Entity Reference View Widget problem with add selective
I solved a very similar issue by changing the display type to "Entity Reference" (not "Entity Reference View Widget") and using using the ER Widget only for the view checkbox selection field.

Here is a detailed step-by-step guide to a solution which worked for me using the latest Drupal 7 dev version of the ER Widget module.