Add all related content from entity reference with views
Click the "More" link in the contextual filter. That fieldset is collapsed by default but you'll find the option to make exclusions there. You may have to exclude the current node ID separately--not sure about that.