Contextual filter is not working
So you just need to place 1 contextual filter for nid and one relationship with referenced entity, and use that relationship in fields. 
See the attached screenshot of a demo view.