Get entities that share the Entity Reference field
I finally found a way to do it, here are the steps:


Add a relationship: Entity Reference: Referenced Entity, select the right field to match, select "Require this relationship"
Add a relationship: Entity Reference: Referencing Entity, selection the just add relationship in step 2 and check "Require this relationship".
Add a contextual filter: Content:nid, provide default value: Content ID from URL
Add a contextual filter: Content:nid, select the relationship "Content referencing...", provide default value: Content ID from URL, then in the More fieldset, check exclude.
Add a field "Title" and select the relationship "Content Referencing..."


I will close this question, feel free to comment or propose other solutions.

Thanks.