How to show nodes where the user is (not) in the reference field with Views?
You can use exactly the same you did for positive reference but with a single exception. You will see a checkbox contextual field setting names "Exclude". You can check that and the views will exclude the records which have not referenced.