View with empty filter result visible only to admin user
So, in the end I followed some advice I found on another somewhat similar problem which said one can go onto the Advanced Settings on your view > Query Settings > check "Disable Query Rewriting"

This worked, but anyone following this advice should be aware of the security implications regarding visibility.