Views filter criteria
I just tested this and got the same problem as you. 

I found the solution you need to check mark limit to selected items. 

If you don't have the Limit list option, check marking the expose operator also fixes it. You would then have to use css to hide the expose operator if you don't want it.