Listener pointing to incorrect AlwaysOn Availability Group
An Availability Group Listener simply connects the user to a database instance. Once they are connected to the instance they can access all the databases on the instance. It doesn't matter of the databases are part of the availability group or not. This is by design. 

In other words everything is working exactly as it should be.