SQL Server Management Studio cannot Connect to Always On Availability Listener
When you configure your listener to use a non-default port (any port other than 1433), then you need to specify the port number in the server name when connecting in order to connect successfully.

This is detailed in the documentation here.