SQL Server 2016 Always On ReadOnly Routing List
Port 5022 is the endpoint that is used for mirroring, not for client connections.  You just need to connect to the listener on same port as usual (1433 if using the default), and the availability group will route the read-only connection to the secondary.

See Connecting to ReadOnly Secondary Replica of SQL Server via the Listener by Default for further explanation.  

To test a read-only connection with SQL Server Management Studio, select Options, and on the Additional Connection Parameters tab enter "ApplicationIntent=ReadOnly").  Then use a SELECT @@SERVERNAME query to confirm the connection is routed to the secondary.