SQL Server AlwaysOn ReadOnly Routing to Secondary
Does anyone know what is wrong with the settings or reason for this? I checked altering the settings but didn't work.  


You may verify the read-only routing configuration based on this post

Once all set (upon validation): If you're using SQL Login, try to mention default database that is part of AG, then your connection must be re-direct to secondary replica. 

or mention following parameter from SSMS connection. This is how usually every application connects.

ApplicationIntent=READONLY; Initial Catalog=YourDatabase