Can we configure logins to only connect to read-only replicas in Azure SQL Database automatically?
No.  But you can disable their logins on the instance that normally hosts the primary replica and have them connect directly to an instance that normally hosts a read-only replica.