How to know when to scale RDS MySQL instance? How to scale it?
You need to scale it up when resource of CPU and disk io is the bottleneck and the cost of optimising the database is higher than scale up.

There are many way to scale it horizontally for sure. Master slave replication is one of the most used way to scale horizontally. You can also run MySQL cluster too.