Enable cache on AWS RDS for MySQL
You can tune performance using Parameter Groups. Some (unfortunately, not all) variables can be configured there.

Also, if you used AWS Database Migration make sure you have all the keys you need because they're not transferred by default.