RDS IOPS utilizing fully
First try to review current caching parameter values.
Then check list in AuroraMySQL.Reference.ParameterGroups
And try to tune/increase caching parameters like query_cache_size

Alternative solution is to use architecture redesign with AWS CloudFront to reduce load on primary system (probbly web?).