'Can't create thread to handle new connection' on RDS
This might help you 
A Percona blog of tale of 2 limits

We (not RDS) had the second issue after we failed over as part of a disaster recovery exercise.

How old are the RDS instances, were they upgraded, replaced failed over...? Enjoy :)