Is there a big RSA Data Set
No.  You can generate such a dataset for yourself by generating lots of RSA keypairs yourself.  Therefore, there's no need for such a dataset (and no reason why anyone would publish one).