How can I remove references to tables after removing .frm files?
Shut down mysql.  What files do you see?  Restart mysql; are things better now?

One possible fix is to CREATE a new table (with a different name), copy the .frm to somewhere else, drop the table, shutdown, copy the .frm back as the problematical table name, restart.