PCB Single 90 Degree Connectors for More Secure and Removable Connection
How about a ring crimp connector?

Nice and robust and, properly screwed on, won't come off.  Or perhaps a spade connector.  Pictures at Wikipedia.  Long catalogue at TE