What apps/programs/daemons on OS X use my ~/.ssh/id_rsa* keys?
Amusingly, your own question includes the answer. GitHub for Mac uses Git via SSH, and will automatically generate unprotected SSH key pairs (e.g. no passphrase) in order to push/pull contents between the remote repo and your local ones.