How to configure and use multiple ssh RSA keys with Keychain help
ssh-agent can do this: use ssh-add -K path/to/key to store the passphrase for the key in your Keychain. Whenever you do something requiring that key you won't be prompted for your password, provided the Keychain is unlocked.

This article gives more information, as does this related ServerFault question.