Is there software for transcribing and recognizing musical pitches in an audio recording?
No, GarageBand cannot do this. You should investigate the commercial products Celemony Melodyne and Neuratron AudioScore.

Also have a look at Capo by SuperMegaUltraGroovy. It provides a good method for assisting a person in transcribing by ear.