Music App crashes frequently under iOS 5.0.1
It seems to be a software based issue. I would suggest backing up and restoring the device using these steps. I know you are wary about erasing all your music, but you can back it up to iTunes before doing this. Make sure you set it up as a new device so as not to transfer any old software back to the phone after the restore.