All Music Off iPhone
This isn't through the iPod app, but it (should) delete all the music from your device.

Settings > General > Usage > Music > Edit (button, upper right hand corner) > "-" button > Delete.