How to delete all the recordings from the Voice Memos app on iOS?
Open the app and you'll find a little symbol with 3 horizontal stripes in the right bottom corner.
You'll get a list and you can tap the memo and click "delete" right afterwards.

Or in iTunes you can select all voice memo's after you've synced them to your PC and delete them from there.