How can I delete all voicemails from my iPhone?
Via swipe left on multiple voicemails you can delete them, and on the Phone app, you can even "delete all" of them.

But to delete Permanently all voicemails Permanently, meaning could not be recovery by any software, you should try iMyfone Umate.