Can I retrieve Whatsapp voicenotes which have been deleted while recording?
If the dustbin animation is shown the voice note probably is deleted. 

Or you can check all the saved voice notes on the SD card. 
The path is 
Whatsapp/Media/Whatsapp Voice