How can I disable voicemail notifications?
The only thing that worked for me is to stop the Phone Application. It restarts itself again, so you don't have to worry for missing calls or anything.

Steps:


Settings -> Apps -> ALL -> Phone.
Click Force stop


Source:
Clear Voice Mail Notification Icon