How to delete unwanted material?
In Blender Version 2.79b go to "Blender File" in the Outliner. Find the material you want to remove and right click it. An option to delete it will be presented to you. 

Be warned that this will permanently delete the material with no undo.