Removing material from project
To remove a material from your file, go to the materials tab and shift+Click the × next to the material.

The material will be set to 0 uses. Consequently, saving your project, closing and reopening it will remove it from the list of available materials.