Select Vertices by Material Color
You could select the material slot and then click 'Select', which will select the faces that have this material. Only faces have material assigned, vertices don't.

You can do this in Edit mode only with thanks to Delagone :)