Can a surface reflect in black and white?
You can use the light path node. This node allows you to use different materials for each incoming ray type.  



However, this approach is not ideal, since you have to modify the object's material and not the glossy material itself, which becomes almost unmanageable quickly.