Glossy reflecting only one object
A while back, I found this tutorial on YouTube. Perhaps you can do something similar.

Another thing you could consider is taking a picture of the desk and mapping it onto your shadow-receiving plane. Then try adding glossiness again. This should provide a nicer rendition.