Best cover for IR proximity sensor?
It will reflect very little IR back on the sensor as long as the window is perpendicular to the travel of light.  You can enhance this by shrouding the sensor or emitter right up to the window with something that doesn't pass IR light.

While a little will come back due to the window, the difference between that small reflection and a reflection from an external object should be so great that detection isn't a problem.