Why does this crystal oscillator have a window?
@SteveHubbard has it right. The crystal has to be hermetically sealed preventing gas migration into the chamber, so plastic alone will not work. Glass is an excellent material for creating gas-tight hermetic seals with through-conductors.  The crystal chamber will be filled with a dry inert gas or a vacuum.