Why have a small neon lamp in power supply input circuitry?
It is used as discharger for overvoltage conditions - in case of overvoltage a discharge starts through the lamp and that protects the main circuit from overcurrent.

A neon lamp is used because it is relatively cheap, very reliable and there's zero current through the lamp until the discharge actually starts.