Initial pluse from schmitt trigger switch debouncer
The cap charges through R1 and the diode when the switch is open, and sit at a diode drop below Vcc, producing a LOW on the output of the schmitt inverter.  So yes, the output is high until the cap is charged.  Any system using this will need to deal with the initialization transient.