Delaying part of circuitry
simulate this circuit &ndash; Schematic created using CircuitLab

This might work better depending on your actual timing diagram specs.  


20~30us dual edge +ve pulse on switch toggle. Can be debounced better than shown.