Charge Pump Inverter Noise
The most likely problem here is the self resonance of the output capacitor.  Try putting smaller capacitors in parallel with it.  At the noise frequencies in your scope photo, the 22uF capacitor is looking like and inductor.