Cheap high-voltage low-current source
Just addressing the 'cheap' aspect, have you considered re-purposing the circuit from a relatively cheap COTS electric flyswatter.

Not exactly a good way to learn how it was designed, but it might get you there quick and dirty.   You might even need to use a voltage divider to bring the voltage back down