Capacitors in series, equivalent capacitance to reduce voltage rating
You will have to include a parallel resistor-ladder to stabilize the node voltages. The resistor values must be high enough for the low-pass to be effective
$$f_c = \frac{1}{2\pi RC} $$
and low enough to ensure a save operating point (smaller than the capacitors leakage).
This will cost you some additional power.