Low ESL Capacitor Types
X2Y capacitors are available from various manufacturers, the MLC structure has three plates, and two of them can be paralleled which cuts back on the ESL (kind of like two inductors in parallel). 

The Layout will also affect your application as vias and a few nH of inductance. A spice simulation might help find out how much inductance the circuit can tolerate by adding board and component parasitics. 

The voltage rating can be increased with the capacitors in a series configuration if needed but the inductance also increases. A parallel\serial configuration might be solve both problems.  

Regular Capacitor parasitics look like this:






simulate this circuit &ndash; Schematic created using CircuitLab