How to keep capacitor from discharging in/through regulator
Ok thanks for your comments.
The tank cap before the LDO seems to be the right way.
I'm gonna test this solution.

By the way I also found this question, and the answers interesting :
Help with power-loss protection using capacitor