ESP32 stuck in reset
I just found the issue:
Although both, my external and on board power supply were stable, I still had too much noise at the ESP 3.3V pin. This, I believe, caused the ESP to run unstable and to reset all the time. I forgot to put a large enough decoupling capacitor directly at 3.3V and GND pin of ESP. With a capacitor in place, it works.