Arduino power on button problem
Leave the Arduino powered permanently.
Make your code put the device to sleep at the appropriate time.
Look up examples of "wake from sleep".
You just wire the wake button to the wake-from-sleep input.


The micro will turn on at initial power-up.