Voltage Drop on ATMEGA328 when enabling multiple pins
I notice that you do not have any decoupling capacitors anywhere. Not around your regulators, not around your CPU. 

Also you do not have a reset circuit. You need one!

Fix those first before doing anything else.