Reduce power noise on AVR
Here is an image how I always use a voltage regulater. I would also recommend to connect a (ceramic) capacitor of about 22pF between the crystal pins and the ground. I also put a ceramic capacitor of 0.1µF between the Vss and Vdd pins of the microcontroller itself.

Hope this helps.