Isolating A Noisy Component In A Circuit
At a guess, your problem is decoupling (or lack thereof). Try adding a 0.1 uF ceramic to each chip's power pin and the ground plane, with the 5 volt connection as close to the IC as you can manage. Likewise, add a 0.1 uF ceramic to the 3.3 volt supply at the oscillator.

Furthermore, please add a photo of your complete circuit - a good picture, too, and not some crappy out-of-focus snapshot from your cell phone. Depending on how you've got things connected to the Arduino, you may well have to modify your ground as well.