Noise on glass in cycles
I went with the following settings, which seemed to do the trick.


Removed the emission planes and replaced with a sun light source
Changed the color management to "Filmic" since that is supposed to be better with dynamic range
Used denoising to eliminate most of the grainy look
Increased the resolution of my animation to 1080p (not sure if that made a difference, but it looks better to me)