Render glass distortion and not background
There's an easier way.

Select the background plane, go to its object settings, then scroll down to Cycles Settings. Uncheck 'Camera'.



That's it!

Here's the 3D view and the rendered view to demonstrate the effect: