How to degrease a bicycle frame?
Citrus degreasers work well. They can be washed away with water. 

If you are going to spray your chain with WD-40, try making some shields with cardboard to keep it off the frame, brakes, wheels, tires etc.