How long does it take on average for a control surface to deflect by one degree?
With hydraulically actuated flight controls, the deflection speed is only limited by the maximum hydraulic fluid flow through the servo valve. I've taken some step responses of civil airliners in the past, and on-ground they can deflect full range in about 1-2 seconds.

For a mid-range passenger jet:


Elevator range = 42 deg, max no load deflection speed = 66 deg/sec
Aileron range = 40 deg, max no load deflection speed = 66 deg/sec
Rudder range = 48 deg, max no load deflection speed = 56 deg/sec


At higher airspeed the maximum deflection angle and speed become less due to aerodynamic blowback - by design, to limit the inertia forces on the airframe.