Stalls: which flight control surface is effective last?
It depends on the type of stall and the loading configuration of the aircraft. The short answer is that the rudder typically stalls last because the angle of attack of the wings is independent of the AOA of the vertical stabilizer. However it's usually among the least effective control surfaces in getting out of a straight dive (very useful for recovering from spins and spiral dives though).

Of the horizontal surfaces, it depends on which one has a higher AOA at the time the wings stall, which is dependent on how the plane entered the stall, and how the aircraft is configured. A sudden pitch-up in an airframe with an aft CG will cause the horizontal stabilizers and thus the elevators to depart first. In most other situations especially when the CG is forward of the CL, the wings will have the higher AOA as the nose pitches downward, so the elevators will remain useful as long as the tail isn't caught in the turbulent airflow off the wing. T-tails have this disadvantage; the higher tail location normally puts the tail in cleaner air, but in a stall the turbulent air off the wing shelters the tail making it less effective.