Driving LM317 with pwm signal
shouldn't I get an output voltage 1.25v greater than the adjust voltage?
  When I measure V_out - V_adj I get about 2V.


Yes, assuming other conditions of the circuit is satisfiedd.


  What's wrong with my circuit?


Read the data sheet thoroughly. The circuit requires some minimum level of current to flow through for it to work.