Buck converter step response
The characteristics of a passive network like this are very much dependent on the load impedance it sees. Obviously, the step-up scenario has half the load impedance of the step-down scenario, and this provides greater damping (lower "Q").

If your converter had feedback and dynamic control of the switching duty cycle, you could pretty much eliminate these effects.