How can I temporarily soundproof my apartment ceiling?
Ridged foam insulation might work here.  It comes in large pieces and is lightweight enough that it won't take many fasteners to hold it up (so you'll have less nail holes to fill when you leave).  The downside of course is that it isn't very pretty.