Loss of power when I remove item from the outlet
Defective receptacle.

Kill it with fire, before it kills you with fire.  

And if it has backstab connections (wires jabbed in back holes that auto-grab them) this is a good time to  get rid of em.  Because they cause this kind of mischief too.