How do I remove old hockey tape from drop bars
A razor blade/knife/x-acto knife should cut it. Hockey shops have special knifes for cutting through hockey tape if you want a specialized device. This shouldn't be a problem for non-carbon bars though, if you're careful.

The residue can be removed with rubbing alcohol or soapy water or mineral spirits (again, for carbon, I'm not sure what you'd do).