How do I delete a tag? Where in the Craft Control Panel can I globally delete a tag? 

Not from a specific entry, but completely out of the system.
Currently it’s not possible to delete tags (or otherwise manage them).