How do I remove unwanted Transform Orientations?
The custom transforms are also listed in the 'Transform Orientations' panel in the Properties shelf (N).

Choose the custom transform you would like to delete from the list, then press the 'x' next to it to remove it: