Maritime Trading both ways?
This is covered in the Catan FAQ:


  Trade - What is the meaning of the resource symbols on some harbor
  hexes?
  
  Answer The special harbor hexes always show the resource type of which
  you have to discard 2 units in order to receive one different resource
  or one commodity.


In other words, it only works one way - the way you expected.