Robber in fishing version of Settlers
The rules (here) actually state that for two fish you may:


  Move the robber back to the desert (do not steal any cards)


It isn't removed from the board, but is placed on the desert (where it has no effect). A knight may still then move it as normal.