Switch between two serial ports
just use a DPDT switch

[edit] Choosing the right kind of switch is important.
As the signal is a low voltage and low current you want a type of switch
where the contacts are self cleaning, like a rotary or slide switch.