How to connect more than one arduino serial port together
You can do it with two diodes and a resistor:



simulate this circuit &ndash; Schematic created using CircuitLab
You'll still have to implement some system to prevent collisions, but electrically that will be sound.