Need help with wiring of in-line ventilation fan
Since you are running the wires back to the control unit anyway - I would run 4 wires back to the unit and connect them all including the ground in that location.

This should prevent any issue with ground loops.