The family emigrated to South Australia in 1859 where Rev. Gordon took charge of the Presbyterian church at Mount Barker, and was afterwards stationed at Gawler.
On 4 January 1877 at the Presbyterian church, Strathalbyn, Gordon married Ann Wright Rogers (20 February 1855 - 20 April 1951), youngest daughter of William Rogers MHA.