Sandford was born in Footscray, Victoria the eldest son of Scottish-born businessman Alexander Wallace Sandford.
He joined A. W. Sandford & Co. in 1901; his father died in 1906 and James took over control of the company, which had diversified into an importer of agricultural machinery, in 1911.