Sauvage grew up in the mining community of Penrhos, Rhosllannerchrugog, Wales, the son of Thomas and Mary Savage of The Square.
At the age of eighteen, he left to seek work in the coalfields of Ohio in the United States with several other young men from Rhos.