He was born in York, Upper Canada (later Toronto) in 1821, the son of Sir John Robinson, an important political figure in Upper Canada.
He briefly lived at The Grange, a house in Springfield, Toronto Township.