 He was the son of Elmes Steel (d.1824), surgeon of Coleford, and Mary Benfield (1749-1831).Two of his brothers served as officers in the Royal Navy and three as officers in the British Army.His uncle, Colonel Samuel Steel, served in Quebec under Lord Amherst.