Rogers was born at Newington Green, then a village north of Islington, London.
Two nephews, orphaned young and for whom he assumed responsibility, were Samuel Sharpe, the Egyptologist and translator of the Bible, and his younger brother Daniel, the early geologist.