Born at Broseley in Shropshire on 17 March 1802, he was the only child of John Hartshorne, an ironmaster,.
Hartshorne had thought of applying to work at the British Museum, but after the scandal had little choice of career.