He was born on 17 February 1820 at Baskerville House, Worcestershire, the eldest son of John Richards of Wassell Grove near Stourbridge, who was M.P. for Knaresborough from 1832 to 1837.
Richards entered his name as a law student at Lincoln's Inn on 16 May 1839.