 He attended Emory and Henry College, then read law.He married Sarah Elizabeth (Lizzie) Duncan (1845-1869) in 1864 and had a son (Henry C. L.Richmond) and daughter (Mary Elizabeth Richmond Cox Deisher) before her death.The year following Lizzie's death, Richmond married Catherine (Kate) Morison (1844-1911) of Scott County.