 He married Elizabeth Lord Cogswell on October 1, 1840.They had two sons, James Wyllys Dixon and Henry Whitfield Dixon, and two daughters, Elizabeth L. Dixon and Clementine Lydia Dixon.Clementine was courted (unsuccessfully) by the paleontologist, Othniel Charles Marsh.