 His four elder brothers were Silas, James, Cornelius Jr., and Robert.Thee's younger brother William died at the age of one.Thee married Martha Stewart "Mittie" Bulloch of Roswell, Georgia on December 22, 1853.