 He remarried in 1898 to Lillie Hix; they remained married until her death in 1946.He had two sons and two daughters.His elder brother was Rufus A. Doughton, who was at various times Speaker of the North Carolina House of Representatives and Lieutenant Governor of North Carolina.