 He married Margaret S. McCollum in Lincoln County, Tennessee, on 29 December 1850.To this union were born two children Sarah Louise (Sallie) Armstrong (1851-1934) and David Armstrong (1853-1871).In November 1855, at the age of 36, Armstrong moved with his family to Texas, settling in Coryell County near Gatesville, Texas.