While living in Lafayette County, Arkansas, Conway met Mary Jane Bradley, who had also migrated with her family from Tennessee.
Conway was the brother of Arkansas Governor Elias Nelson Conway, brother of Congressman Henry Wharton Conway, first cousin of Senator Ambrose Hundley Sevier and Governor Henry Massey Rector.