Joseph Wilson's immigrant family settled in Steubenville, Ohio.
After marrying, Joseph and Jessie Wilson moved to the Southern United States in 1851 and came to fully identify with it, moving from Virginia deeper into the region as Wilson became a minister in Georgia and South Carolina.