 In 1823, he left Breckinridge County, Kentucky and came to Perry County, Indiana, settling near the town of Rome.There he met Rebecca "Becky" Lang (1808–1891), and after a brief courtship they were married at Rome by her stepfather, Lemuel Mallory (1763–1851), on April 4, 1824.Joshua and Rebecca Huckeby were the parents of nine children, three sons and six daughters