After his father's death, his mother Margaret (Owandah), the niece of Tiaogeara , a Caughnawaga sachem, returned to the province of New York from Ohio with Joseph and his sister Mary (also known as Molly).
On September 9, 1753 his mother married again, to a widower named Brant (Canagaraduncka), a Mohawk sachem.