 He was the son of infantry captain Nicolay Tostrup (1768–1858) and his wife Thale Margrethe Resen Holfeldt (1779–1860).He was born into a family with eight siblings.Around 13 years of age, he worked for a local silversmith.