The son of a music teacher, Avé-Lallemant studied music (French horn, organ, and piano) from the age of nine, in Greifswald and Lübeck, before settling in Hamburg in 1828.
Avé-Lallemant married, in 1840, Wilhelmina of the Jauch family, the daughter of a wealthy Hamburg merchant.