 Carlebach was a student at "Katharineum zu Lübeck".After he passed his A-levels in 1929 he studied theology and music in Köln.In 1934 he became a teacher at in Leipzig a school for Jewish students founded by his uncle Ephraim Carlebach (1879–1936) in 1912.