Heidelberger was born in 1888 in New York City to David and Fannie Campe Heidelberger, a traveling salesman and a homemaker respectively.
Heidelberger decided at age eight that he wanted to be a chemist, for reasons he could never quite articulate or recall, but which he later judged no more than a "pigheaded idea".