Goldberg was born in the Brooklyn section of New York City to immigrant parents from eastern Poland (then part of the Russian Empire).
Goldberg was encouraged by career guidance councilors at the school to pursue a career in engineering, since he did well in science and math classes.