After serving as a chaplain in the United States armed forces during World War II, Goldberg moved to Israel to study at the Hebrew University in Jerusalem, where he remained until his retirement.
After graduation, Goldberg served at the Hebrew University as professor and professor emeritus of Talmud, as well as chair of the Talmud department.