Rudolph, the son of Bishop Robert Livingston Rudolph and his wife Anna Knight Rudolph, was born in New York City on June 8, 1906.
After attending the Collegiate School in New York, Rudolph earned his undergraduate degree at the University of Pennsylvania in 1929.