Gerry was born in New York City on December 5, 1911 to Robert L. Gerry Sr. and Cornelia Harriman [REF].
Robert L. Gerry Jr. was the nephew of U.S. Senator Peter Goelet Gerry, Governor W. Averell Harriman, Junior League founder Mary Harriman, and E. Roland Harriman.