Collins was born in Rome, Italy, on October 31, 1930, to U.S. Army Major General James Lawton Collins, who served in the army for 38 years.
After the United States entered World War II, the family moved to Washington, D.C. where Collins attended St. Albans School, from which he graduated in 1948.