Hilton was born in Dallas, Texas, the son of Mary Adelaide (née Barron; 1906-1966) and Conrad Nicholson Hilton (1887-1979), founder of Hilton Hotels.
He served in the Navy during World War II as a photographer.