On November 26, 1939, Gravel wed the former Katherine David, who died in 1979.
Gravel's second wife, whom he married in 1980, was the former Evelyn Gianfala (1922-2012), a native of Berwick in St. Mary Parish, who was the president of Gianfala & Son Oil Field Construction Company.