In 1917 he married Lady Mary Gascoyne-Cecil, granddaughter of Prime Minister Robert Gascoyne-Cecil, 3rd Marquess of Salisbury.
William Cavendish, Marquess of Hartington (1917-1944), killed in action in World War II.