On 14 December 1957, he married Anne Mary Sibylla Abel Smith, the daughter of Henry Abel Smith and Lady May Abel Smith.
Liddell-Grainger and Christine de la Rue (née Schellin) conducted an affair in the 1970s that was open knowledge.