 His sisters were Lady Joanna Gore (wife of Philip Doyne and, after his death, Michael Daly) and Lady Elizabeth Gore (wife of Sir John Evans-Freke, 1st Baronet).His paternal grandparents were Sir Arthur Gore, 2nd Baronet, and the former Elizabeth Annesley (a daughter of Maurice Annesley of "Sherlock v Annesley" infamy).His aunt, Anne Gore, was married to John Browne, 1st Earl of Altamont.