 His maternal grandfather was Richard Saunders (a grandson of Henry Whitfield, MP).Upon his grandfather's death, his father became the 3rd Gore Baronet of Newtown.After his father was raised to the Peerage of Ireland as Baron Saunders of Deeps in the County of Wexford, and Viscount Sudley of Castle Gore in the County of Mayo in 1758, he was styled The Honourable Arthur Gore.