 His brothers were Richard who became MP for Wigan, and William.His father, John Potter, was born on 7 December 1728 in Tadcaster and died there on 28 November 1802.He is buried in grave 40655 at St Mary the Virgin's Church in Tadcaster.