 He was a first cousin of the brothers John Foster, last Speaker of the (united) Irish House of Commons, and Bishop (William) Foster.The Fosters had two sons, Frederick (3 October 1777 – 1853) and Augustus John Foster (1780 – 1848).Their only daughter, also named Elizabeth, was born prematurely on 17 November 1778 and lived only eight days.