 Frances was one of the two daughters of Sir James Altham of Oxhey (son of the judge Sir James Altham) and his wife Elizabeth, the daughter of Sir Richard Sutton.Her sister Elizabeth married Arthur Annesley, 1st Earl of Anglesey.As co-heiresses, the Altham sisters had a considerable inheritance.