Mrs. Fitzherbert. Since Lady Jersey enjoyed the favour of Queen Charlotte, even the displeasure of George III was not enough to threaten her position, and she continued to run the Prince of Wales' life and household for some time. In about 1803, her previously undisputed place as senior mistress to the Prince of Wales was challenged by his infatuation with Lady Hertford. In 1807, he replaced Lady Jersey, and she lost her position as Lady of the Bedchamber, and would come to have no active involvement with the royal court. According to Archaeologia Cantiana,The home of the Bishop's daughter Frances, Lady Jersey, a favourite of George IV, became a society gambling rendezvous, at which the reputations of her cousins were in no way enhanced. Though it may be said the death of her husband—who had narrowly avoided imprisonment in 1802—in 1805 left her without the means to support her rank, her son increased her jointure to £3,500 per annum and settled her debts many times. Nonetheless, "her attempts to economize appear to have been unavailing". She died on 25 July 1821 in Cheltenham and was buried at Middleton Stoney in the Villiers family vault. Children Lady Charlotte Anne Villiers (1771–1808), married Lord William Russell in 1789, and had issue. Lady Anne Barbara Frances Villiers (1772–1832), married William Henry Lambton and had issue, including John Lambton, 1st Earl of Durham; married secondly Hon. Charles Wyndham, son of Charles, 2nd Earl of Egremont. George Child Villiers, 5th Earl of Jersey (1773–1859), married Sarah Sophia Fane daughter of John Fane, 10th Earl of Westmorland and Sarah Anne Child, only child of Robert Child, the principal shareholder in the banking firm Child & Co. Lady Caroline Elizabeth Villiers (1774–1835), married firstly Henry Paget, 1st Marquess of Anglesey and had issue. She divorced him in the Scottish courts in 1809 and married secondly, George Campbell, 6th Duke of Argyll. Lady Georgiana Villiers, d. young. Lady Sarah Villiers (b. 1779), married Charles Nathaniel Bayley in 1799. Hon. William Augustus Henry Villiers (1780–1813), died unmarried in America, having assumed the surname of Mansel in 1802, pursuant to the will of Louisa Barbara, Lady Vernon daughter of Barbara Villiers and Bussy, 4th Lord Mansell. Lady Elizabeth Villiers, d. unmarried 1810. Lady Frances Elizabeth Villiers (1786–1866), married John Ponsonby, 1st Viscount Ponsonby, in 1803. Lady Harriet Villiers (1788–1870), married Richard Bagot, Bishop of Oxford in 1806, and had issue.