 Charlotte herself was a healthy child , and according to her biographer , Thea Holme , " The impression one gets from all the early recorded stories of Charlotte is of a happy recklessness , and a warm heart . " As Charlotte grew , her parents continued to battle , and to use the young girl as a pawn in their conflict , with both parents appealing to the King and Queen to take their side . In August 1797 , Caroline left Carlton House , establishing herself in a rented home near Blackheath and leaving her daughter behind — English law at the time considered the father 's rights to minor children paramount . However , the Prince took no action to further restrict Caroline 's access to her daughter . In December 1798 , the Prince invited his estranged wife to spend the winter at Carlton House , which she refused to do . It was the last serious effort at reconciliation , and its failure meant there was little likelihood that George would have a legitimate son who would come between Charlotte and the British throne . Caroline visited her daughter at Carlton House , and sometimes Charlotte was driven out to Blackheath to visit her mother , but was never allowed to stay in her mother 's house . During the summers , the Prince leased Shrewsbury Lodge at Blackheath for his daughter , which made visitation easier , and according to Alison Plowden , who wrote of George 's relationship with his wife and daughter , Caroline probably saw as much of her daughter as she wanted to . 
