 George IV came to the throne in 1820 intending to create a set of royal palaces that reflected his wealth and influence as the ruler of an increasingly powerful Britain . George 's previous houses , Carlton House and the Brighton Pavilion were too small for grand court events , even after expensive extensions . George expanded the Royal Lodge in the castle park whilst he was Prince Regent , and then began a programme of work to modernise the castle itself once he became king . 
