 William III commissioned Nicholas Hawksmoor and Sir Christopher Wren to conduct a large , final classical remodelling of the Upper Ward , but the king 's early death caused the plan to be cancelled . Queen Anne was fond of the castle , and attempted to address the lack of a formal garden by instructing Henry Wise to begin work on the Maestricht Garden beneath the North Terrace , which was never completed . Anne also created the racecourse at Ascot and began the tradition of the annual Royal Ascot procession from the castle . 
