It has included a garden, as a replacement for an earlier garden which had been destroyed under siege from Sweden in 1659- the Queen's Garden, which was located beyond the city's western Gate Vesterport, an area today known as Vesterbro.
Work on the garden began in 1664, and the castle was built 1669-1673.