In 1580, as a result of the Dutch Revolt, the castle fell into the hands of the States of Utrecht.
In 1852 the town council became owner of the castle and turned the surrounding fortifications into a park.