In 1830 a Swedish emigre, Prince Gustavus Wasa, son of the deposed & exiled King of Sweden Gustav IV, bought the castle and began systematically to build it as the representative seat of his family.
During World War II, the castle was occupied by the Wehrmacht (Germans set up barracks), and during this period area was extensively damaged, including shooting damage to the second floor of the so-called palace.