The importance of the fortress decreased steadily, resulting in its slow decline. A rebuilding of the castle in the 16th century was never carried out due to the high cost. During the Thirty Years' War, the castle changed hands several times, although its garrison remained intact. Since this type of fortification had become insignificant due to the changed nature of warfare, demolition of the remaining elements of the ruin began in 1650. Since then the castle has amounted to little more than its foundation ruins and well. The urban settlement of Neustadt at the foot of the Großer Burgberg adopted the castle's name in 1892.