 In the early 13th century the castle was the seat of the imperial ministeriales family von Mildenstein who had to give up their properties in the area after they lost a dispute over the entitlement to tithes from former church properties, and Margrave Henry the Illustrious captured the castle in 1232.The Burgraves of Leisnig founded Buch Abbey in 1192 and acquired the lordship of Mutzschen before 1308.They became one of the most powerful families in the area.