 Mildenstein castle was probably built in the 10th century.However, it was first mentioned only in 1046 when Emperor Heinrich III gifted the Burgwards of Colditz, Rochlitz, and Leisnig to Agnes of Poitou.In 1084 the castle was enfeoffed by Emperor Heinrich IV to Wiprecht of Groitzsch.