 It remained in the Ferrers family for more than 200 years, and in 1453, passed to Walter Devereux, through his wife Anne de Ferrers, the Ferrers heiress.Through his wife, Walter also became "jure uxoris" Baron Ferrers of Chartley in 1461, and was killed at the Battle of Bosworth in 1485.The castle was then abandoned as a residence, and Chartley Manor, a moated and battlemented timber mansion, was built nearby.