 Mitford Castle was the first of three seats for the main line of the Mitford family constructed on manor lands.Following the destruction of Mitford Castle, Mitford Old Manor House (nearby and to the northwest) was used from the 16th century until the construction of Mitford Hall in 1828.Mitford Hall stands in an park to the west of the castle ruins.