 In 1315, Mitford Castle was used by Sir Gilbert for kidnappings and as a prisoner hold, when Ralph de Greystock seized de Middleton for treason.There are conflicting accounts over the castle's destruction.One theory is of a fire during Middleton's rebellion.