The castle itself includes a motte and two bailey enclosures, approximately and across respectively. It had timber defences, ditches and additional flanking earthworks. The castle appears to have been abandoned in subsequent years, and it may be that it was destroyed after William de Ferrers' part in the Revolt of 1173-74, or it might have become abandoned when the land passed to the Duchy of Lancaster after the sixth Earl was dispossessed. Alternatively, it may simply have become redundant as nearby Hartington grew in importance and the village of Pilsbury became increasingly depopulated.