 The castle may have started as a solar tower, which could have been added to an existing manor house approximately 1315.Further towers appear to have been added incrementally throughout the course of the fourteenth century.Early owners included Fitz-Marmaduke, Viscount Lumley and Gascoigne.