Hayton Castle is the centre of a small manor within the baroncy of Allerdale, whose families have featured prominently in the history of Cumberland.
It was from this marriage of Margaret Colville and Nicholas Musgrave (1450-1506), fourth son of Sir Thomas that sprang the line through which the manor was handed down for fourteen generations, lasting about 300 years.