The core of the present house was constructed in the early 17th century for the Hampden family and then the Lee family.
The house remained a private residence until 1938, when, at risk of demolition, the estate was acquired by the philanthropist Ernest Cook and the contents sold off by public auction.