The manor house was built around 1260 as a community house for two Knights Templar.
In 1335 the manor was bought by William Montacute, 1st Earl of Salisbury and in 1337 he founded Bisham Priory alongside, within the year of his death 1344, he was buried in the abbey.