There is documentary evidence that a castle was built on the existing site soon after the Norman Conquest.
Around 1667 the manor was restored to the See of Durham to be leased out as a farmhouse to various people until Bishop William van Mildert was allowed by Parliament to sell it into private hands in 1827.