Just before the Norman conquest the manor of Chesterton was held by Wigod, a Saxon thegn who was a kinsman of King Edward the Confessor.
A few years later the manor passed to John Williams, 1st Baron Williams de Thame, who in turn left it to his daughter Margery and son-in-law Henry Norris, 1st Baron Norreys.