Lady Anne Catesby had a life interest in a large portion of the property, given her by her husband at their marriage. This preserved a portion of the estate from alienation, and though an attempt was made in 1618 to reverse that, the settlement remained. In 1612, it was purchased by Bryan I'Anson (1560-1634), Sheriff of the City of London. He was the father of Sir Bryan I'Anson, 1st Bt., of Ashby St Ledgers; Gentleman of the Bedchamber to Charles I of England. In 1703, Esther I'Anson (Sir Bryan's elder brother John's great-granddaughter) sold the manor to Joseph Ashley, a London draper. When his great nephew, also called Joseph Ashley, died in 1798, the manor passed to his daughter, Mary, who was the wife of Sir Joseph Senhouse. Their daughter, Elizabeth, married Joseph Pocklington in 1835, and the manor remained in their family until 1903, when it was sold to Ivor Guest, 1st Viscount Wimborne, who had previously rented it for hunting. Viscount Wimborne's grandson and namesake, Ivor Guest, 3rd Viscount Wimborne, sold the estate in 1976. It passed through a series of owners, including the British Airways Pension Fund, who separated the manor house from the rest of the estate. In 1998 the 3rd Viscount's son Ivor Guest, 4th Viscount Wimborne, bought the house, which had fallen into neglect, and restored it over two years. It was purchased by his cousin, Henry Guest, and his wife Nova. The original medieval manor house was gradually replaced by later buildings, starting with a new range probably erected by the Catesbys in the early Tudor period. The I'Ansons created the main façade and an adjacent tower in the first half of the 17th century, together with another freestanding building across the court from the surviving medieval building. After being widowed in 1828, Mary Senhouse took up residence in the manor and expanded it in Jacobean revival style; a lifesize oil painting on the cellar door of a "Herculean" figure brandishing a club dates to this period and presumably alludes to the Guy Fawkes association of the house. The house was further expanded throughout the 19th century and then under the ownership of the Wimborns extensively remodelled by Edwin Lutyens, who worked on it for 40 years, the longest commission of his career, while also carrying out other commissions in the village. He created a new garden façade and a new range with