The last noble owner was John, Duke of Montagu, from 1709 until 1749 who died without surviving male issue in that year.
It was sold in 1898-9 to the Southwark and Vauxhall Water Company, who pulled down the house, and "excavated [what is described in the Victoria County History of 1912 as] the whole estate for a reservoir".