 Substantial alterations were made to the structure in 1764 by Newton Ogle (1726–1804), Dean of Winchester, who also in 1788 erected an obelisk in the grounds commemorating the accession of William III and Mary II in 1689.The Reverend John Saville Ogle substantially rebuilt the house in about 1832.

Notable members of the Ogle family connected with Kirkley include Admiral Sir Chaloner Ogle and Sir Chaloner Ogle, 1st Baronet.See also Baron Ogle and Ogle Baronets.