 Richard had married Sir Thomas's stepdaughter, Mary Turner, in 1804.Richard and Mary had two daughters, Isabella and Elizabeth, who inherited their parents' fortune in 1843.The sisters demolished their ancestral home in Ireland, and built a new Castle Oliver a few hundred yards to the north east.