Part of the Waldo Patent, it was called the Lower Plantation of St. Georges, once extending across both sides of the St. George River.
The Olson House was depicted in Andrew Wyeth's 1948 painting, Christina's World, which in turn was used as Dahlia Gillespie's house in the horror video game series Silent Hill, and inspired the farmer's house in the 1978 film Days of Heaven.