The first settler in the area was James Taylor, who built a house there after 1730.
Hampden-Sydney College apparently planned to use the property as a Presbyterian boarding school, and retained the New York architectural firm of Visscher & Burley to draft a master plan.