The first frame dwelling at Penn Yan was built in 1799.
The first settlers were chiefly followers of Jemima Wilkinson (1753-1819), a religious enthusiast, born in Cumberland Township, Providence County, Rhode Island.