The first permanent settlement occurred in 1819 at Whitesville, although an attempt was made to settle the town in 1798.
From November 16, 1896, through June 1936 Whitesville was served by the New York & Pennsylvania Railway (and predecessors) as part of its Canisteo to Ceres (via Greenwood, Genesee, Oswayo and Shinglehouse) main line.