Train service at Great Notch originated with the introduction of the Caldwell Railway, a service that went from the community of Caldwell, New Jersey to the New York & Greenwood Lake Railway.
By the early 1970s, the Great Notch station, which was falling into disrepair, received a new paint job, changed from the red-green colors for the Erie Lackawanna to a new all red Erie Railroad paint scheme.