The wilderness area is named for its second-highest peak, Jay Mountain. The highest peak within the area is actually Saddleback Mountain, not be confused with the mountain of the same name within the High Peaks Wilderness Area of Adirondack State Park (which is the 17th highest peak of the Adirondack Mountains).