Misery Mountain is located within the New York towns of Stephentown and Berlin and the Massachusetts towns of Hancock and Williamstown. The Taconic ridge continues south as Rounds Mountain and north as Berlin Mountain. Misery Mountain is flanked to the east by Brodie Mountain. The northwest side of Misery Mountain drains into the Little Hoosic River, thence into the Hoosic River, the Hudson River, and New York Harbor. The southwest side drains into West Brook, Kinderhook Creek, thence the Hudson River; the southeast side into Kinderhook Creek. The northeast side drains into the West Branch of the Green River, the Green River, thence the Hoosic River.