Mount Raimer is located within Williamstown, Massachusetts and the New York towns of Petersburgh and Berlin. The Taconic Mountains continue south from Mount Raimer as Berlin Mountain and north as the White Rock ridgeline. It is flanked to the east by several hills that precede the Hoosic River Valley and the town of Williamstown. The west side of the mountain drains into the Little Hoosic River, thence into the Hoosic River, the Hudson River. The east side drains into the Hoosic River. Petersburg Pass, located on New York Route 2/ Massachusetts Route 2, cuts over the gap between Mount Raimer and the next summit to the north, Smith Hill, at an elevation of , just north of the summit of Mount Raimer.