The highest point in Hart's Location is above sea level along the town's western boundary, beneath the summit of Mount Willey. Arethusa Falls, New Hampshire's highest waterfall, located in the neighboring township of Livermore, is a popular hiking destination with access from U.S. Route 302 in Hart's Location. The town lies fully within the Saco River watershed.