According to the United States Census Bureau, the town has a total area of , of which is land and is water, comprising 0.97% of the town.
New Ipswich is bordered by Rindge to the west, Sharon and Temple to the north, Greenville and Mason to the east, and Ashburnham, Massachusetts and Ashby, Massachusetts to the south.