According to the United States Census Bureau, the town has a total area of , of which, of it is land and of it (9.42%) is water.
New York State Route 364 intersects New York State Route 245 (a north-south highway) at Middlesex village.