According to the United States Census Bureau, the town has a total area of 35.6 square miles (92.3 km²), of which, 35.6 square miles (92.2 km²) of it is land and 0.04 square miles (0.1 km²) of it (0.06%) is water.
New York State Route 29 is an east-west highway across Milton.