The town is located along the eastern border of Clark County, adjoining Marathon County.
According to the United States Census Bureau, the town of Colby has a total area of , of which , or 0.06%, is water [REF].