 Waverly is in the southwest corner of Chambers County at 32°44'8.369" North, 85°34'27.736" West (32.735658, −85.574371).The town limits extend south into Lee County.According to the United States Census Bureau, the town has a total area of , of which , or 0.68%, is water.