The current geography was slightly modified during the last ice age by the Wisconsin Glacier about 15,000 years ago.
The "mountains" are made up of sedimentary rocks (mostly sandstone and shales, with a little conglomerate) that were part of a lowland that collected sediments eroded from mountains to the southeast in Mississippian and Pennsylvanian geologic time.