The hill is what remains of the top of a volcanic plug. A little east from Windy Hill can be observed a well developed bole horizon (more than 2 metres thick), a type of soil which originates from the weathering of igneous rocks.