The rocks that make up Peveril Point are shale and Portland and Purbeck limestone in a syncline structure. This has resisted erosion more than the adjacent clay of Swanage Bay; whilst the clay has eroded away over time, the limestone has remained as a promontory.