The mountain looks like an elongated summit plateau running north-to-south for about , with a width of up to from west-to-east. It has an area of some twelve hectares and rises about above the surrounding countryside. The actual summit lies in the southern part of the plateau. The edge of the Pfaffenstein is formed by rugged and heavily fissured sandstone rocks. There are numerous isolated rock formations around the main massif, the best-known being the Barbarine on the southern tip of the Pfaffenstein. Other significant rock pinnacles are the Königspitze, the Förster, the Bundesfels, the Rauhe Zinne, the Jäckelfels, the Pfaffenschluchtspitzen, the Peterskirche and the Einsiedler.