The Pfaffenstein lies about south of the village of Pfaffendorf in the borough of Königstein. Another nearby settlement is Cunnersdorf about southeast. Its nearest neighbour is the Quirl to the northwest, another table hill.