Stoney Down is part of the Corfe Mullen AGLV, which covers an area of just under 3 square miles. The plantation lies west of Corfe Mullen's village centre and east-northeast of Lytchett Matravers. To the north, across Crumpet's Valley, is the Henbury Plantation with its sand and gravel pits that reaches a high point in Notting Hill (89 m). To the northeast are the grounds of Castle Court School around Knoll Clump. To the east is Corfe Mullen, to the southeast are Poor Common and Beacon Hill. Away to the south and southwest across Elder Moor are the Purbeck Hills.