Adorf is located in the Elstergebirge, a low mountain range, part of the Erzgebirge. The lowest point in the Adorf district being in Rebersreuth (415 m) and the highest point being the Hoher Stein (high stone) near Gettengrün (632.9 m). This Hoher Stein is not the same as the Czech Vysoký kámen 5 km to the east, whose name is also Hoher Stein in German.