Gernrode is located in Upper Eichsfeld in the southern foothills of the Harz. It lies on both sides of the River Wipper, between the Dün and the Ohm Hills, in the centre of the Eichsfelder Kessel (although it is not part of the administrative unit of that name).