The Großer Knollen is located northeast of Herzberg am Harz and Scharzfeld, northwest of Bad Lauterberg im Harz and south of the hamlet of Sieber. It is surrounded by several other mountains and hills that range in height between 550 and 650 m above mean sea level. Just under 1 km away to the southwest the Kleiner Knollen rises to a height of 631 m.