The Rastkogel lies five kilometres north-northeast as the crow flies of Vorderlanersbach (municipality of Tux) in the Tuxertal, the westernmost side valley of the Zillertal. Its neighbouring peaks are: to the west, separated by the Nurpensjoch saddle (2,525 m), the Halslspitze at 2,574 metres, and beyond that over the Wattentaler Lizum, the Hirzer (2,725 m). To the north lies the Roßkopf (2,576 m) and - jutting far out into the Inn valley - the Gilfert (2,506 m) and, to the east, separated by the Hoarbergjoch (2,590 m), the Pangert at 2,550 metres.