The Kleiner Gleichberg lies on the Rhine-Weser watershed between the Vogelsberg and Rhön mountains (in the East Hesse Highlands) and the Lange Berge, where the Thuringian Highland adjoins and the watershed also ends not far from the source of the Werra. Whilst the water of the Milz, which is fed by various headstreams on the eastern side of the saddle between the two mountains, flows towards the southwest via the Franconian Saale and Main into the Rhine, the short streams that rise on the extreme northeastern side of the Kleiner Gleichberg and the hills north of it drain via the Werra into the Weser.