Bayrischzell is located in the Mangfallgebirge between Schliersee in the West and Oberaudorf in the East. It is located at the foot of Wendelstein mountain, at the foot of Sudelfeld and below the Sudelfeld pass. It lies at the northern exit of Ursprungtal. It is 23 km southeast of Miesbach, 25 km northwest of Kufstein, 20 km west of Oberaudorf. In the west of the municipality, near the border with the Schliersee municipality, is the Taubensteinhaus at 1567 meters altitude.