This shrew is endemic to Tanzania, and is only known from the Udzungwa Mountains, one of the ranges of the Eastern Arc Mountains, although some specimens of a species of Myosorex on Mount Rungwe might prove to be M. kihaulei. At one time these mountains were part of a continuous belt of rainforest, but climate changes resulted in the lowland areas between the mountains becoming savannah, and the forest on each mountain range was separated from the neighbouring ranges, resulting in much endemism. This shrew is found in moist montane forest, including swamp forest and areas of bamboo, at altitudes of over .