why does the spectral envelope of human speech not change w.r.t. pitch when taking a Fourier transform?
The spectral envelope, which determines where the formant frequencies are, is determined by the shape of the mouth, tongue, lips, and nasal coupling.  That is independent of the pitch, which is dependent on the tension or stiffness of the vocal cords.