Why does my multimeter show a wrong voltage over a large resistor?
The input impedance of your multimeter changes the circuit:



With 10k resistors, the difference would not matter, but the 1M resistors pass so little current that the additional current through the multimeter has a noticeable effect.

If you knew your multimeter's input impedance, you would be able to calculate the voltage that you would get without it.