Confusion around common mode voltage
You are right about the multimeter. The difference between that and an amplifier circuit is that the amplifier circuit is supplied from power rails which are not "floating". Common mode voltages refer to voltages at the input terminal with respect to the power supply rails.