Comparing current from two 9V batteries
As a battery goes flat, the voltage will slightly reduce.  But at the same time, the internal resistance rises substantially.

So even if the battery gives 9V with no load, as soon as you connect a load, the output voltage drops.

So if you're testing how good a battery is, you need to apply a load, and then measure the voltage.