What does it mean when a battery still has high voltage but doesn't deliver current?
The internal resistance of the battery is high? That would explain why the voltage is high when there is no current but why there is no voltage when there is current.

The more current is drawn by the battery, the more voltage is dropped across the internal resistance and therefore the less voltage actually appears on the battery terminals.