My multimeter probes are too big to measure a laptop battery
Do you have a small piece of electrical wire, like loudspeaker cable or telephone cable? You only need about 5 cm.

Strip the isolation to reveal the copper strands inside. Take two of those strands and wrap one around each probe tip. Do not wind the last centimeter but bend it so that it's an extension to the probes. Now you have very thin probes.