How can you measure voltage differences less than thermal voltage (~26mV at room temp)?
Thermal voltage noise has a magnitude of ~1nV/sqrt(Hz) at room temp. for a 60 ohms resistor.
Where did you get that 26mV from? 26mV is a lot (26 Million) higher than thermal noise. So there’s no measurement problem at 26mV if you got a good measurement device.