Do cold battery capacity de-ratings apply at low currents?
The reasoning about the internal resistance is correct.  To illustrate it, I found this plot for different discharge rates at low temperatures.



Energizer L91 Lithium Battery Capacity and Temperature Curve.  Source.

There is another discussion about temperature and discharge rate here.