Planet with acid ice caps
Of the planets, two have ice caps: Earth and Mars.  The Earth's ice caps are water ice, and Mars has ice caps of Carbon dioxide, and some Water ice. The CO2 on Mars would give a weakly acidic solution if melted but it would not be a caustic acid.

Titan has hydrocarbon lakes at its poles, and other planets are too hot, or are uniformly frozen.