How can a parallel capacitor improve the power factor of an inductive load?
If the impedance of the capacitor and that of the inductor were perfectly equal, the reactive power would be exactly zero.

The formula for the reactive power has two components, current squared and impedance. And while impedance goes to infinite, as you correctly pointed out, current goes twice as fast to zero, so reactive power goes to zero.