How to compensate for op-amp offset voltage for AC current?
Trivial solution: coupling capacitor on output. This assuming the DC offsets aren't so bad as to cause clipping when the AC signal is overimposed.

If you have more sophisticated needs like preserving high CMR
(unclear from the question if you do), then read http://www.ti.com/lit/an/sboa003/sboa003.pdf

If you have high-level DC bias on the input, then removing it before amplification is preferable:



This is the simplest idea, using a passive network; the two coupling capacitors allow only AC in, roughly speaking. More accurately they (together with the resistors) form high-pass filters. More sophisticated solutions are in the aforementioned TI app-note.