Do we have to use an IV for AES encryption to be FIPS 140-2 compliant?
No you don't need to use an IV. However, this limits you to ECB mode only — the only one which doesn't use an IV — and your CAVP (Cryptographic Algorithm Validation Program) AES certificate will indicate so.