Powering RGB Leds from 2 AA batteries
Your LEDs need current-limiting resistors. This does not appear to be a constant-current LED driver IC.

See page 23 for an example circuit:
http://www.nxp.com/documents/data_sheet/PCA9635.pdf