Op-amp saturation problem
The ADG708 can only handle negative inputs if it's in the -2.5 to 2.5V dual supply configuration. If you've got it hooked up to 0 and 5V, then that makes complete sense. There will be protection diodes in the ADG708 that will clamp to -0.7 or so below it's lower rail (VSS).