Reference voltage changes when connected to inverting input of op amp comparator
I don't see any negative feedback on the op-amp. You are exceeding the differential input voltage of the op-amp. According to page 2 of its datasheet the maximum is 0.5V and it has protection diodes so it is drawing a large current to protect the device.