I2C bus multiplexing issue
Try putting pull-up resistors on the I2C bus on both the input and output sides of the mux. If you already have smallish resistors (1 to 2k) on the output side, then adding larger ones (10k) to the input side would be reasonable, as they would only serve to hold the high level while the mux is switched and not drive the bus from low to high.