Power Consumpion on i2c on esp32 on arduino framework
The extra current draw is likely due to the VEML7700 eval board having four 10k pull ups total on the SDA and SCL lines 

These will draw power as long as the VEML7700 or the ESP connected to it are talking over I2C and there is power on the resistors from Vin and the VEML7700's internal 3.3v. If you want to increase these resistor values this will decrease the current draw of the system, but may also affect communication speed.

I recommend not using internal pull ups on the esp32 without some kind of protection like a clamp or voltage divider, as these pull ups will pull the I2C lines up to 5v and the VEML7700 does not appear to have internal over-voltage protection over 3.6v.