Strange I2C behavior: sometime it works, some time it doesn't
It sounds like it's right on the margin of working; all sorts of tiny effects like EM noise from the computer, capacitance from the human body, and temperature are pushing it from "working" to "not working".

The general solution is to slow down the I2C or shield it more thoroughly.