Much of the initial resistance to Joule's work stemmed from its dependence upon extremely precise measurements.
Joule was proposing a kinetic theory of heat (he believed it to be a form of rotational, rather than translational, kinetic energy), and this required a conceptual leap: if heat was a form of molecular motion, why didn't the motion of the molecules gradually die out?