It is believed that the stones used to construct the temple were existed in the bank of river Dihing. Due to natural calamities the temple was destroyed and the remains were found in deep forest called Gajapanemara. However, as the Dihing river changed the course, the temple was again destroyed and merged into the river water. A devotee of lord Shiva found the ruined temple and the linga in the shallow water of river Dihing, now this place is known as Sheetal Negheri. Ahom king Rajeswar Singha (1751-1769) brought the linga from the river and reconstructed the present temple and established the Shivalinga in it.