Popularly known as Gupta Kedar in the vicinity, this sacred place is associated with Shri Rama of the epic Ramayana. The nearby hill has been named Ramagiri. According to mythology, the lingam was first discovered by Lord Rama when he was roaming in the then Dandakaranya forest with wife Sita and brother Laxman, and later worshipped it calling it Gupteswar. The poet Kalidas too, described the scenic beauty of Ramgiri forest where the cave temple is referred to in his famous Meghadutam.