On the discovery of the caves, there are several legends, which the tribals (Jatapu, Porja, Kondadora, Nookadora, valmiki etc.) who inhabit the villages around the caves narrate. The popular legend is that a cow, grazing on the top of the caves, dropped through a hole in the roof. The cowherd while searching for the cow came across the caves. He found a stone inside the cave that resembled a Lingam, which he interpreted as the Lord Shiva who protected the cow. The village folk who heard the story believed it and since then they have built a small temple for Lord Shiva outside the cave. People flock to the temple for worship and the cave to get a glimpse of the Lingam.