According to a popular legend, the Pandavas of Mahabharata fame resided here during their "incognito" exile from their kingdom and built this temple.
The pond in front of the complex has a mythical link to Draupadi, the consort of the Pandavas.