The Kalika Siva Temple is located beyond the southern compound wall of Kapilesvara siva temple and close to the northern embankment of Manikarnika tank. The temple faces west and the presiding deity of the temple is Siva lingam within a circular yonipitha (basement). The temple is made of sandstone and was built around 10th / 11th Century A.D.