Panchavarnaswamy temple complex has three prakarams (outer courtyard) and a five-tiered rajagopuram (gateway tower). The central shrine faces east and holds the image of Panchavarnaswamy (Shiva) in the form of lingam made of granite. The granite images of the deities Ganesha (son of Shiva and god of wisdom), Murugan (son of Shiva and god of war), Nandi (the bull and transport of Shiva) and Navagraha (nine planetary deities) are located in the hall leading to the sanctum. As in other Shiva temples of Tamil Nadu, the first precinct or the walls around the sanctum of Panchavarnaswamy has images of Dakshinamurthy (Shiva as the Teacher), Durga (warrior-goddess) and Chandikeswarar (a saint and devotee of Shiva). The second precinct is surrounded by granite walls.