Ta Krabey temple consists of a single central sanctuary, where houses a Shiva Linga, named Svayabhuva Linga (), which means the self-emergence Linga and four gopuras face to all four directions in total area of 900 square meters. This sandstone temple was decorated with some carvings, especially the depiction of god Yama mounts on a buffalo as his vehicle, however the construction work of the temple was unfinished as most of the exterior surface of the central tower has no carving. According to architectural style, this temple was built in 12th or 13th century in Bayon style but it is believed that it started being constructed in 11th century. Nowadays, the temple is surrounded by Dângrêk Mountains jungle that provides cool shade and fresh air for visitors.