The temple is said to have been initially constructed during the reign of Emperor Gaozong of Song, the first emperor of the Southern Song (mid-12th century), as a straw hut.
Cao'an was renovated in 1922, becoming an annex of a Buddhist temple complex where the "ancestral teachers of India and China" were venerated; however, that temple complex later fell into disuse as well [REF].