After Tokugawa Ieyasu retired to Sunpu Castle, he continued to maintain the fortifications on Mount Kunō.
With the overthrow of the Tokugawa by the new Meiji government, and the subsequent separation of Buddhism and Shintō, the Kunōzan Tōshō-gū suffered the loss of a number of its structures and much of its revenue.