In 1851, the Xianfeng Emperor gave the mansion to his sixth brother, Prince Gong, whom the mansion is named after.
During the Cultural Revolution, the mansion was used by the Beijing Air Conditioning Factory until it experienced a revival in the 1980s.