What is the Chinese word for a Chinese lantern?
灯笼 means lantern in the general sense, that is, a portable lighting device or mounted light fixture used to illuminate broad areas.

The hot air balloon you described is 'sky lantern', which is called 天灯 (sky lantern) or 孔明灯 (Kongming Lantern) in Chinese.