How to reduce noise on a warm air duct?
There are sound baffles that can be installed in your duct system. 

Here’s a link that explains how they work: https://soundproofpanda.com/soundproof-air-vents/