Heat pump water heaters also make noise. If the heater is in your garage, or like Miller's in your basement, that noise probably won't be a problem. ... Spicer explains that heat pump water heaters “take heat out of the air, and they exhaust cold air.