Additional costs: 1  A building/mechanical permit is usually required to replace a furnace.  Replacing an old furnace with a high-efficiency new one can also require installing a chimney liner for about $300 -$700 for a gas furnace or $700 -$1,800 for a fuel oil model. If needed, make sure this is included in all estimates.