1 Replacing an oil-fired furnace in a central heating system starts typically costs $2,000-$5,000 for a basic installation, but can reach $6,000-$10,000 or more for complex installations. A building/mechanical permit is usually required to replace a furnace. 2  Permit and inspection fees are typically about $50-$300, but can cost more in some locations.