1 The cost of this home refinance item will usually average between $400 and $700. As with all other costs, be sure to get the exact amount in advance.  Prepayment Penalty - Some lenders charge a penalty fee if you pay off your home mortgage loan early. This is referred to as a prepayment penalty, or an early pay-off fee.