If you paid "points" when you refinanced your mortgage, you may be able to deduct them. ... One point equals 1% of the loan amount, so if you paid 2 points on a $100,000 loan, for example, you would have paid $2,000. Points sometimes go by other names, including: Loan origination fee.