The IRS will work with you. The penalty for filing late is normally 5 percent of the unpaid taxes for each month or part of a month that a tax return is late. That penalty starts accruing the day after the tax filing due date and will not exceed 25 percent of your unpaid taxes.