Tax documents, such as a Form 1099-INT, should be kept with that year's tax return. The IRS recommends that tax records be kept at least three to four years after the filing date. Some people feel that a person should always keep all of their tax paperwork. The IRS suggests keeping tax records and paperwork for three to four years after filing.