Bank records. Length of time to keep, and why: From one year to permanently. 1  Go through your checks each year and keep those related to your taxes, business expenses, home improvements and mortgage payments. 2  Shred those that have no long-term importance.