Ongoing Bills. 1  Utility Bills: Hold on to these for one year—just in case there are any billing issues. If you claim a home-office deduction, keep statements for three years because that's how long the IRS generally has to challenge tax returns. 2  Pay Stubs: Save one year's worth.