Even if closed, the accounts that have no late payment history remain on your credit report for 10 years from the date closed. As long as the positive information remains, it contributes to a stronger credit history. So, removing those accounts early actually could be harmful to your credit scores.