6. The method of claim 1 , wherein the first score for the document identifier is a function of an age of the corresponding document.
6. The method of claim 1 , wherein the first score for the document identifier is a function of an age of the corresponding document. 7. The method of claim 6 , wherein the age of the corresponding document is determined by computing time since last download of the corresponding document by the search engine crawler system.