43. The computer readable storage medium of claim 40 , wherein the web crawl interval is not updated if the first average interval is greater than the second average interval.
40. The computer readable storage medium of claim 23 , wherein the one or more programs further comprise: instructions for-updating the web crawl interval of a document after retrieving a new copy of the document's content from its host and detecting content changes to the document based on the new copy.