1. A computer system for fetching a web page, comprising: a web crawler for fetching a plurality of web pages to update content indexed for use by a search engine; and a crawling policy manager operably coupled to the web crawler for implementing a policy for estimating an impact of fetching uncrawled web pages for queries of a workload using content-independent features of the uncrawled web pages.