1. A method for grouping document providers into provider clusters comprising profiles, comprising: receiving document fetch data of one or more document providers, document fetch data of a document provider comprising one or more document fetch parameters corresponding to document fetch operations associated with the document provider; grouping document providers into provider clusters based upon document fetch data; and for respective provider clusters, specifying a profile for a provider cluster based upon document fetch parameters of document providers within the provider cluster, the profile comprising one or more parameters corresponding to at least one of a document size parameter, a frequency http status code parameter, a mime type parameter, and a redirect rate parameter.