22. The method of claim 14 , further comprising: receiving respective feedback for each test query, the respective feedback for each test query selecting either the first group of resources or the second group of resources; and selecting either the first automated resource selection process or the second automated resource selection process as a result of the respective feedback for each test query.
23. The method of claim 22 , further comprising presenting first search results corresponding to the first group of resources and second search results corresponding to the second group of resources to each evaluator in a plurality of evaluators, wherein: receiving feedback selecting either the first group of resources or the second group of resources comprises receiving feedback from each evaluator indicating that the evaluator prefers the first search results or the second search results, and aggregating the received feedback.