28. A system comprising: one or more computers configured to perform operations comprising: receiving a plurality of test queries; selecting, for each test query, a first group of resources corresponding to a first automated resource selection process and a second group of resources corresponding to a second automated resource selection process, the selecting comprising, for each test query: identifying a plurality of resources responsive to the test query, determining, for each resource in the plurality of resources, whether the first automated resource selection process would classify the resource as to-be-indexed or not-to-be-indexed, and then selecting all resources classified as to-be-indexed as the first group of resources, and determining, for each resource in the plurality of resources, whether the second automated resource selection process would classify the resource as to-be-indexed or not-to-be-indexed, and then selecting all resources classified as to-be-indexed as the second group of resources; obtaining a respective query-specific score for each resource in the first group of resources and each resource in the second group of resources; presenting for comparison by a user first search results for a first subset of the first group of resources and second search results for a second subset of the second group of resources, wherein the first search results are presented in an order derived from the respective query-specific scores for the resources in the first subset and the second search results are presented in an order derived from the respective query-specific scores for the resources in the second subset.
28. A system comprising: one or more computers configured to perform operations comprising: receiving a plurality of test queries; selecting, for each test query, a first group of resources corresponding to a first automated resource selection process and a second group of resources corresponding to a second automated resource selection process, the selecting comprising, for each test query: identifying a plurality of resources responsive to the test query, determining, for each resource in the plurality of resources, whether the first automated resource selection process would classify the resource as to-be-indexed or not-to-be-indexed, and then selecting all resources classified as to-be-indexed as the first group of resources, and determining, for each resource in the plurality of resources, whether the second automated resource selection process would classify the resource as to-be-indexed or not-to-be-indexed, and then selecting all resources classified as to-be-indexed as the second group of resources; obtaining a respective query-specific score for each resource in the first group of resources and each resource in the second group of resources; presenting for comparison by a user first search results for a first subset of the first group of resources and second search results for a second subset of the second group of resources, wherein the first search results are presented in an order derived from the respective query-specific scores for the resources in the first subset and the second search results are presented in an order derived from the respective query-specific scores for the resources in the second subset. 29. The system of claim 28 , wherein the operations further comprise: comparing an assessment of the first search results by the user and an assessment of the second search results by the user; and selecting either the first automated search process or the second automated search process based on a result of the comparing.