12. The system of claim 1 , wherein the operations further comprise: for one or more of the test queries: receiving the test query through a search engine user interface from each of a plurality of users; presenting search results corresponding to the first group of resources to one or more first users in the plurality of users in response to receiving the test query from each first user, and presenting search results corresponding to the second group of resources to one or more second users in the plurality of users in response to receiving the test query from each second user; and comparing user assessment of the search results corresponding to the first group of resources and user assessment of search results corresponding to the second group of resources, resulting in a comparison; and analyzing the comparison for each of the one or more test queries to select either the first automated resource selection process or the second automated resource selection process.
12. The system of claim 1 , wherein the operations further comprise: for one or more of the test queries: receiving the test query through a search engine user interface from each of a plurality of users; presenting search results corresponding to the first group of resources to one or more first users in the plurality of users in response to receiving the test query from each first user, and presenting search results corresponding to the second group of resources to one or more second users in the plurality of users in response to receiving the test query from each second user; and comparing user assessment of the search results corresponding to the first group of resources and user assessment of search results corresponding to the second group of resources, resulting in a comparison; and analyzing the comparison for each of the one or more test queries to select either the first automated resource selection process or the second automated resource selection process. 13. The system of claim 12 , wherein the operations further comprise obtaining a query-specific score for each resource in the first group of resources and obtaining a query-specific score for each resource in the second group of resources, wherein: the search results for a first subset of identified resources have a first order derived from the query-specific scores for each resource and presenting the search results comprises presenting the search results according to the first order; and the search results for a second subset of identified resources have a second order derived from the query-specific scores for each resource and presenting the search results comprises presenting the search results according to the second order.