273691a7__Relevance_Issues___Lucidworks__Name
[Description] Assign a percentage of users queries to go to one search system, while the other percentage searches an alternate system. After the appropriate period of time, evaluate the choices made by those in the A group and those in the B group to see if one group had better results than the other. If feasible, have the users in each group rate the results. [Pros] Combine with log analysis to get a good picture of what people prefer. [Cons] Requires setting up and maintaining two systems in production. Difficult to do in non-server based applications. [Name] 
A/B Testing
A d - h o c
F o c u s G r o u p s
T R E C a n d o t h e r P u b l i c E v a l u a t i o n s
O n l i n e R a t i n g s
L o g A n a l y s i s o n a B e t a P r o d u c t i o n S i t e
A / B T e s t i n g
E m p i r i c a l T e s t i n g
Debugging Search Application Relevance Issues - Lucidworks
Name