273691a7__Relevance_Issues___Lucidworks__Name
[Description] Run a relevance study using a set of queries, documents and relevance judgments created by a third party group. The most popular instance of this is the Text Retrieval Evaluation Conference (TREC) held by the National Institute of Standards and Technologies (NIST). [Pros] Relatively easy to use, test and compare to previous runs. Completely repeatable. Good as a part of a larger evaluation, but should not be the sole means of testing. [Cons] The collection is not free or open. Doing well in TREC doesn’t necessarily translate to doing well in real-life. [Name] 
TREC and other Public Evaluations
A d - h o c
F o c u s G r o u p s
T R E C a n d o t h e r P u b l i c E v a l u a t i o n s
O n l i n e R a t i n g s
L o g A n a l y s i s o n a B e t a P r o d u c t i o n S i t e
A / B T e s t i n g
E m p i r i c a l T e s t i n g
Debugging Search Application Relevance Issues - Lucidworks
Name