273691a7__Relevance_Issues___Lucidworks__Name
[Description] Gather a set of real users and have them interact with the system over some period of time. Log everything they do and explicitly ask them for feedback. [Pros] Low cost, if done online. Feedback and logs are quite useful, especially if users feel invested in the process. May be possible to produce precision/recall info if users provide feedback. [Cons] The results may not be extrapolated to broader audience, depending on how well the users represent your target audience. [Name] 
Focus Groups
A d - h o c
F o c u s G r o u p s
T R E C a n d o t h e r P u b l i c E v a l u a t i o n s
O n l i n e R a t i n g s
L o g A n a l y s i s o n a B e t a P r o d u c t i o n S i t e
A / B T e s t i n g
E m p i r i c a l T e s t i n g
Debugging Search Application Relevance Issues - Lucidworks
Name