273691a7__Relevance_Issues___Lucidworks__Name
[Description] Deploy a live system to a large audience and let them kick the tires. You should only do this once you are reasonably confident things work well. It is imperative to have good logging in place first, which means thinking about the things your want to log, such as queries, results, clickthrough rates, etc. Finally, invite feedback from your users. Mix these factors together and pay attention to trends and red flags. [Pros] What’s better than real users? This approach is essentially a scaled up version of the Focus Group. [Cons] What’s worse than real users? It’s scary and it is expensive, but at some point you have to do it anyway, right? Also, it is difficult to do in non-hosted environments. [Name] 
Log Analysis on a Beta Production Site
A d - h o c
F o c u s G r o u p s
T R E C a n d o t h e r P u b l i c E v a l u a t i o n s
O n l i n e R a t i n g s
L o g A n a l y s i s o n a B e t a P r o d u c t i o n S i t e
A / B T e s t i n g
E m p i r i c a l T e s t i n g
Debugging Search Application Relevance Issues - Lucidworks
Name