the -value is basically the probability that this experiment satisfies the null hypothesisthat isthe probability that there is no real difference between the control and the treatment' behavior low -value means there' low probability of it having no effectkind of double negative going on thereso it' little bit counter intuitivebut at the end of the day you just have to understand that low -value means that there' high probability that your change had real effect what you want to see are high -statistic and low -valueand that will imply significant result nowbefore you start your experimentyou need to decide what your threshold for success is going to beand that means deciding the threshold with the people in charge of the business sowhat -value are you willing to accept as measure of successis it percentis it percentand againthis is basically the likelihood that there is no real effectthat it' just result of random variance it is just judgment call at the end of the day lot of times people use percentsometimes they use percent if they're feeling little bit riskierbut there' always going to be that chance that your result was just spuriousrandom data that came in howeveryou can choose the probability that you're willing to accept as being likely enough that this is real effectthat' worth rolling out into production when your experiment is overand we'll talk about when you declare an experiment to be over lateryou want to measure your -value if it' less than the threshold you decided uponthen you can reject the null hypothesis and you can say "wellthere' high likelihood that this change produced real positive or negative result if it is positive result then you can roll that change out to the entire site and it is no longer an experimentit is part of your website that will hopefully make you more and more money as time goes onand if it' negative resultyou want to get rid of it before it costs you any more money rememberthere is real cost to running an / test when your experiment has negative result soyou don' want to run it for too long because there' chance you could be losing money this is why you want to monitor the results of an experiment on daily basisso if there are early indications that the change is making horrible impact to the websitemaybe there' bug in it or something that' horribleyou can pull the plug on it prematurely if necessaryand limit the damage