sample size increased seven-digits let' actually increase the sample size to as shown hereoqsboepnopsnbm oqsboepnopsnbm tubutuuftu@joe "here is the resultwhat does that dowellnowwe're back under for the -statisticand our value' around percent we're seeing these kind of fluctuations little bit in either direction as we increase the sample size this means that going from , samples to , to , , isn' going to change your result at the end of the day and running experiments like this is good way to get good gut feel as to how long you might need to run an experiment for how many samples does it actually take to get significant resultand if you know something about the distribution of your data ahead of timeyou can actually run these sorts of models / testing if we were to compare the set to itselfthis is called an / test as shown in the following code exampletubutuuftu@joe "we can see in the following outputa -statistic of and -value of because there is in fact no difference whatsoever between these sets nowif you were to run that using real website data where you were looking at the same exact people and you saw different valuethat indicates there' problem in the system itself that runs your testing at the end of the daylike saidit' all judgment call