in this casewe have -statistic of - the negative indicates that it is negative changethis was bad thing and the -value is veryvery small sothat implies that there is an extremely low probability that this change is just result of random chance remember that in order to declare significancewe need to see high tvalue -statisticand low -value that' exactly what we're seeing herewe're seeing - which is very high absolute value of the -statisticnegative indicating that it' bad thingand an extremely low -valuetelling us that there' virtually no chance that this is just result of random variation if you saw these results in the real worldyou would pull the plug on this experiment as soon as you could when there' no real difference between the two groups just as sanity checklet' go ahead and change things so that there' no real difference between these two groups soi' going to change group #the control group in this caseto be the same as the treatmentwhere the mean is the standard deviation is unchangedand the sample size is unchanged as shown hereoqsboepnopsnbm tubutuuftu@joe "if we go ahead and run thisyou can see our -test ends up being below one nowremember this is in terms of standard deviation so this implies that there' probably not real change there unless we have much higher -value as wellover percent nowthese are still relatively high numbers you can see that random variation can be kind of an insidious thing this is why you need to decide ahead of time what would be an acceptable limit for -value