Measuring performance of different classifiers with different sample sizes
You need to look at the confidence interval of the statistic.  This helps measure how much uncertainty in the statistic, which is largely a function of sample size.