If you have a probability here you're trying to estimate--and here is the empirical mean-- with few data points--you might have a very right confidence interval--but as data increases, the boundary of the confidence interval will move inward. 