Metric to combine average with number of accurance
The metric you are looking for is the standard error. From Wikipedia:


  the standard error equals the standard deviation divided by the square root of the sample size.


So as the sample size increases the standard error decreases. You can also see this for an explanation with some code in R.