Examples of the use of biased estimators
In machine learning, the sample error of an ERM learner is a biased estimator of the true generalization error. Here the bias is not by choice but by necessity: we simply don't know of a way to construct an unbiased estimator of the generalization error, and I'm pretty sure it's impossible from general no-free-lunch principles.