Probabilities predicted by XGBoost
If the predicted outcome targets(i.e., probabilities in this example), are consistently higher than actual, it implies you have statistical bias model. Statistical bias is when there is a systematically different result from the population parameter being estimated.
There are many ways to reduce statistical bias:

Resample at more extreme ratio
Change the loss function to more heavily penalize mispredictions
Change algorithm