XGBoost Feature Importance, Permutation Importance, and Model Evaluation Criteria
So your goal is only feature importance from xgboost?
Then don't focus on evaluation metrics, but rather splitting.
I would suggest to read this. Using the default from tree based methods can be slippery.