How valuable is a categorical feature that has a predominant category over all other ones?
Feature importance is an empirical question. Train a model with the feature in it. Train another model without the feature in it. Then see which model does better when predicting new data, aka the test dataset. The difference between model performance on train and test datasets is one way to measure overfitting.