nested CV feature selection I have a small dataset of 150 records with 25 features (too small to do train/test).
I'm using nested cv for both hyperparameter tuning and feature selection. 10cv in the outer loop, 5 cv in the inner loop.
Eventually i'm getting 10 sets of hyperparameters and 10 sets of selected features.
If i'm publishing my results, how eventually would i know which features should be selected for a model to be tried on an external data. (Currently i don't have another external data to test the model)
thank you
Assuming the feature selection method is always the same, on an external data (or final training set), you would simply apply the exact same method. The actual set of selected features does not matter.
If there was any difference in the selection method, for instance if you are selecting different number of features, you would do like with any other hyper-parameter: select the best model according to the nested CV process, then apply the same hyper-parameters (including for instance number of features) when training the final model.