Catboost tuning order?
You have essentially answered your own question already. Any variable that depends on something else x you must first define x.
One thing to keep in mind is you can define a function before the variables you need to pass into it since its only when you call the function that you need the input variables, defining the function is just setting the process you will use. Calling a function and defining the variable it returns is what you have to do in order.
The order you would use is:
Include any remote librarys or functions, define any initial variables that dont depend on anything, define your local functions.
Next in your main you first need to generate the variables that your iteration function requires, then itterate with these variables, then generate the ones that depend on the itteration.
So with Catboost you have parameters to tune and also iterations to tune. So for iterations you can tune using cross validation with the overfit detector turned on. And for the rest of the parameters you can use Bayesian/Hyperopt/RandomSearch/GridSearch. My question is which order to tune Catboost in. Should I tune the number of iterations first or the other parameters first. A lot of the parameters are kind of dependent on number of iterations, but also the number of iterations could be dependent on the parameters set. So any idea of which order is the proper way?