title: XGBoost best max_depth=1
body: <p>I use xgboost to train a classification model. GridCVSearch gives the best max_depth=1. This means all my hundreds of trees are split at a single node. </p>
  
  <p>Does this mean that the problem/dataset that I work with is separable using simple models and I don't need to use complicated model such as xgboost? </p>
  
  <p>In general, if all the trees have depth 1, does xgboost provide better prediction than simple models such as SVM/logistic regression?</p>
  
  <p>Thanks!</p>