Should I modify dataset?
You don't need to remove your features from your data set you may just drop the features which you don't want considered as features or lables.  Dropping a feature or label works by excluding the columns while fitting the data into the training set.