How many features can scikit-learn handle?
Some linear model (Regression, SGD, Bayes) will probably be your best bet if you need to train your model frequently. 
Although before you go running any models you could try the following 
1) Feature reduction. Are there features in your data that could easily be removed? For example if your data is text or ratings based there are lots known options available. 
2) Learning curve analysis. Maybe you only need a small subset of your data to train a model, and after that you are only fitting to your data or gaining tiny increases in accuracy. 
Both approaches could allow you to greatly reduce the training data required.
I have a csv file of [66k, 56k] size (rows, columns). Its a sparse matrix. I know that numpy can handle that size a matrix. I would like to know based on everyone's experience, how many features scikit-learn algorithms can handle comfortably?