Libraries for Online Machine Learning
You could look at scikit-learn or Orange module in Python.
Scikit-learn has a SGD classifier and regressor that could do a partial fit data in case of online learning.
In R, take a look at caret package