Storing large data sets for python machine learning algorithm consumption
There are a lot of technologies out there to handle. These are the most popular ones I know of:

For moderate data to operate in chunks- Pandas -  pd.read_csv('train.csv', chunksize=chunksize)

For larger data - dask, Hadoop with R

Refer this for various other suggestions.