I have a very large panel data set (around 50m observations, size around 3G). Now I want to implement an algorithm on it. The algorithm is basically loops over observations. Ideally I want to use functions in numpy. But I guess it would be really slow. Is R or matlab good for this work? Are there any other python packages I could use?Thanks in advance for any help.
Python ,R or matlab for programming very large data set?
python;r;bigdata;matlab;programming