Merging large CSV files in pandas I have two CSV files (each of the file size is in GBs) which I am trying to merge, but every time I do that, my computer hangs. Is there no way to merge them in chunks in pandas itself?
No, there is not. You will have to use an alternative tool like dask, drill, spark, or a good old fashioned relational database.