Does pandas read the full data file and stores it in a data frame? Is it efficient to load a 100mb file in pandas?
Yes the performance is affected and sometimes system gets slow. 
You can try to read the data in the form of table or you can also use chunksize. This will improve the efficiency
I want to load a file of size around 100mb using pandas. I know we can load but I want to know does the file size affects the efficiency of the program. And is there any way to load the file efficiently?