Comparing 2 huge (5-6 GB) csv files and count the number of matching and unmatched no. of rows
I hope this algorithm work

create hash of every line in both file
now create set of that hash
difference and intersection of that set.
There are 2 huge (5-6 GB) each csv files. Now the objective is to compare both these files. how many rows are matching and how many rows are not matching? 
Lets say file1.csv contains 5 similar lines, we need to count it as 1 but not 5.
Similarly, for file2.csv if there are redundant data, we need to count it as 1.
I expect the output to display the number of rows that are matching and the no. of rows that are different.