I have 6000+ .csv files in `/hadoop/hdfs/location1` and 6100+ .csv files in `/hadoop/hdfs/location2`.

I want to compare these two hdfs directories and find the diff of files. The diff .csv files(non-similar) should be reflected in a 3rd hdfs directory(`/hadoop/hdfs/location3`). I am not sure we can use *diff command* as in unix to hdfs file system. 

Any idea on how to resolve this would be appreciable.

Anshul