1. A method comprising: two or more data sets operating in a computer system, with one data set assigned to a single node; profiling each data set, including dividing each data set into two or more data chunks and applying a hash value to each data chunk; assigning a hash value range to each node, and storing hash values within the assigned hash value range in memory local to the assigned node; eliminating duplicate data chunks associated with the two or more data sets, including comparing hash values of each of two or more data sets, and for each duplicate hash value retaining a single copy of the duplicate hash value, with each node retaining non-duplicate data chunks within the hash value range assigned to the node; and migrating the non-duplicate data chunks of the data sets.