1. A method for data deduplication comprising: segmenting an original data set into a plurality of data segments; applying a transform function to the data in each data segment of the plurality of data segments and transforming the data in said each data segment into a transformed data representation that comprises a band-type structure for said each data segment, wherein said band-type structure comprises a plurality of bands; partitioning the plurality of bands into a first set of one or more bands of the plurality of bands and a second set of one or more bands of the plurality of bands, wherein the plurality of bands for each data segment of the plurality of data segments encodes structural information about said each data segment, wherein said first set of one or more bands is different in the transformed data representations of the plurality of data segments, wherein said second set of one or more bands, in the transformed data representations of the plurality of data segments, is identical transformed data indicating that the plurality of data segments comprise structurally identical data having transformed data representations that behave similarly and wherein the plurality of data segments are not identical; applying a hash function onto the identical transformed data of the second set of one or more bands for the plurality of data segments and thereby generating transformed data segments indexed by hash function indices, wherein said hash function is not applied to the transformed data of the first set of one or more bands that is different in the transformed data representations of the plurality of data segments; and storing a single copy of the identical transformed data with an associated hash value generated by the hash function for the identical transformed data in a deduplication database.