22112979_e_WARC_Ecosystem___Archiveteam__has_documentation
[name] DeDuplicator (Heritrix add-on) [license] ? [programming language] ? [test suite] ? [# of authors] ? [description] The DeDuplicator is an add-on module (plug-in) for the web crawler Heritrix. It offers a means to reduce the amount of duplicate data collected in a series of snapshot crawls. [has documentation] 
?
The WARC Ecosystem - Archiveteam
has documentation