1. A computer-implemented method of de-duplicating data from industry reports, the computer-implemented method having steps comprising: receiving through a communications interface a set of industry reports from multiple industry sources; comparing with circuitry one or more attributes of at least two trade lines to identify whether the at least two trade lines in the set of industry reports are duplicates; characterizing with the circuitry as a binary indication whether the comparing indicates the one or more attributes of the at least two trade lines are a match and storing the binary indication in a memory; displaying on a display a representation of the binary indication and receiving via a graphical user interface (GUI) a user-identified indication whether the at least two trade lines are duplicates; training a classifier through circuitry with feedback from the user-identified indication, the classifier being a computer-implemented classifier; recording in the memory the binary indication whether the at least two trade lines are duplicates and when the at least two trade lines are duplicates, removing at least one of the at least two trade lines from the set of industry reports so as to de-duplicate a portion of the at least two trade lines; and running the classifier with a processor as an intelligent proxy for subsequent de-duplication decisions, wherein the set of industry reports includes reports from one of electronic file archival reports, electronic indexing reports, census reporting reports, inventory recording reports, research organization reports, financial decision-making reports, and evaluation and achievement reporting reports.