1. A process for data collection and conditioning comprising: receiving multiple data records from multiple data sources at a processing engine, wherein the multiple data records have different formats from each other and from a pre-established internal data format; parsing in near real time by at least one parser each of the multiple data records into multiple constituent parts; translating in near real time by at least one translator each of the multiple data records using their parsed multiple constituent parts into a pre-established internal data format; comparing in near real time by the processing engine each of the multiple translated internal data records with at least a first enrichment rule to determine if the at least a first enrichment rule is applicable to at least one data element in one or more of the multiple translated internal data records; if applicable, enriching in near real time by the processing engine the at least one data element in one or more multiple translated internal data records with additional data pursuant to the at least a first enrichment rule to form one or more enriched translated internal data records; and transmitting in near real time the one or more enriched translated internal data records to at least one data sink for storage therein, wherein the one or more enriched translated internal data records are available for use by multiple applications.