1. A method comprising: reading, by a processor, source data corresponding to a source variable, wherein the source variable is a field in a record that includes the source data; applying, by the processor, a first transformation to the source variable to alter at least a portion of the source data and to generate a first output variable, wherein the first transformation comprises a first logic, wherein the first transformation uses the first logic to map the source variable to the first output variable by applying data transformations to the source variable and intermediate variables generated from the source data, wherein the first output variable is configured for ingestion into a big data storage format ingesting, by the processor, into the big data format by using a control node to distribute tasks among nodes for processing to complete a job intelligently and to limit network traffic and enhance speed at which the first output variable is processed, wherein the nodes process the first output variables in parallel to expedite the processing; and recording, by the processor, first lineage data of the first output variable, wherein the first lineage data includes a history of where the first output variable came from such that forward and backward transformation linkages can be re-created for use in analytics, wherein the first lineage data is used to detect duplicative data transformations in order to reduce duplicative data transformations, wherein the first lineage data is automatically obtained in response to a request for the lineage data, and wherein the first lineage data includes at least one of the first transformation or the source variable.