1. A method comprising; receiving a plurality of records, the records having a first format, but exhibiting a plurality of different record layouts for the first format; analyzing the records to determine their record layouts; streaming the records and data indicative of their determined record layouts through a processing pipeline; the processing pipeline translating the records to a second format based in part on the data indicative of the records' determined record layouts; and wherein the method steps are performed by a processor.