1. A method for processing data in a distributed data storage system, said method comprising: obtaining said data and one or more corresponding checksum values from a compute node; appending, using at least one processing device of a log structured file system, said data to a corresponding data file; generating, using said at least one processing device of said log structured file system, a metadata index entry in an index file that maps said data in the corresponding data file to a log structured file, wherein said metadata index entry further comprises a checksum value of the data generated by said at least one processing device of said log structured file system; providing said metadata index entry to a key-value store for storage as a key-value pair comprising a key and a value comprising said metadata index entry, wherein a first checksum value of said key and a second checksum of said value comprising said metadata index entry are stored as a header in a storage element storing said value; and providing said data file to said distributed data storage system for storage.