1. A method to limit core file generation in a massively parallel computing system comprising a plurality of compute nodes each executing at least one task, of a plurality of tasks, the method comprising: upon determining that a first task executing on a first compute node has failed: performing, by the first task, an atomic load and increment operation on a core file count received from a leader node of the plurality of compute nodes; generating, by the first task, a first core file upon determining that the core file count is below a predefined threshold; and not generating, by the first task, the first core file upon determining that the core file count is not below the predefined threshold.