1. A computer-implemented method for sharing compiler optimizations among a plurality of compute nodes of a massively parallel computing system, comprising: selecting, at a first compute node of the plurality of compute nodes, a block of code of a program to compile; compiling, by the first compute node, the block of code to generate a first set of native instructions; transmitting, to at least a second compute node of the plurality of compute nodes, an indication that the block of code has been compiled, wherein the second compute node is executing the program; and compiling, by the second compute node, the block of code to generate a second set of native instructions.