1. A computer-implemented method for sharing compiler optimizations among a plurality of compute nodes of a massively parallel computing, comprising: selecting, at a first compute node of the plurality of compute nodes, a block of code of a program to compile; compiling, by the first compute node, the block of code to generate a first set of native instructions; transmitting, to at least a second compute node of the plurality of compute nodes, an indication that the block of code has been compiled, wherein the second compute node is executing the program; compiling, by the second compute node, the block of code to generate a second set of native instructions; and monitoring one or more performance characteristics of the first set of native instructions when executed on the first commute node and one or more performance characteristics of the second set of native instructions when executed on the second compute node; wherein the performance characteristics include an execution time of the respective native instructions, relative to the execution time of the block of code.