1. A method of executing an application program on a parallel computing system having a plurality of compute nodes, comprising: receiving a program binary executable by each of the plurality of compute nodes; dividing the program binary into a plurality of code fragments; distributing each of the plurality of code fragments to at least one of the plurality of compute nodes; and initiating execution of the application program on each of the plurality of compute nodes.