1. A method of reducing power consumption while synchronizing a plurality of compute nodes during execution of a parallel application, the method comprising: reducing, for each compute node, power to one or more hardware components of that compute node in response to that compute node beginning performance of a blocking operation specified by the parallel application; and restoring, for each compute node, the power to the hardware components having power reduced in response to all of the compute nodes beginning the performance of the blocking operation.