1. A method performed in conjunction with a plurality of instances of a concurrent computation executing a computational job, where the plurality of instances include a first instance of the concurrent computation and a second instance of the concurrent computation, the first instance of the concurrent computation and the second instance of the concurrent computation communicating using a communication channel, the method comprising: using a computer, sending or receiving a message, the sending or receiving performed by the first instance of the concurrent computation and performing: a first action during an uninterrupted sending or receiving, and a second action when an interrupt request is detected and received at the first instance of the concurrent computation, the second action comprising: notifying one or more of the plurality of instances of the detection of the interrupt request; terminating execution of the computational job; and maintaining communication between the first instance of the concurrent computation and the second instance of the concurrent computation.