1. A method of debugging a parallel application, comprising: executing a debug client at a host computer; executing a shim on a portion of a parallel application at each of a plurality of node computers to collect data therefrom; executing a remote debug client to debug the portion of the parallel application at each of the plurality of node computers; sending the results of the debugging and collected data from each of the plurality of node computers to the debug client; and aggregating the received data and results of the debugging by the debug client.