1. A method for managing the processing of tasks over a network, comprising: receiving at least one task and assigning the at least one task to a coordinator node among a plurality of nodes wherein nodes of the plurality of nodes are distinct computing devices arranged in a cluster interconnected by a backplane; provisioning by the coordinator node at least one thread for the at least one task for processing on at least one of the plurality of nodes, wherein a node that is provisioned at least one thread is deemed an initiator node associated with the thread; employing the initiator node to process the at least one task using the provisioned at least one thread, wherein processing the at least one task includes making at least one storage drive access request to at least another of the plurality of nodes that is separately employed as a participant node that provides access to at least one storage drive device; determining by the coordinator node each storage drive device at each participant node having a workload processing access requests that is above a predefined threshold; and dynamically reducing at least a portion of the at least one thread on the initiator node that provided the storage drive access request to each participant node that provides access to the at least one storage device having the workload above the predefined threshold.