1. A method of operating a network comprising a plurality of nodes and a plurality of node-to-node connections by a computerized apparatus, the method comprising: configuring individual ones of the plurality of connections, each adapted to communicate data from a source node to a target node of the plurality of nodes, and to allow access to memory associated with the target node; partitioning the plurality of nodes into at least a first node portion and a second node portion, individual ones of the plurality of nodes being characterized by a node memory; selecting a first portion of the plurality of connections configured to provide an input to individual nodes of the first node portion; and selecting a second portion of the plurality of connections configured to provide the input to individual nodes of the second node portion; wherein the first node portion and the first portion of the plurality of connections are assigned to a first parallel executor; and wherein the second node portion and the second portion of the plurality of connections are assigned to a second parallel executor; wherein: an operation of the first portion of the plurality of connections and the first node portion by the first parallel executor is characterized by first and second operation stages configured to be executed immediately sequentially with one another; an operation of the second portion of the plurality of connections and the second node portion by the second parallel executor is characterized by third and fourth operation stages configured to be executed immediately sequentially with one another; the first, second, third, and fourth operation stages have varied execution times; and an operation of a combination of the first and the second operation stages is configured to occur in parallel with an operation of a combination of the third and fourth operation stages.