1. A distributed computing system comprising: a computing node cluster including a plurality of computing nodes comprising first computing nodes that each generates associated data; a distributed memory cluster configured to store the associated data of the first computing nodes; a controlling node configured to select memory blocks of the associated data for distribution on the distributed memory cluster based on a node selection rule and memory cluster structure information, and to select second computing nodes from the computing node cluster based on a location selection rule and the memory cluster structure information, wherein the controller node is configured to select, as one of the selected second computing nodes, a computing node included in a server rack storing the associated data greater than a given data amount, and to control the selected computing node to process the data stored in the same server rack.