1. An arithmetic device which controls a parallel arithmetic operation, the arithmetic device comprising: a global memory; a plurality of compute units, each of the compute units including a local memory and a plurality of processing elements, and each of the processing elements including a private memory and processing data blocks stored in the private memory; an attribute group holding unit which includes following attributes; a specific attribute which includes a parameter indicative of a size of a data block of the data blocks; an arithmetic attribute which includes a parameter indicating whether the data block includes data relevant to processing, and indicating a transfer order when the data block includes data relevant to processing; and a policy attribute which includes a parameter indicative of how to execute a transfer of the data block and how to execute processing of the data block; and a scenario determination unit that determines respective transfer systems of the data blocks between the global memory and at least one of the private memories and the local memories based on the specific attribute, the arithmetic attribute, and the policy attribute.