1. A parallel operation processing apparatus, comprising: a parallel operator configured to calculate a path value of source nodes in a current column, and to determine input data and at least one source node in a previous column, the input data corresponding to a path selected using the path value; and a data arrangement unit configured to arrange first input data of the source nodes in the current column, based on an order of second input data of the at least one source node in the previous column, wherein the parallel operator combines the arranged first input data with the second input data, based on a register processing unit, and stores the combined input data in a parallel register unit.