1. A method for adding a plurality of first floating point numbers in a parallel computing system, the parallel computing system including a plurality of computing nodes, a computing node including at least one processor and at least one memory device, the method comprising: receiving, at a collective logic device, a plurality of the first floating point numbers in parallel from the computing nodes or network links; converting, by said collective logic device, the first floating point numbers to a plurality of integer numbers, said collective logic device further for comparing exponents of each of the first floating point numbers to determine a maximum exponent; adding the integer numbers in parallel and generating a summation of all of the plurality of integer numbers in one pass; and converting the summation to a second floating point number by performing shifting according to the maximum exponent, wherein the receiving, the converting the first floating point numbers, the adding, the generating and the converting the summation are performed in one pass in which the computing nodes send the plurality of first floating point numbers only once to the collective logic device and receive the second floating point number only once from the collective logic device.