1. A real-time three-dimensional (3D) real environment reconstruction apparatus, comprising: a plurality of RGB-D cameras that acquire frame information including RGB color image information and depth image information; and a processor that includes a plurality of GPUs for processing the frame information acquired by the plurality of RGB-D cameras and a CPU for aligning a processing result of each of the GPUs, and reconstructs a 3D real environment in real-time, wherein the RGB-D cameras the GPUs are configured as sets including one RGB-D camera and one GPU.