1. A real-time three-dimensional (3D) real environment reconstruction apparatus, comprising: a plurality of RGB-D cameras that acquire frame information, the frame information including RGB color image information and depth image information; and a processor that reconstructs a 3D real environment in real-time and includes: a plurality of GPUs that process the frame information acquired by the plurality of RGB-D cameras, wherein each GPU is part of a set that includes one RGB-D camera and one GPU; and a CPU that aligns a processing result generated by each of the GPUs.