1. A system for encoding a plurality of videos acquired of a moving object in a scene by a plurality of fixed cameras, comprising: means for determining camera calibration data of each camera; means for associating the camera calibration data of each camera with the video acquired by the camera; means for determining a segmentation mask for each frame of each video, the segmentation mask identifying only pixels in the frame associated with the object; a shape encoder configured to encode the segmentation masks; a position encoder configured to encode a position of each pixel; and a color encoder configured to encode a color of each pixel.