1. A method for encoding video data into a plurality of bitstreams using an encoding system, the video data comprising data from a plurality of data categories, the method comprising: providing at least one first layer, wherein the at least one first layer comprises a frame-compatible interlace representation of the plurality of data categories from the video data; providing at least one second layer, wherein each second layer comprises one or more progressive representations, each progressive representation being associated with one or more of the data categories; encoding the at least one first layer to generate one or more encoded first layer bitstreams; and encoding the at least one second layer to generate one or more encoded second layer bitstreams, wherein the encoding the at least one second layer comprises, for a particular second layer: performing disparity estimation on one or more progressive representations associated with the particular second layer based on second layer reference pictures from a reference picture buffer associated with the particular second layer to generate disparity parameters; performing disparity compensation on the second layer reference pictures based on the disparity parameters to generate predicted progressive pictures; taking a difference between each progressive representation associated with the particular second layer and a corresponding predicted progressive picture to obtain second layer residuals, each second layer residual being associated with an data category; performing transformation and quantization on the second layer residuals to obtain second layer quantized transform residuals; and performing entropy encoding on the second layer quantized transform residuals to generate one or more second layer bitstreams.