1. A computing device comprising a video processing system, the video processing system comprising: a video decoder comprising: an input configured to receive, for an encoded bitstream of video data, indices of frames of the encoded video data and information describing a format of the encoded video data; and an output configured to provide decoded video data, the encoded video data comprising encoded video data in a plurality of formats; and memory accessible by the video decoder and configured to store the encoded bitstream and data from the output of the video decoder at least based on the video decoder decoding the encoded bitstream; the video decoder configured to: compute addresses in the memory at least using the one or more indices of the one or more frames and the format of the video data; access and decode the encoded bitstream; and output decoded video data at least based on the computed addresses; the memory configured to store an array of textures, the array of textures including, for video data in the plurality of formats, a first set of memory locations configured to store the data produced by the video decoder based on decoding of the encoded bitstream of video data in a first format, and a second set of memory locations configured to store the data produced by the video decoder based on decoding of the encoded bitstream of video data in a second format, a number of memory locations in the first set and a number of memory locations in the second set allocated so as to change while the video decoder is decoding the encoded bitstream.