1. A method of processing video data, the method comprising: decoding, from a scalable nesting supplemental enhancement information (SEI) message in an encoded video bitstream, a plurality of syntax elements that identify a plurality of operation points to which each nested SEI message encapsulated by the scalable nesting SEI message applies, wherein: the encoded video bitstream comprises coded pictures of the video data, the scalable nesting SEI message includes one or more nested SEI messages encapsulated by the scalable nesting SEI message, the plurality of syntax elements is not in any nested SEI message encapsulated by the scalable nesting SEI message, and for each respective operation point of the plurality of operation points, a sub-bitstream associated with the respective operation point is derivable by removing, from the encoded video bitstream, any Network Abstraction Layer (NAL) unit with a temporal identifier greater than a respective temporal identifier associated with the respective operation point and removing, from the encoded video bitstream, any NAL unit with a layer identifier not in a respective set of layer identifiers associated with the respective operation point.