1. A method of decoding video data, the method comprising: receiving in a video parameter set, one or more syntax elements that include information related to hypothetical reference decoder (HRD) parameters; receiving in the video data a first sequence parameter set comprising a first syntax element identifying the video parameter set; receiving in the video data a second sequence parameter set comprising a second syntax element identifying the video parameter set; coding, based on the one or more syntax elements, a first set of video blocks associated with the first parameter set and second set of video blocks associated with the second parameter set.