1. A method for decoding video data, the method comprising: obtaining, from a video parameter set (VPS) in a bitstream, a syntax element that indicates whether inter-view/layer reference pictures are ever included in a second reference picture list for any view component/layer representation of any coded video sequence (CVS) that refers to the VPS; constructing, based on pictures in a reference picture set, a first reference picture list and a second reference picture list for a current view component/layer representation of a CVS that refers to the VPS, wherein at least one inter-view/layer reference picture is present in the first reference picture list for the current view component/layer representation; and decoding the current view component/layer representation, wherein when the syntax element indicates that inter-view/layer reference pictures are never included in the second reference picture list for any view component/layer representation of any CVS that refers to the VPS, the current view component/layer representation is decoded without use of inter-view/layer reference pictures in the second reference picture list for the current view component/layer representation.