1. A method comprising: encoding a bitstream comprising a base layer, a first enhancement layer and a second enhancement layer; encoding an indication of both the base layer and the first enhancement layer used for prediction for the second enhancement layer in the bitstream; encoding, in the bitstream, an indication of a first set of prediction types with a first prediction direction that is applicable from the base layer to the second enhancement layer, wherein the first set of prediction types is a subset of all prediction types available for prediction between layers, encoding, in the bitstream, an indication of a second set of prediction types with a second prediction direction that is applicable from the base layer or the first enhancement layer to the second enhancement layer, wherein the second set of prediction types is a subset of all prediction types available for prediction between layers, wherein the first set of prediction types with the first prediction direction and the second set of prediction types with the second prediction direction have different domains or scalability types; and encoding, in the bitstream, an indication of at least one set of prediction types that is not applicable from the base layer or the first enhancement layer to the second enhancement layer, wherein said prediction type is adaptively selectable as at least one of the following: sample prediction, motion information prediction or filtering parameter prediction.