1. A method for decoding video data, the method comprising: receiving, in a bitstream, significance syntax elements for transform coefficients of a current sub-block of a block; selecting a context pattern from a plurality of two-dimensional context patterns for a plurality of scan types for the significance syntax elements of the transform coefficients of the current sub-block, wherein the plurality of two-dimensional context patterns is the same for each of the plurality of scan types, and wherein each of the context patterns is associated with a condition of whether one or more neighboring sub-blocks include any non-zero transform coefficients; assigning contexts to each of the significance syntax elements of the transform coefficients based on the selected context pattern; and context adaptive binary arithmetic coding (CABAC) decoding the significance syntax elements of the transform coefficients of the current sub-block based on the assigned contexts.