1. A method of decoding video data, the method comprising: determining that a first transform coefficient of a first video block is a DC transform coefficient, wherein the first video block comprises a plurality of sub-blocks; determining a first context for entropy decoding the first transform coefficient based on the first transform coefficient being the DC transform coefficient without regard for a first size of the first video block; determining that a second transform coefficient of the first video block is not the DC transform coefficient; based on the second transform coefficient not being the DC transform coefficient, determining a second context for entropy decoding the second transform coefficient based at least in part on which of the sub-blocks includes the second transform coefficient; determining whether a third transform coefficient of a second video block is a DC transform coefficient, wherein the second video block has a second size different from the first size of the first video block; when the third transform coefficient is determined to be the DC transform coefficient of the second video block, determining the first context for entropy decoding the third transform coefficient based on the third transform coefficient being the DC transform coefficient of the second video block without regard for the second size; entropy decoding the first transform coefficient using the first context; entropy decoding the second transform coefficient using the second context; and entropy decoding the third transform coefficient using the first context.