18. A device for coding video data, the device comprising: a memory configured to store the video data; and a video coder in communication with the memory, wherein the video coder is configured to: determine whether a coding unit (CU) depth of a current CU is smaller than a minimal CU depth of one or more neighboring CUs, or whether the CU depth of the current CU is greater than a maximum CU depth of the one or more neighboring CUs; select, as part of an entropy coding process, a context for a syntax element associated with the current CU stored in the memory based on information relating to CU depth of the one or more neighboring CUs relative to the current CU, wherein the information relating to the CU depth of the one or more neighboring CUs relative to the current CU includes whether the CU depth of the current CU is smaller than the minimal CU depth of the one or more neighboring CUs or whether the CU depth of the current CU is greater than the maximum CU depth of the one or more neighboring CUs, wherein the syntax element represents whether the current CU is split into sub-CUs; and entropy code the syntax element based on the selected context.
18. A device for coding video data, the device comprising: a memory configured to store the video data; and a video coder in communication with the memory, wherein the video coder is configured to: determine whether a coding unit (CU) depth of a current CU is smaller than a minimal CU depth of one or more neighboring CUs, or whether the CU depth of the current CU is greater than a maximum CU depth of the one or more neighboring CUs; select, as part of an entropy coding process, a context for a syntax element associated with the current CU stored in the memory based on information relating to CU depth of the one or more neighboring CUs relative to the current CU, wherein the information relating to the CU depth of the one or more neighboring CUs relative to the current CU includes whether the CU depth of the current CU is smaller than the minimal CU depth of the one or more neighboring CUs or whether the CU depth of the current CU is greater than the maximum CU depth of the one or more neighboring CUs, wherein the syntax element represents whether the current CU is split into sub-CUs; and entropy code the syntax element based on the selected context. 29. The device of claim 18 , wherein the syntax element comprises a split_cu_flag syntax element.