1. A method for decoding a video bitstream, comprising: determining, for a current block of the video bitstream, a reference motion vector from a varying number of candidate reference motion vectors, wherein the reference motion vector is associated with a reference block and includes a predicted portion and a residual portion; selecting a probability context model for the current block by evaluating the residual portion of the reference motion vector with one or more thresholds; and entropy decoding, for the current block using a processor, a motion vector residual associated with the current block using the probability context model.