1. A method for processing video data, comprising: receiving multiple frames of video data forming tracking information by: detecting at least one of a feature and an object in a region of interest of the video data using a detection algorithm in at least one frame; modeling the detected at least one of the feature and the object using a set of parameters; and associating any instances of the detected and modeled at least one of the feature and the object across plural frames of the video data, resulting in at least one track of the associated instances, each track providing tracking information of respective associated instances; relating the at least one track to at least one specific block of video data to be encoded; and producing a model-based prediction for the at least one specific block of video data using the tracking information of the at least one related track, the model-based prediction having model-based motion vectors, and said producing including incorporating the model-based motion vectors into a standards-compliant bit stream such that the model-based prediction is stored as standards-compliant encoded video data.