1. A method comprising: receiving first data defining a first bounding box for a first image of a sequence of images, the first bounding box corresponding to a region of interest and including a tracked object; receiving object tracking data for a second image of the sequence of images, the object tracking data defining a second bounding box, the second bounding box corresponding to the region of interest and including the tracked object in the second image; based on receiving the object tracking data for the second image and defining the second bounding box, determining a search region for the second image based on the second bounding box, the search region corresponding to a portion of the second image and including pixels within the second bounding box and pixels next to the second bounding box; and based on determining the search region for the second image, determining a plurality of similarity metrics based on multiple search bounding boxes corresponding to the search region, wherein the search region includes the multiple search bounding boxes, wherein each similarity metric of the plurality of similarity metrics is determined based on first pixels within the first bounding box and search pixels within a search bounding box, of the multiple search bounding boxes, that corresponds to the similarity metric, and wherein search coordinates of each of the multiple search bounding boxes are based on second coordinates of the second bounding box shifted in one or more directions; and determining a modified second bounding box based on the plurality of similarity metrics.