1. A method for video-based object tracking, said method comprising: selecting at least one motion parameter from a plurality of motion parameters associated with a scene of interest; defining a motion environment state according to said selected at least one motion parameter, wherein said selected at least one motion parameter is indicative of a pattern of motion in said scene of interest; setting a size of a search neighborhood associated with a target object according to said motion environment state; adjusting said motion environment state as said pattern of motion in said scene of interest changes; adjusting said size of said search neighborhood associated with said target object in response to said adjusted motion environment state; and determining a frame-by-frame location of said target object using said adjusted search neighborhood size in order to track said target object in said video data.