Queries on Kalman Filter
Main thing is that in the first frame it will be required to select the object of detection because it is obvious that the algorithm will not know automatically which object you want to track if a number of things will be moving in the video scene.Lucas-Kannade method is one of the methods which can detect moving objects in a given video frame . If you do not specify object it will show movement of all moving objects.Thats why you have to tell the algorithm which thing you want to track. Second thing i want to tell you is about Kalman filter which i think you are interpreting wrong , what Kalman filter actually do is that it uses the system model and input signal and generates its own output which is actually a predicted value . Now using the observation from the system it calculate the correction to be applied to the predicted output and hence final results are better than observations obtained from the system. Hence very first step is that you need a system model and the measurements. In tracking algorithms generally, Image processing algorithm is applied to detect the object of interest and then Kalman filter is applied to make the detected location more precise. Do not think that it will predict on its own. I hope it will help you.