Object triangulation, 3-D object tracking, feature correspondence, and camera calibration are key problems for estimation from camera networks. This paper addresses these problems within a unified Bayesian framework for joint multi-object tracking and sensor registration. Given that using standard filtering approaches for state estimation from cameras is problematic, an alternative parametrisation is exploited, called disparity space. The disparity space-based approach for triangulation and object tracking is shown to be more effective than non-linear versions of the Kalman filter and particle filtering for non-rectified cameras. The approach for feature correspondence is based on the Probability Hypothesis Density (PHD) filter, and hence inherits the ability to update without explicit measurement association, to initiate new targets, and to discriminate between target and clutter. The PHD filtering approach then forms the basis of a camera calibration method from static or moving objects. Results are shown on simulated data.
@cite_47: 
@cite_20: Bayesian single-target tracking techniques can be extended to a multiple-target environment by viewing the multiple-target state as a random finite set, but evaluating the multiple-target posterior distribution is currently computationally intractable for real-time applications. A practical alternative to the optimal Bayes multitarget filter is the probability hypothesis density (PHD) filter, which propagates the first-order moment of the multitarget posterior instead of the posterior distribution itself. It has been shown that the PHD is the best-fit approximation of the multitarget posterior in an information-theoretic sense. The method avoids the need for explicit data association, as the target states are viewed as a single global target state, and the identities of the targets are not part of the tracking framework. Sequential Monte Carlo approximations of the PHD using particle filter techniques have been implemented, showing the potential of this technique for real-time tracking applications. This paper presents mathematical proofs of convergence for the particle filtering algorithm and gives bounds for the mean-square error
@cite_12: This comprehensive resource provides you with an in-depth understanding of finite-set statistics (FISST) - a recently developed method which unifies much of information fusion under a single probabilistic, in fact Bayesian, paradigm. The book helps you master FISST concepts, techniques, and algorithms, so you can use FISST to address real-world challenges in the field. You learn how to model, fuse, and process highly disparate information sources, and detect and track non-cooperative individual platform groups and conventional non-cooperative targets. You find a rigorous Bayesian unification for many aspects of expert systems theory. Moreover, the book presents systematic integral and differential calculus for multisource-multitarget problems, providing a methodology for devising rigorous new techniques. This accessible and detailed book is supported with over 3,000 equations, 90 clear examples, 70 explanatory figures, and 60 exercises with solutions.
The FISST approach to multi-sensor multi-object tracking has attracted significant international attention in the Sensor Fusion community due to the success of practical implementations of first-moment multi-object approximation filters, known as Probability Hypothesis Density (PHD) filters @cite_12 @cite_47 @cite_20 .