A multi-camera Multi-Target Tracker based on Factor Graphs

System modeling with Probabilistic Graphical Models (PGM) has become increasingly popular in the last years. In this paper we design a Multiple Target Tracker based on the probabilistic architecture of Normal Factor Graph. Belief propagation makes best use of data coming from different branches of the graph and yields the tracks via messages fusion. The issues of data association, track life-cycle management and data fusion from heterogeneous sensor modalities are resolved at each time step by propagating and combining forward and backward probabilistic messages. Inexpensive cameras deployed in the scene under surveillance are the primary sensor modality, even if the framework has been designed to receive data from a wide range of sensors such as Radars, Infrared cameras, etc. The framework has been tested by calculating the tracks of different ships moving in an harbour framed by three cameras.

[1]  F. A. N. Palmieri,et al.  Harbour surveillance with cameras calibrated with AIS data , 2013, 2013 IEEE Aerospace Conference.

[2]  Pascal Vasseur,et al.  Introduction to Multisensor Data Fusion , 2005, The Industrial Information Technology Handbook.

[3]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[4]  G. Forney,et al.  Codes on graphs: normal realizations , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[5]  LI X.RONG,et al.  Survey of maneuvering target tracking. Part I. Dynamic models , 2003 .

[6]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[7]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[8]  Thiagalingam Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation , 2001 .

[9]  Mathias Kölsch,et al.  Emerging Topics in Computer Vision , 2004 .

[10]  R. Mahler.  Multitarget Bayes filtering via first-order multitarget moments , 2003 .

[11]  Francesco Castaldo,et al.  Image fusion for object tracking using Factor Graphs , 2014, 2014 IEEE Aerospace Conference.

[12]  B. Vo,et al.  Data Association and Track Management for the Gaussian Mixture Probability Hypothesis Density Filter , 2009, IEEE Transactions on Aerospace and Electronic Systems.

[13]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[14]  Li Ping,et al.  The Factor Graph Approach to Model-Based Signal Processing , 2007, Proceedings of the IEEE.

[15]  David Barber,et al.  Bayesian reasoning and machine learning , 2012 .

[16]  X. Jin.  Factor graphs and the Sum-Product Algorithm , 2002 .

[17]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .