Context Analysis Using a Bayesian Normal Graph

Contextual information can be used to help object detection in video and images, or to categorize text. In this work we demonstrate how the Latent Variable Model, expressed as a Factor Graph in Reduced Normal Form, can manage contextual information to support a scene understanding task. In an unsupervised scenario our model learns how various objects can coexist, by associating object variables to a latent Bayesian cluster. The model, that is implemented using probabilistic message propagation, can be used to correct or to assign labels to new images.

[1]  Antonio Torralba,et al.  A Tree-Based Context Model for Object Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[3]  Antonio Torralba,et al.  Contextual Priming for Object Detection , 2003, International Journal of Computer Vision.

[4]  Francesco Palmieri,et al.  Two-dimensional multi-layer Factor Graphs in Reduced Normal Form , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[5]  Serge J. Belongie,et al.  Object categorization using co-occurrence, location and appearance , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Stuart Geman,et al.  Context and Hierarchy in a Probabilistic Image Model , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[7]  Francesco Palmieri,et al.  Bayesian Clustering on Images with Factor Graphs in Reduced Normal Form , 2016, Advances in Neural Networks.

[8]  A. Torralba,et al.  The role of context in object recognition , 2007, Trends in Cognitive Sciences.

[9]  Francesco Palmieri,et al.  Simulink Implementation of Belief Propagation in Normal Factor Graphs , 2015, Advances in Neural Networks.

[10]  Francesco Palmieri,et al.  Discrete independent component analysis (DICA) with belief propagation , 2015, 2015 IEEE 25th International Workshop on Machine Learning for Signal Processing (MLSP).

[11]  Francesco Palmieri,et al.  A Comparison of Algorithms for Learning Hidden Variables in Bayesian Factor Graphs in Reduced Normal Form , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Daphne Koller,et al.  Learning Spatial Context: Using Stuff to Find Things , 2008, ECCV.

[13]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[14]  H.-A. Loeliger,et al.  An introduction to factor graphs , 2004, IEEE Signal Processing Magazine.

[15]  Fei-Fei Li,et al.  Recognizing Human-Object Interactions in Still Images by Modeling the Mutual Context of Objects and Human Poses , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Francesco Palmieri,et al.  Towards Building Deep Networks with Bayesian Factor Graphs , 2015, ArXiv.

[17]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[18]  Thomas M. Cover,et al.  Elements of Information Theory: Cover/Elements of Information Theory, Second Edition , 2005 .

[19]  Sanja Fidler,et al.  The Role of Context for Object Detection and Semantic Segmentation in the Wild , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.