Socio-economic vision graph generation and handover in distributed smart camera networks

In this article we present an approach to object tracking handover in a network of smart cameras, based on self-interested autonomous agents, which exchange responsibility for tracking objects in a market mechanism, in order to maximise their own utility. A novel ant-colony inspired mechanism is used to learn the vision graph, that is, the camera neighbourhood relations, during runtime, which may then be used to optimise communication between cameras. The key benefits of our completely decentralised approach are on the one hand generating the vision graph online, enabling efficient deployment in unknown scenarios and camera network topologies, and on the other hand relying only on local information, increasing the robustness of the system. Since our market-based approach does not rely on a priori topology information, the need for any multicamera calibration can be avoided. We have evaluated our approach both in a simulation study and in network of real distributed smart cameras.

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  William Vickrey,et al.  Counterspeculation, Auctions, And Competitive Sealed Tenders , 1961 .

[3]  Kazuyuki Morioka,et al.  A Cooperative Object Tracking System with Fuzzy-Based Adaptive Camera Selection , 2010 .

[4]  S. Clearwater.  Market-based control: a paradigm for distributed resource allocation , 1996 .

[5]  Bernhard Rinner,et al.  Autonomous Multicamera Tracking on Embedded Smart Cameras , 2007, EURASIP J. Embed. Syst..

[6]  Peter McBurney,et al.  Evolutionary mechanism design: a review , 2010, Autonomous Agents and Multi-Agent Systems.

[7]  Peter McBurney,et al.  An evolutionary game-theoretic comparison of two double-auction market designs , 2004, AAMAS'04.

[8]  Charles R. Plott,et al.  An Experimental Examination of Two Exchange Institutions , 1978 .

[9]  Nicholas R. Jennings,et al.  Bidding optimally in concurrent second-price auctions of perfectly substitutable goods , 2007, AAMAS '07.

[10]  Xin Yao,et al.  How Specialised Are Specialists? Generalisation Properties of Entries from the 2008 and 2009 TAC Market Design Competitions , 2009, AMEC/TADA.

[11]  D. Makris.  Learning a Multi-camera Topology , 2003 .

[12]  David S. Munro,et al.  Topology Estimation for Thousand-Camera Surveillance Networks , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[13]  Justin K. Romberg,et al.  Multi-camera tracking on a graph using Markov chain Monte Carlo , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[14]  Bernhard Rinner,et al.  An Introduction to Distributed Smart Cameras , 2008, Proceedings of the IEEE.

[15]  Wendi B. Heinzelman,et al.  A Survey of Visual Sensor Networks , 2009, Adv. Multim..

[16]  David Hausheer,et al.  PeerMart: the technology for a distributed auction-based market for peer-to-peer services , 2005, IEEE International Conference on Communications, 2005. ICC 2005. 2005.

[17]  Xin Yao,et al.  A socio-economic approach to online vision graph generation and handover in distributed smart camera networks , 2011, 2011 Fifth ACM/IEEE International Conference on Distributed Smart Cameras.

[18]  Daniel Keren,et al.  Multi-Camera Topology Recovery from Coherent Motion , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[19]  Peter McBurney,et al.  JCAT: a platform for the TAC market design competition , 2008, AAMAS.

[20]  Bir Bhanu,et al.  A comparison of techniques for camera selection and handoff in a video network , 2009, 2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).

[21]  Kevin C. Almeroth,et al.  Price issues in delivering E-content on-demand , 2002, SECO.

[22]  Enrico Gerding,et al.  Bilateral bargaining with multiple opportunities: knowing your opponent's bargaining position , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[23]  Nicholas R. Jennings,et al.  Optimal Bidding Strategies for Simultaneous Vickrey Auctions with Perfect Substitutes , 2006, Negotiation and Market Engineering.

[24]  T. Eymann,et al.  Co-Evolution of Bargaining Strategies in a Decentralized Multi-Agent System , 2001 .

[25]  Manuel López-Ibáñez,et al.  Ant colony optimization , 2010, GECCO '10.

[26]  Xin Yao,et al.  Improved adaptivity and robustness in decentralised multi-camera networks , 2012, 2012 Sixth International Conference on Distributed Smart Cameras (ICDSC).

[27]  Tim J. Ellis,et al.  Bridging the gaps between cameras , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[28]  Richard J. Radke.  A Survey of Distributed Computer Vision Algorithms , 2010, Handbook of Ambient Intelligence and Smart Environments.

[29]  Andrew B. Whinston,et al.  The economics of network management , 1999, CACM.

[30]  Demetri Terzopoulos,et al.  Multi-camera Control through Constraint Satisfaction for Persistent Surveillance , 2008, 2008 IEEE Fifth International Conference on Advanced Video and Signal Based Surveillance.

[31]  Zhaolin Cheng,et al.  Determining Vision Graphs for Distributed Camera Networks Using Feature Digests , 2007, EURASIP J. Adv. Signal Process..

[32]  Gregory Dudek,et al.  A practical algorithm for network topology inference , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[33]  Torsten Eymann,et al.  The catallaxy approach for decentralized economic-based allocation in Grid resource and service markets , 2006, Applied Intelligence.

[34]  Tad Hogg,et al.  Spawn: A Distributed Computational Economy , 1992, IEEE Trans. Software Eng..

[35]  Yiming Li,et al.  Utility-Based Camera Assignment in a Video Network: A Game Theoretic Framework , 2011, IEEE Sensors Journal.

[36]  Xin Yao,et al.  Resource allocation in decentralised computational systems: an evolutionary market-based approach , 2009, Autonomous Agents and Multi-Agent Systems.

[37]  Amit K. Roy-Chowdhury,et al.  Tracking and Activity Recognition Through Consensus in Distributed Camera Networks , 2010, IEEE Transactions on Image Processing.

[38]  Mongi A. Abidi,et al.  Camera handoff with adaptive resource management for multi-camera multi-object tracking , 2010, Image Vis. Comput..

[39]  Bir Bhanu,et al.  Distributed Video Sensor Networks , 2011 .

[40]  YaoXin,et al.  Socio-economic vision graph generation and handover in distributed smart camera networks , 2014 .

[41]  Pietro Simone Oliveto,et al.  Co-evolution of Optimal Agents for the Alternating Offers Bargaining Game , 2010, EvoApplications.

[42]  Michael Wooldridge,et al.  Negotiation among autonomous computational agents: principles, analysis and challenges , 2008, Artificial Intelligence Review.

[43]  Stan Sclaroff,et al.  Look there! Predicting where to look for motion in an active camera network , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[44]  Vernon L. Smith,et al.  A Comparison of Posted-Offer and Double-Auction Pricing Institutions , 1984 .

[45]  Richard Wolski,et al.  Analyzing Market-Based Resource Allocation Strategies for the Computational Grid , 2001, Int. J. High Perform. Comput. Appl..

[46]  Dave Cliff,et al.  Simple Bargaining Agents for Decentralized Market-Based Control , 1998, ESM.

[47]  Eric A. Brewer,et al.  Lessons from Giant-Scale Services , 2001, IEEE Internet Comput..

[48]  Hans M. Amman,et al.  Handbook of Computational Economics , 1996 .

[49]  D. Cliff.  Minimal-Intelligence Agents for Bargaining Behaviors in Market-Based Environments , 1997 .

[50]  Gernot A. Fink,et al.  Calibration-free camera hand-over for fast and reliable person tracking in multi-camera setups , 2008, 2008 19th International Conference on Pattern Recognition.

[51]  Xin Yao,et al.  Resource-aware configuration in smart camera networks , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.