Multi-agent surveillance and tracking using cyclic stochastic gradient

This paper formulates a solution to a problem in stochastic multi-agent and multi-target surveillance. The research goal is to implement a cyclic stochastic optimization (CSO) application for an ensemble of cooperating, mobile sensing agents executing a surveillance mission. Each agent continually combines information to determine its best estimate of the multi-target system state and then decides on its next action. This decision is selected to optimize a criterion related to the Fisher information matrix. For CSO, only noisy measurements of the objective function are available to each agent, and in this study, each agent attempts to optimize this objective function by calculating its stochastic gradient. This paper examines the implications and applicability of CSO convergence via simulation-based experiments. In these experiments, a cooperating multi-agent ensemble of sensing agents search a region for targets and, using our proposed algorithm, maintain track on all discovered targets.

[1]  A. J. Newman,et al.  Dynamic optimization of ISR sensors using a risk-based reward function applied to ground and space surveillance scenarios , 2012, Defense + Commercial Sensing.

[2]  Ronald Mahler,et al.  MULTITARGET SENSOR MANAGEMENT OF DISPERSED MOBILE SENSORS , 2004 .

[3]  Simon Haykin,et al.  Cognitive Control , 2012, Proceedings of the IEEE.

[4]  Yan Jin,et al.  Balancing search and target response in cooperative UAV teams , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[5]  Alfred O. Hero,et al.  An Information-Based Approach to Sensor Management in Large Dynamic Networks , 2007, Proceedings of the IEEE.

[6]  James C. Spall,et al.  Cyclic Seesaw Process for Optimization and Identification , 2012, J. Optim. Theory Appl..

[7]  James C. Spall,et al.  Simulation-based examination of the limits of performance for decentralized multi-agent surveillance and tracking of undersea targets , 2014, Defense + Security Symposium.

[8]  Sean R. Martin,et al.  Decentralized closed-loop collaborative surveillance and tracking performance sensitivity to communications connectivity , 2013, Defense, Security, and Sensing.

[9]  James C. Spall,et al.  Cyclic stochastic optimization with noisy function measurements , 2014, 2014 American Control Conference.

[10]  Mo M. Jamshidi,et al.  Consensus Control for a System of Underwater Swarm Robots , 2010, IEEE Systems Journal.

[11]  Daniel Pack,et al.  Decentralized Cooperative Control of Autonomous Surface Vehicles , 2010 .

[12]  James C. Spall,et al.  Introduction to Stochastic Search and Optimization. Estimation, Simulation, and Control (Spall, J.C. , 2007 .

[13]  Ümit Özgüner,et al.  Motion planning for multitarget surveillance with mobile sensor agents , 2005, IEEE Transactions on Robotics.

[14]  Erik Blasch,et al.  Performance Measures of Covariance and Information Matrices in Resource Management for Target State Estimation , 2012, IEEE Transactions on Aerospace and Electronic Systems.

[15]  Y. Bar-Shalom,et al.  Autonomous search, tracking and classification by multiple cooperative UAVs , 2006, SPIE Defense + Commercial Sensing.

[16]  James C. Spall,et al.  Introduction to stochastic search and optimization - estimation, simulation, and control , 2003, Wiley-Interscience series in discrete mathematics and optimization.