Data-driven background representation method to video surveillance.

Background subtraction is the fundamental step of moving object detection. As current methods use specific data-based or data learning methods to represent background, this will induce the problem of model distortion while the scenarios cannot meet their assumptions or model conditions. A novel data-driven framework is proposed to represent the background using the intrinsic characteristics of the background. In the framework, the model-free adaptive control method is used as an instance to analyze the background by its status of the nearest time instants, and linearize them dynamically from a pure data perspective. To overcome the occlusion of foreground objects, the selective update method is employed to satisfy the background update. Experiments are carried out under different video conditions to compare algorithm performance with state-of-the-art background models. The results show that the proposed method has reached over 95% in F-measure and percentage of correct classification in most cases, which is better than other state-of-the-art methods. Furthermore, the proposed method shows better robustness in severe video conditions, including bad weather and night cases, and its simplified data-driven control laws make it suitable for outdoor video surveillance.

[1]  Tong Liu,et al.  A fast recognition algorithm for suspicious behavior in high definition videos , 2015, Multimedia Systems.

[2]  Chun Qi,et al.  Future-data driven modeling of complex backgrounds using mixture of Gaussians , 2013, Neurocomputing.

[3]  Seong-Dae Kim,et al.  Dynamic background subtraction via sparse representation of dynamic textures in a low-dimensional subspace , 2016, Signal Image Video Process..

[4]  Brendon J. Woodford,et al.  A Self-adaptive CodeBook (SACB) model for real-time background subtraction , 2015, Image Vis. Comput..

[5]  Zhi Xu,et al.  Variant of the region-scalable fitting energy for image segmentation. , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  Andrzej Czyzewski,et al.  Parallel implementation of background subtraction algorithms for real-time video processing on a supercomputer platform , 2012, Journal of Real-Time Image Processing.

[7]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[8]  Felix Naumann,et al.  Data fusion , 2009, CSUR.

[9]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Z. Hou,et al.  On Data-driven Control Theory: the State of the Art and Perspective: On Data-driven Control Theory: the State of the Art and Perspective , 2009 .

[11]  Nigel J. B. McFarlane,et al.  Segmentation and tracking of piglets in images , 1995, Machine Vision and Applications.

[12]  Jitendra Malik,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence Segmentation of Moving Objects by Long Term Video Analysis , 2022 .

[13]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[14]  Dilip K Prasad,et al.  Online tracking of deformable objects under occlusion using dominant points. , 2013, Journal of the Optical Society of America. A, Optics, image science, and vision.

[15]  Lihua Jiang,et al.  Analysis of Heavy Metal Sources for Vegetable Soils from Shandong Province, China , 2011 .

[16]  Fadi Dornaika,et al.  Efficient object detection and tracking in video sequences. , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.

[17]  Boubakeur Boufama,et al.  Feature-based active contour model and occluding object detection. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[18]  Shangtai Jin,et al.  A Novel Data-Driven Control Approach for a Class of Discrete-Time Nonlinear Systems , 2011, IEEE Transactions on Control Systems Technology.

[19]  Rita Cucchiara,et al.  Detecting Moving Objects, Ghosts, and Shadows in Video Streams , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  G. Choquet Theory of capacities , 1954 .

[21]  Xuhui Bu,et al.  Model free adaptive control with data dropouts , 2011, Expert Syst. Appl..

[22]  Guoying Zhao,et al.  Background Subtraction Based on Low-Rank and Structured Sparse Decomposition , 2015, IEEE Transactions on Image Processing.

[23]  The Monte Carlo Simulation of the Electronic Local Properties in the Two-Dimensional Disordered System , 2012 .

[24]  Lucia Maddalena,et al.  A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications , 2008, IEEE Transactions on Image Processing.

[25]  Andrea Fusiello,et al.  Patch-Based Background Initialization in Heavily Cluttered Video , 2010, IEEE Transactions on Image Processing.

[26]  Lucia Maddalena,et al.  A fuzzy spatial coherence-based approach to background/foreground separation for moving object detection , 2010, Neural Computing and Applications.

[27]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[28]  Vasile Gui,et al.  A fast algorithm for background tracking in video surveillance, using nonparametric kernel density estimation , 2005 .

[29]  Laure Tougne,et al.  Special section on background models comparison , 2014, Comput. Vis. Image Underst..

[30]  Antoine Vacavant,et al.  A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos , 2014, Comput. Vis. Image Underst..