An Intelligent Real-Time Occupancy Monitoring System Using Single Overhead Camera

Real-time occupancy monitoring information is an important component in building energy management and security. Advances in technology enables us to develop vision-based systems. These systems have gained popularity among different scientific research communities due to their high accuracy. Based on real-time video from a single camera, people occupancy rates in buildings can be correctly estimated using neural network models. This paper proposes an intelligent real-time bidirectional system, using Random Neural Network (RNN) predictions. An overhead camera was used to capture RGB images and the number of people crossing a virtual line was counted using the proposed counting technique. The proposed algorithm extracts some important features such as occupant blob areas, major axis, minor axis, eccentricity, perimeters and area-perimeter ratio for total 1000 frames. Finally, a RNN model is trained with aforementioned features using a gradient decent algorithm. Real-time experimental results show the effectiveness of the proposed method, especially when occupants are in group and blob merge/split scenarios. Real-time testing revealed an accuracy between 100 and 93.38% for single and multiple occupants, respectively.

[1]  Christian Micheloni,et al.  Video security for ambient intelligence , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[2]  Dubravko Culibrk,et al.  K-means based segmentation for real-time zenithal people counting , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[3]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Lawrence Wai-Choong Wong,et al.  A PTZ camera based people-occupancy estimation system (PCBPOES) , 2017, 2017 Fifteenth IAPR International Conference on Machine Vision Applications (MVA).

[5]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[6]  Junjie Yan,et al.  Water Filling: Unsupervised People Counting via Vertical Kinect Sensor , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[7]  Abbas Javed,et al.  Smart Random Neural Network Controller for HVAC Using Cloud Computing Technology , 2017, IEEE Transactions on Industrial Informatics.

[8]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[9]  Vidhya Balasubramanian,et al.  A Comparative Study of Vision Based Human Detection Techniques in People Counting Applications , 2015 .

[10]  Ching-Tang Hsieh,et al.  A Kinect-based people-flow counting system , 2012, 2012 International Symposium on Intelligent Signal Processing and Communications Systems.

[11]  Mario Vento,et al.  Counting people by RGB or depth overhead cameras , 2016, Pattern Recognit. Lett..

[12]  Weidong Zhou,et al.  Design and Simulation of the Integrated Navigation System based on Extended Kalman Filter , 2017 .

[13]  Osama Masoud,et al.  Estimating pedestrian counts in groups , 2008, Comput. Vis. Image Underst..

[14]  Abbas Javed,et al.  Energy demand prediction through novel random neural network predictor for large non-domestic buildings , 2017, 2017 Annual IEEE International Systems Conference (SysCon).

[15]  Valery A. Petrushin,et al.  Counting people using video cameras , 2007, Int. J. Parallel Emergent Distributed Syst..

[16]  Tsong-Yi Chen,et al.  A Cost-Effective People-Counter for a Crowd of Moving People Based on Two-Stage Segmentation , 2012, J. Inf. Hiding Multim. Signal Process..

[17]  Lei Meng,et al.  A people counting system based on head-shoulder detection and tracking in surveillance video , 2010, 2010 International Conference On Computer Design and Applications.

[18]  Tsong-Yi Chen,et al.  An Intelligent People-Flow Counting Method for Passing Through a Gate , 2006, 2006 IEEE Conference on Robotics, Automation and Mechatronics.

[19]  José Luis Lázaro,et al.  Tracking People Motion Based on Extended Condensation Algorithm , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[20]  Greg Welch,et al.  An Introduction to Kalman Filter , 1995, SIGGRAPH 2001.