Tracking and Localization based on Multi-angle Vision for Underwater Target

With the cost reduction of underwater sensor network nodes and the increasing demand for underwater detection and monitoring, near-land areas, shallow water areas, lakes and rivers have gradually tended to densely arranged sensor nodes. In order to achieve real-time monitoring, most nodes now have visual sensors instead of acoustic sensors to collect and analyze optical images, mainly because cameras might be more advantageous when it comes to dense underwater sensor networks. In this article, image enhancement, saliency detection, calibration and refraction model calculation are performed on the video streams collected by multiple optical cameras to obtain the track of the dynamic target. This study not only innovatively combines the application of AOD-Net’s (all-in-one network) image defogging algorithm with underwater image enhancement, but also refers to the BASNet (Boundary-Aware Salient network) network architecture, introducing frame difference results in the input to reduce the interference of static targets. Based on the aforementioned technologies, this paper designs a dynamic target tracking system centered on video stream processing in dense underwater networks. As part of the process, most nodes carried underwater cameras. When the dynamic target could be captured by at least two nodes in the network at the same time, the target position could then be calculated and tracked.

[1]  Fei Cheng,et al.  Object detection based on an adaptive attention mechanism , 2020, Scientific Reports.

[2]  Nasser Alzeidi,et al.  Localization Schemes for Underwater Wireless Sensor Networks: Survey , 2020 .

[3]  Shang Gao,et al.  An RNN-Based Delay-Guaranteed Monitoring Framework in Underwater Wireless Sensor Networks , 2019, IEEE Access.

[4]  Jiaxin Liu,et al.  A Scale-Adaptive Matching Algorithm for Underwater Acoustic and Optical Images , 2020, Sensors.

[5]  Jonghoek Kim,et al.  Cooperative Localization and Unknown Currents Estimation Using Multiple Autonomous Underwater Vehicles , 2020, IEEE Robotics and Automation Letters.

[6]  Yangyang Wang,et al.  Pseudo-3D Vision-Inertia Based Underwater Self-Localization for AUVs , 2020, IEEE Transactions on Vehicular Technology.

[7]  Atsushi Yamashita,et al.  Underwater Structure from Motion for Cameras Under Refractive Surfaces , 2019, J. Robotics Mechatronics.

[8]  Souhail Guennouni,et al.  Performance Evaluation of Edge Orientation Histograms Based System for Real-time Object Detection in Two Separate Platforms , 2020 .

[9]  Sen Bai,et al.  Autonomous underwater vehicles localisation in mobile underwater networks , 2016 .

[10]  Xiaohui Wei,et al.  RECRP: An Underwater Reliable Energy-Efficient Cross-Layer Routing Protocol † , 2018, Sensors.

[11]  Jun Liu,et al.  DeepOcean: A General Deep Learning Framework for Spatio-Temporal Ocean Sensing Data Prediction , 2020, IEEE Access.

[12]  Navinda Kottege,et al.  Underwater acoustic localization for small submersibles , 2011, J. Field Robotics.

[13]  Miao Pan,et al.  HAS4: A Heuristic Adaptive Sink Sensor Set Selection for Underwater AUV-Aid Data Gathering Algorithm , 2018, Sensors.

[14]  Jun Wang,et al.  Neural-Network-Based AUV Navigation for Fast-Changing Environments , 2020, IEEE Internet of Things Journal.

[15]  Junzhi Yu,et al.  A NSGA-II-Based Calibration Algorithm for Underwater Binocular Vision Measurement System , 2020, IEEE Transactions on Instrumentation and Measurement.

[16]  Can Zhang,et al.  A standard expression of underwater binocular vision for stereo matching , 2020 .

[17]  Kun-Chou Lee,et al.  Underwater acoustic localization by principal components analyses based probabilistic approach , 2009 .

[18]  Jong-Hwan Kim,et al.  SimVODIS: Simultaneous Visual Odometry, Object Detection, and Instance Segmentation , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Stefan Winkler,et al.  The Evolution of Video Quality Measurement: From PSNR to Hybrid Metrics , 2008, IEEE Transactions on Broadcasting.

[20]  Miao Pan,et al.  Task-Oriented Intelligent Networking Architecture for the Space–Air–Ground–Aqua Integrated Network , 2020, IEEE Internet of Things Journal.

[21]  Ling Shao,et al.  Video Salient Object Detection via Fully Convolutional Networks , 2017, IEEE Transactions on Image Processing.

[22]  S. N. Shome,et al.  Real-time underwater image enhancement: An improved approach for imaging with AUV-150 , 2016 .

[23]  Danail Stoyanov,et al.  Refractive Two-View Reconstruction for Underwater 3D Vision , 2019, International Journal of Computer Vision.

[24]  Hajime Asama,et al.  Structure from Motion of Underwater Scenes Considering Image Degradation and Refraction , 2019 .