Ensemble Transfer Learning for Emergency Landing Field Identification on Moderate Resource Heterogeneous Kubernetes Cluster

The full loss of thrust of an aircraft requires fast and reliable decisions of the pilot. If no published landing field is within reach, an emergency landing field must be selected. The choice of a suitable emergency landing field denotes a crucial task to avoid unnecessary damage of the aircraft, risk for the civil population as well as the crew and all passengers on board. Especially in case of instrument meteorological conditions it is indispensable to use a database of suitable emergency landing fields. Thus, based on public available digital orthographic photos and digital surface models, we created various datasets with different sample sizes to facilitate training and testing of neural networks. Each dataset consists of a set of data layers. The best compositions of these data layers as well as the best performing transfer learning models are selected. Subsequently, certain hyperparameters of the chosen models for each sample size are optimized with Bayesian and Bandit optimization. The hyperparameter tuning is performed with a self-made Kubernetes cluster. The models outputs were investigated with respect to the input data by the utilization of layer-wise relevance propagation. With optimized models we created an ensemble model to improve the segmentation performance. Finally, an area around the airport of Arnsberg in North Rhine-Westphalia was segmented and emergency landing fields are identified, while the verification of the final approach's obstacle clearance is left unconsidered. These emergency landing fields are stored in a PostgreSQL database.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Wolfram Schiffmann,et al.  Emergency Landing Field Recognition Based on Elevation Data Using Parallel Processing , 2018, 2018 IEEE/AIAA 37th Digital Avionics Systems Conference (DASC).

[3]  Masahiro Iwahashi,et al.  Safety-level Estimation of Aerial Images based on Convolutional Neural Network for Emergency Landing of Unmanned Aerial Vehicle , 2018, 2018 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[4]  Xi Liu,et al.  Forced landing technologies for unmanned aerial vehicles : towards safer operations , 2009 .

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Luis Mejías Alvarez,et al.  Enabling Aircraft Emergency Landings Using Active Visual Site Detection , 2013, FSR.

[7]  Klaus-Robert Müller,et al.  Layer-Wise Relevance Propagation: An Overview , 2019, Explainable AI.

[8]  D. Fitzgerald,et al.  A Vision Based Forced Landing Site Selection System for an Autonomous UAV , 2005, 2005 International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Jiang Li,et al.  A Vision-Based Automatic Safe Landing-Site Detection System , 2013, IEEE Transactions on Aerospace and Electronic Systems.

[11]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[12]  Lars Petersson,et al.  Classification of materials in natural scenes using multi-spectral images , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Nikos Komodakis,et al.  Wide Residual Networks , 2016, BMVC.

[15]  Marius Klein,et al.  Moving target approach for wind-aware flight path generation , 2018, Int. J. Netw. Comput..

[16]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Matthew Coombes,et al.  Landing site reachability and decision making for UAS forced landings , 2016 .

[18]  Emil Slusanschi,et al.  SafeUAV: Learning to Estimate Depth and Safe Landing Areas for UAVs from Synthetic Data , 2018, ECCV Workshops.

[19]  Sumair Aziz,et al.  UAV Emergency Landing Site Selection System using Machine Vision , 2016 .

[20]  Luis Mejias,et al.  A multi-layered approach for site detection in UAS emergency landing scenarios using geometry-based image segmentation , 2013, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).

[21]  Luis Mejias Classifying natural aerial scenery for autonomous aircraft emergency landing , 2014, 2014 International Conference on Unmanned Aircraft Systems (ICUAS).

[22]  P. B. Sujit,et al.  Terrain-based landing site selection and path planning for fixed-wing UAVs , 2015, 2015 International Conference on Unmanned Aircraft Systems (ICUAS).

[23]  J. Lyou,et al.  Robust terrain classification by introducing environmental sensors , 2010, 2010 IEEE Safety Security and Rescue Robotics.

[24]  Masaki Takahashi,et al.  Path Planning to Improve Reachability in a Forced Landing , 2017, J. Intell. Robotic Syst..

[25]  Marko Lukša Kubernetes in Action , 2018 .

[26]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[27]  Guilherme Ottoni,et al.  Constrained Bayesian Optimization with Noisy Experiments , 2017, Bayesian Analysis.

[28]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[29]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[30]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[31]  Daniel P. Raymer,et al.  Aircraft Design: A Conceptual Approach , 1989 .

[32]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Xiangyu Zhang,et al.  ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design , 2018, ECCV.

[34]  Daniel Raymer,et al.  Aircraft Design: A Conceptual Approach, Sixth Edition , 2012 .

[35]  Boris Polyak,et al.  Acceleration of stochastic approximation by averaging , 1992 .

[36]  Chiman Kwan,et al.  Semi-Automated Emergency Landing Site Selection Approach for UAVs , 2019, IEEE Transactions on Aerospace and Electronic Systems.

[37]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Pavel Pačes,et al.  EMERGENCY LANDING SITE LOCATION USING AERIAL IMAGE SEGMENTATION , 2014 .

[39]  Frank Hutter,et al.  Fixing Weight Decay Regularization in Adam , 2017, ArXiv.

[40]  Rafael C. González,et al.  Digital image processing, 3rd Edition , 2008 .

[41]  K. Madhava Krishna,et al.  Fast and Spatially-Smooth Terrain Classification Using Monocular Camera , 2010, 2010 20th International Conference on Pattern Recognition.

[42]  Benjamin Van Roy,et al.  A Tutorial on Thompson Sampling , 2017, Found. Trends Mach. Learn..