Capacity and Limits of Multimodal Remote Sensing: Theoretical Aspects and Automatic Information Theory-Based Image Selection

Although multimodal remote sensing data analysis can strongly improve the characterization of physical phenomena on Earth's surface, nonidealities and estimation imperfections between records and investigation models can limit its actual information extraction ability. In this article, we aim at predicting the maximum information extraction that can be reached when analyzing a given data set. By means of an asymptotic information theory-based approach, we investigate the reliability and accuracy that can be achieved under optimal conditions for multimodal analysis as a function of data statistics and parameters that characterize the multimodal scenario to be addressed. Our approach leads to the definition of two indices that can be easily computed before the actual processing takes place. Moreover, we report in this article how they can be used for operational use in terms of image selection in order to maximize the robustness of the multimodal analysis, as well as to properly design data collection campaigns for understanding and quantifying physical phenomena. Experimental results show the consistency of our approach.

[1]  Stephen V. Stehman,et al.  Selecting and interpreting measures of thematic classification accuracy , 1997 .

[2]  Katsuaki Koike,et al.  Improved Accuracy of Chlorophyll-a Concentration Estimates from MODIS Imagery Using a Two-Band Ratio Algorithm and Geostatistics: As Applied to the Monitoring of Eutrophication Processes over Tien Yen Bay (Northern Vietnam) , 2013, Remote. Sens..

[3]  Zhaohui Xue,et al.  Kernel Supervised Ensemble Classifier for the Classification of Hyperspectral Data Using Few Labeled Samples , 2016, Remote. Sens..

[4]  Thomas M. Cover,et al.  Network Information Theory , 2001 .

[5]  Jon Atli Benediktsson,et al.  Multisource and Multitemporal Data Fusion in Remote Sensing , 2018, ArXiv.

[6]  Shuai Li,et al.  Remote sensing of chlorophyll-a concentration for drinking water source using genetic algorithms (GA)-partial least square (PLS) modeling , 2012, Ecol. Informatics.

[7]  Luis Gómez-Chova,et al.  Biophysical Parameter Estimation With a Semisupervised Support Vector Machine , 2009, IEEE Geoscience and Remote Sensing Letters.

[8]  Jocelyn Chanussot,et al.  Challenges and Opportunities of Multimodality and Data Fusion in Remote Sensing , 2014, Proceedings of the IEEE.

[9]  Quan Zheng,et al.  Integral global minimization: Algorithms, implementations and numerical tests , 1995, J. Glob. Optim..

[10]  L. Goddard Information Theory , 1962, Nature.

[11]  T. W. Anderson An Introduction to Multivariate Statistical Analysis , 1959 .

[12]  Jon Atli Benediktsson,et al.  Hyperspectral Image Classification With Rotation Random Forest Via KPCA , 2017, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[13]  Paolo Gamba,et al.  Integration of Administrative, Clinical, and Environmental Data to Support the Management of Type 2 Diabetes Mellitus , 2015, Journal of diabetes science and technology.

[14]  Gustavo Camps-Valls,et al.  Retrieval of oceanic chlorophyll concentration with relevance vector machines , 2006 .

[15]  W. Marsden I and J , 2012 .

[16]  Ken A. Dill,et al.  Molecular Structure Prediction by Global Optimization , 1997 .

[17]  Christian Jutten,et al.  Multimodal Soft Nonnegative Matrix Co-Factorization for Convolutive Source Separation , 2017, IEEE Transactions on Signal Processing.

[18]  Gabriele Moser,et al.  Supervised Classification of Multisensor and Multiresolution Remote Sensing Images With a Hierarchical Copula-Based Approach , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[19]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[20]  Sanjay Ranka,et al.  Disaggregation of Remotely Sensed Soil Moisture in Heterogeneous Landscapes Using Holistic Structure-Based Models , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[21]  A. Kraskov,et al.  Estimating mutual information. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  Silvano Martello,et al.  Meta-Heuristics: Advances and Trends in Local Search Paradigms for Optimization , 2012 .

[23]  Lorenzo Bruzzone An approach to feature selection and classification of remote sensing images based on the Bayes rule for minimum cost , 2000, IEEE Trans. Geosci. Remote. Sens..

[24]  Pierre Comon,et al.  Information–Estimation Relationship in Mismatched Gaussian Channels , 2017, IEEE Signal Processing Letters.

[25]  J. Benediktsson,et al.  Remotely Sensed Image Classification Using Sparse Representations of Morphological Attribute Profiles , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[26]  J. J. Moré,et al.  Global continuation for distance geometry problems , 1995 .

[27]  Tin Kam Ho,et al.  A Data Complexity Analysis of Comparative Advantages of Decision Forest Constructors , 2002, Pattern Analysis & Applications.

[28]  Xiaofeng Li,et al.  Straight road edge detection from high-resolution remote sensing images based on the ridgelet transform with the revised parallel-beam Radon transform , 2010 .

[29]  Naoto Yokoya,et al.  Advanced Multi-Sensor Optical Remote Sensing for Urban Land Use and Land Cover Classification: Outcome of the 2018 IEEE GRSS Data Fusion Contest , 2019, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[30]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[31]  Paolo Gamba,et al.  An Efficient Approach for Local Affinity Pattern Detection in Remotely Sensed Big Data , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[32]  Qian Du,et al.  Multi-Modal Change Detection, Application to the Detection of Flooded Areas: Outcome of the 2009–2010 Data Fusion Contest , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[33]  Lorenzo Bruzzone,et al.  Kernel methods for remote sensing data analysis , 2009 .

[34]  Verzekeren Naar Sparen,et al.  Cambridge , 1969, Humphrey Burton: In My Own Time.

[35]  Marco Pastori,et al.  Information mining in remote sensing image archives: system concepts , 2003, IEEE Trans. Geosci. Remote. Sens..

[36]  Jiawei Han,et al.  Generalized Fisher Score for Feature Selection , 2011, UAI.

[37]  K. Svanberg The method of moving asymptotes—a new method for structural optimization , 1987 .

[38]  J. L. Maryak,et al.  Bayesian Heuristic Approach to Discrete and Global Optimization , 1999, Technometrics.

[39]  Pravin Varaiya,et al.  Capacity of fading channels with channel side information , 1997, IEEE Trans. Inf. Theory.

[40]  Qian Du,et al.  Kernel Collaborative Representation With Tikhonov Regularization for Hyperspectral Image Classification , 2014, IEEE Geoscience and Remote Sensing Letters.

[41]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[42]  Jun Zhang,et al.  Evolutionary Computation Meets Machine Learning: A Survey , 2011, IEEE Computational Intelligence Magazine.

[43]  Nicholas I. M. Gould,et al.  A branch and bound algorithm for the global optimization of Hessian Lipschitz continuous functions , 2013, J. Glob. Optim..

[44]  Carolin Strobl,et al.  Unbiased split selection for classification trees based on the Gini Index , 2007, Comput. Stat. Data Anal..

[45]  Qian Du,et al.  A survey on representation-based classification and detection in hyperspectral remote sensing imagery , 2016, Pattern Recognit. Lett..

[46]  R. Horst,et al.  Global Optimization: Deterministic Approaches , 1992 .

[47]  A. Goldsmith,et al.  Capacity of Rayleigh fading channels under different adaptive transmission and diversity-combining techniques , 1999, IEEE Transactions on Vehicular Technology.

[48]  Gabriele Moser,et al.  Multimodal Classification of Remote Sensing Images: A Review and Future Directions , 2015, Proceedings of the IEEE.

[49]  Layne T. Watson,et al.  Feature reduction using a singular value decomposition for the iterative guided spectral class rejection hybrid classifier , 2009 .

[50]  A. Robert Calderbank,et al.  MIMO Wireless Communications , 2007 .

[51]  David A. Landgrebe,et al.  Feature Extraction Based on Decision Boundaries , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Emma Izquierdo-Verdiguier,et al.  Evaluating the Performance of a Random Forest Kernel for Land Cover Classification , 2017, Remote. Sens..

[53]  Michel Barlaud,et al.  To be or not to be convex? A study on regularization in hyperspectral image classification , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[54]  A. A. Zhigli︠a︡vskiĭ,et al.  Theory of Global Random Search , 1991 .

[55]  Shunsuke Ihara,et al.  On the Capacity of Channels with Additive Non-Gaussian Noise , 1978, Inf. Control..

[56]  Pablo A. Estévez,et al.  A review of feature selection methods based on mutual information , 2015, Neural Computing and Applications.

[57]  D. Lazer,et al.  The Parable of Google Flu: Traps in Big Data Analysis , 2014, Science.