Deep Neural Networks with Extreme Learning Machine for Seismic Data Compression

Advances on seismic survey techniques require a large number of geophones. This leads to an exponential growth in the size of data and prohibitive demands on storage and network communication resources. Therefore, it is desirable to compress the seismic data to the minimum possible, without losing important information. In this paper, a stacked auto-encoder extreme learning machine (AE-ELM) for seismic data compression is proposed. First, a deep asymmetric auto-encoder is constructed, in which nonlinear activation functions are used in the encoder hidden layers and linear activation functions are utilized in the decoder layers. Second, the encoder hidden layers are connected in a cascade way, so that outputs of a hidden layer are considered as the inputs to the succeeding hidden layer. Third, the optimal weights of connections between the layers of the decoder are solved analytically. Lastly, the AE-ELMs are stacked to create the complete encoder/decoder. The extreme learning machine (ELM) is selected due to its analytical calculation of weights efficient training that is suitable for practical implementation. In this neural network, data compression is achieved by transforming the original data through the encoder layers where the size of outputs from the last encoder hidden layer is smaller than the original data size. The proposed method exhibits a comparable reconstruction quality on a real dataset but with a much shorter training duration than other deep neural networks methods. This neural network with more than 8000 hidden units achieved $$ 1.28 \times 10^{ - 3} $$ 1.28 × 10 - 3 of normalized mean-squared error for 10:1 of compression ratio with only 8.23 s of training time.

[1]  Tara N. Sainath,et al.  FUNDAMENTAL TECHNOLOGIES IN MODERN SPEECH RECOGNITION Digital Object Identifier 10.1109/MSP.2012.2205597 , 2012 .

[2]  Andreas Spanias,et al.  Transform methods for seismic data compression , 1991, IEEE Trans. Geosci. Remote. Sens..

[3]  Kou-Yuan Huang Neural networks for seismic principal components analysis , 1999, IEEE Trans. Geosci. Remote. Sens..

[4]  Gholamreza Akbarizadeh,et al.  Detection of Lung Nodules in CT Scans Based on Unsupervised Feature Learning and Fuzzy Inference , 2016 .

[5]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[6]  Gholamreza Akbarizadeh,et al.  Effective supervised multiple-feature learning for fused radar and optical data classification , 2017 .

[7]  Khaled A. Harras,et al.  A Deep Learning Approach for Vital Signs Compression and Energy Efficient Delivery in mhealth Systems , 2018, IEEE Access.

[8]  Julian M. Kunkel,et al.  Data Compression for Climate Data , 2016, Supercomput. Front. Innov..

[9]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[10]  Truong Q. Nguyen,et al.  Seismic data compression: a comparative study between GenLOT and wavelet compression , 1999, Optics & Photonics.

[11]  Abdullatif A. Al-Shuhail,et al.  Processing of Seismic Reflection Data Using MATLAB , 2011, Synthesis Lectures on Signal Processing.

[12]  Nitish Srivastava,et al.  Multimodal learning with deep Boltzmann machines , 2012, J. Mach. Learn. Res..

[13]  Gholamreza Akbarizadeh,et al.  Optimized fuzzy cellular automata for synthetic aperture radar image edge detection , 2018 .

[14]  Ayaz Ghorbani,et al.  ISAR Image Reconstruction with Heavily Corrupted Data Based on Normal Inverse Gaussian Model , 2018, Journal of the Indian Society of Remote Sensing.

[15]  Asma Raeisi,et al.  Combined Method of an Efficient Cuckoo Search Algorithm and Nonnegative Matrix Factorization of Different Zernike Moment Features for Discrimination Between Oil Spills and Lookalikes in SAR Images , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  Gholamreza Akbarizadeh,et al.  Ship Classification in SAR Images Using a New Hybrid CNN–MLP Classifier , 2018, Journal of the Indian Society of Remote Sensing.

[17]  Bo Liu,et al.  Seismic-data compression using autoassociative neural network and restricted Boltzmann machine , 2018, SEG Technical Program Expanded Abstracts 2018.

[18]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  Dipankar Das,et al.  Enhanced SenticNet with Affective Labels for Concept-Based Opinion Mining , 2013, IEEE Intelligent Systems.

[20]  Michele Rossi,et al.  Lightweight Lossy Compression of Biometric Patterns via Denoising Autoencoders , 2015, IEEE Signal Processing Letters.

[21]  Hugo Larochelle,et al.  Efficient Learning of Deep Boltzmann Machines , 2010, AISTATS.

[22]  Lawrence C. Wood Seismic data compression methods , 1974 .

[23]  Gholamreza Akbarizadeh,et al.  Integration of Spectral Histogram and Level Set for Coastline Detection in SAR Images , 2019, IEEE Transactions on Aerospace and Electronic Systems.

[24]  Bo Liu,et al.  Disributed principal component analysis for data compression of sequential seismic sensor arrays , 2016 .

[25]  Bo Liu,et al.  A Distributed Principal Component Analysis Compression for Smart Seismic Acquisition Networks , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Ru-Shan Wu,et al.  Seismic data compression by an adaptive local cosine/sine transform and its effects on migration , 2000 .

[27]  Yann Ollivier Auto-encoders: reconstruction versus compression , 2014, ArXiv.

[28]  Jinghuai Gao,et al.  Dreamlet Transform Applied to Seismic Data Compression And Its Effects On Migration , 2009 .

[29]  Andrew Perkis,et al.  Filter bank optimization for high-dimensional compression of pre-stack seismic data , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[30]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[31]  Chikkannan Eswaran,et al.  Using Autoencoders for Mammogram Compression , 2009, Journal of Medical Systems.

[32]  Phil D. Anno,et al.  Seismic Data Compression And Regularization Via Wave Packets , 2010 .

[33]  Khaled A. Harras,et al.  Multimodal Deep Learning Approach for Joint EEG-EMG Data Compression and Classification , 2017, 2017 IEEE Wireless Communications and Networking Conference (WCNC).

[34]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[35]  Yee Whye Teh,et al.  Rate-coded Restricted Boltzmann Machines for Face Recognition , 2000, NIPS.

[36]  C. Eswaran,et al.  Performance Evaluation of Neural Network and Linear Predictors for Near-Lossless Compression of EEG Signals , 2008, IEEE Transactions on Information Technology in Biomedicine.

[37]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[38]  Michael B. Wakin,et al.  Lossy Compression for Wireless Seismic Data Acquisition , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[39]  Gholamreza Akbarizadeh,et al.  A New Statistical-Based Kurtosis Wavelet Energy Feature for Texture Recognition of SAR Images , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Lawrence G. Roberts,et al.  Beyond Moore's Law: Internet Growth Trends , 2000, Computer.

[41]  W. B. Johnson,et al.  Extensions of Lipschitz mappings into Hilbert space , 1984 .