Multi-kernel extreme learning machine for EEG classification in brain-computer interfaces

Multi-kernel extreme learning machine based method is proposed for EEG classification.Supplementary information from different kernels are integrated for better accuracy.Extensive experimental comparison confirms superiority of the proposed method. One of the most important issues for the development of a motor-imagery based brain-computer interface (BCI) is how to design a powerful classifier with strong generalization capability. Extreme learning machine (ELM) has recently proven to be comparable or more efficient than support vector machine for many pattern recognition problems. In this study, we propose a multi-kernel ELM (MKELM)-based method for motor imagery electroencephalogram (EEG) classification. The kernel extension of ELM provides an elegant way to circumvent calculation of the hidden layer outputs and inherently encode it in a kernel matrix. We investigate effects of two different kernel functions (i.e., Gaussian kernel and polynomial kernel) on the performance of kernel ELM. The MKELM method is subsequently developed by integrating these two types of kernels with a multi-kernel learning strategy, which can effectively explore the supplementary information from multiple nonlinear feature spaces for more robust classification of EEG. An extensive experimental comparison with two public EEG datasets indicates that the MKELM method gives higher classification accuracy than those of the other competing algorithms. The experimental results confirm that superiority of the proposed MKELM-based method for accurate classification of EEG associated with motor imagery in BCI applications. Our method also provides a promising and generalized solution to investigate the complex and nonlinear information for various applications in the fields of expert and intelligent systems.

[1]  Xun Chen,et al.  Joint Blind Source Separation for Neurophysiological Data Analysis: Multiset and multimodal methods , 2016, IEEE Signal Processing Magazine.

[2]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[3]  Fumitoshi Matsuno,et al.  A Novel EOG/EEG Hybrid Human–Machine Interface Adopting Eye Movements and ERPs: Application to Robot Control , 2015, IEEE Transactions on Biomedical Engineering.

[4]  Alice J. Kozakevicius,et al.  Automated drowsiness detection through wavelet packet analysis of a single EEG channel , 2016, Expert Syst. Appl..

[5]  Wei Wu,et al.  STRAPS: A Fully Data-Driven Spatio-Temporally Regularized Algorithm for M/EEG Patch Source Imaging , 2015, Int. J. Neural Syst..

[6]  Jian Yang,et al.  An improved robust and sparse twin support vector regression via linear programming , 2014, Soft Comput..

[7]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Chi-Man Vong,et al.  Sparse Bayesian Extreme Learning Machine for Multi-classification , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Wei Wu,et al.  Probabilistic Common Spatial Patterns for Multichannel EEG Analysis , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[11]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[12]  Engin Avci,et al.  A new method for expert target recognition system: Genetic wavelet extreme learning machine (GAWELM) , 2013, Expert Syst. Appl..

[13]  Xingyu Wang,et al.  Optimizing spatial patterns with sparse filter bands for motor-imagery based brain–computer interface , 2015, Journal of Neuroscience Methods.

[14]  Tzyy-Ping Jung,et al.  High-speed spelling with a noninvasive brain–computer interface , 2015, Proceedings of the National Academy of Sciences.

[15]  Xiaofeng Gong,et al.  Tensor decomposition of EEG signals: A brief review , 2015, Journal of Neuroscience Methods.

[16]  Lei Wang,et al.  Multiple kernel extreme learning machine , 2015, Neurocomputing.

[17]  Xingyu Wang,et al.  Aggregation of Sparse Linear Discriminant analyses for Event-Related potential Classification in Brain-Computer Interface , 2014, Int. J. Neural Syst..

[18]  Dinggang Shen,et al.  Low-Rank Graph-Regularized Structured Sparse Regression for Identifying Genetic Biomarkers , 2017, IEEE Transactions on Big Data.

[19]  Guang-Bin Huang,et al.  An Insight into Extreme Learning Machines: Random Neurons, Random Features and Kernels , 2014, Cognitive Computation.

[20]  Xingyu Wang,et al.  Sparse Bayesian multiway canonical correlation analysis for EEG pattern recognition , 2017, Neurocomputing.

[21]  Guang-Bin Huang,et al.  Extreme Learning Machine for Multilayer Perceptron , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[22]  Qinyu. Zhu Extreme Learning Machine , 2013 .

[23]  Dean J Krusienski,et al.  A comparison of classification techniques for the P300 Speller , 2006, Journal of neural engineering.

[24]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[25]  Xingyu Wang,et al.  Fast nonnegative tensor factorization based on accelerated proximal gradient and low-rank approximation , 2016, Neurocomputing.

[26]  Yong Xu,et al.  Sparse Representation for Brain Signal Processing: A tutorial on methods and applications , 2014, IEEE Signal Processing Magazine.

[27]  Xingyu Wang,et al.  A P300 Brain-Computer Interface Based on a Modification of the Mismatch Negativity Paradigm , 2015, Int. J. Neural Syst..

[28]  Yuanqing Li,et al.  Surfing the internet with a BCI mouse , 2012, Journal of neural engineering.

[29]  Andrzej Cichocki,et al.  Linked Component Analysis From Matrices to High-Order Tensors: Applications to Biomedical Data , 2015, Proceedings of the IEEE.

[30]  Wei Wu,et al.  Bayesian estimation of ERP components from multicondition and multichannel EEG , 2014, NeuroImage.

[31]  Pedro J. García-Laencina,et al.  Exploring dimensionality reduction of EEG features in motor imagery task classification , 2014, Expert Syst. Appl..

[32]  Xiaofeng Zhu,et al.  Multi-view multi-sparsity kernel reconstruction for multi-class image classification , 2015, Neurocomputing.

[33]  Xingyu Wang,et al.  Optimized Motor Imagery Paradigm Based on Imagining Chinese Characters Writing Movement , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  Dinggang Shen,et al.  Multi‐task diagnosis for autism spectrum disorders using multi‐modality features: A multi‐center study , 2017, Human brain mapping.

[35]  Engin Avci,et al.  A new automatic target recognition system based on wavelet extreme learning machine , 2012, Expert Syst. Appl..

[36]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[37]  Xingyu Wang,et al.  Frequency Recognition in SSVEP-Based BCI using Multiset Canonical Correlation Analysis , 2013, Int. J. Neural Syst..

[38]  Xingyu Wang,et al.  Motor imagery EEG classification via Bayesian extreme learning machine , 2016, 2016 Sixth International Conference on Information Science and Technology (ICIST).

[39]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[40]  Guang-Bin Huang,et al.  Trends in extreme learning machines: A review , 2015, Neural Networks.

[41]  Saeid Nahavandi,et al.  EEG signal classification for BCI applications by wavelets and interval type-2 fuzzy logic systems , 2015, Expert Syst. Appl..

[42]  Wei Wu,et al.  A hierarchical Bayesian approach for learning sparse spatio-temporal decompositions of multichannel EEG , 2011, NeuroImage.

[43]  Chi-Man Vong,et al.  Sparse Bayesian extreme learning machine and its application to biofuel engine performance prediction , 2015, Neurocomputing.

[44]  Tianwei Shi,et al.  Brain Computer Interface system based on indoor semi-autonomous navigation and motor imagery for Unmanned Aerial Vehicle control , 2015, Expert Syst. Appl..

[45]  Wei Wu,et al.  Multimodal BCIs: Target Detection, Multidimensional Control, and Awareness Evaluation in Patients With Disorder of Consciousness , 2016, Proceedings of the IEEE.

[46]  A. Cichocki,et al.  An optimized ERP brain–computer interface based on facial expression changes , 2014, Journal of neural engineering.

[47]  Jian Yang,et al.  Recursive projection twin support vector machine via within-class variance minimization , 2011, Pattern Recognit..

[48]  Guang-Bin Huang,et al.  Learning capability and storage capacity of two-hidden-layer feedforward networks , 2003, IEEE Trans. Neural Networks.

[49]  Xiaolan Fu,et al.  Face Recognition and Micro-expression Recognition Based on Discriminant Tensor Subspace Analysis Plus Extreme Learning Machine , 2014, Neural Processing Letters.

[50]  Jim Jing-Yan Wang,et al.  Feature selection and multi-kernel learning for adaptive graph regularized nonnegative matrix factorization , 2015, Expert Syst. Appl..

[51]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[52]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.

[53]  Timothy A. Warner,et al.  Kernel-based extreme learning machine for remote-sensing image classification , 2013 .

[54]  Xingyu Wang,et al.  Sparse Bayesian Learning for Obtaining Sparsity of EEG Frequency Bands Based Feature Vectors in Motor Imagery Classification , 2017, Int. J. Neural Syst..

[55]  Zongben Xu,et al.  Universal Approximation of Extreme Learning Machine With Adaptive Growth of Hidden Nodes , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[56]  Alexandros Iosifidis,et al.  On the kernel Extreme Learning Machine speedup , 2015, Pattern Recognit. Lett..

[57]  Alexandros Iosifidis,et al.  On the kernel Extreme Learning Machine classifier , 2015, Pattern Recognit. Lett..

[58]  Heung-No Lee,et al.  Sparse representation-based classification scheme for motor imagery-based brain–computer interface systems , 2012, Journal of neural engineering.

[59]  Xingyu Wang,et al.  Sparse Bayesian Classification of EEG for Brain–Computer Interface , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[60]  F. L. Chen,et al.  Sales forecasting system based on Gray extreme learning machine with Taguchi method in retail industry , 2011, Expert Syst. Appl..

[61]  Shie-Jue Lee,et al.  An efficient multiple-kernel learning for pattern classification , 2013, Expert Syst. Appl..

[62]  Cuntai Guan,et al.  Optimizing the Channel Selection and Classification Accuracy in EEG-Based BCI , 2011, IEEE Transactions on Biomedical Engineering.

[63]  A. K. Das,et al.  A discriminative subject-specific spatio-spectral filter selection approach for EEG based motor-imagery task classification , 2016, Expert Syst. Appl..

[64]  Rui Zhang,et al.  Enhanced Motor Imagery Training Using a Hybrid BCI With Feedback , 2015, IEEE Transactions on Biomedical Engineering.

[65]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorizations : An algorithmic perspective , 2014, IEEE Signal Processing Magazine.

[66]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[67]  Yu Zhang,et al.  A Novel Multilayer Correlation Maximization Model for Improving CCA-Based Frequency Recognition in SSVEP Brain-Computer Interface , 2017, Int. J. Neural Syst..

[68]  Xingyu Wang,et al.  Discriminative Feature Extraction via Multivariate Linear Regression for SSVEP-Based BCI , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[69]  Cuntai Guan,et al.  Optimizing Spatial Filters by Minimizing Within-Class Dissimilarities in Electroencephalogram-Based Brain–Computer Interface , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[70]  Liqing Zhang,et al.  Kernelization of Tensor-Based Models for Multiway Data Analysis: Processing of Multidimensional Structured Data , 2013, IEEE Signal Processing Magazine.