Information Theoretic Approaches for Motor-Imagery BCI Systems: Review and Experimental Comparison

Brain computer interfaces (BCIs) have been attracting a great interest in recent years. The common spatial patterns (CSP) technique is a well-established approach to the spatial filtering of the electroencephalogram (EEG) data in BCI applications. Even though CSP was originally proposed from a heuristic viewpoint, it can be also built on very strong foundations using information theory. This paper reviews the relationship between CSP and several information-theoretic approaches, including the Kullback–Leibler divergence, the Beta divergence and the Alpha-Beta log-det (AB-LD)divergence. We also revise other approaches based on the idea of selecting those features that are maximally informative about the class labels. The performance of all the methods will be also compared via experiments.

[1]  Chiew Tong Lau,et al.  A New Discriminative Common Spatial Pattern Method for Motor Imagery Brain–Computer Interfaces , 2009, IEEE Transactions on Biomedical Engineering.

[2]  Stephanie Brandl,et al.  Robust common spatial patterns based on Bhattacharyya distance and Gamma divergence , 2015, The 3rd International Winter Conference on Brain-Computer Interface.

[3]  Saeid Sanei,et al.  EEG signal processing , 2000, Clinical Neurophysiology.

[4]  Neri Merhav,et al.  Relations between entropy and error probability , 1994, IEEE Trans. Inf. Theory.

[5]  Clemens Brunner,et al.  Nonstationary Brain Source Separation for Multiclass Motor Imagery , 2010, IEEE Transactions on Biomedical Engineering.

[6]  Haiping Lu,et al.  Regularized common spatial patterns with generic learning for EEG signal classification , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[7]  Bamdev Mishra,et al.  Manopt, a matlab toolbox for optimization on manifolds , 2013, J. Mach. Learn. Res..

[8]  Klaus-Robert Müller,et al.  Tackling noise, artifacts and nonstationarity in BCI with robust divergences , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[9]  Wonzoo Chung,et al.  Common spatial patterns based on generalized norms , 2013, 2013 International Winter Workshop on Brain-Computer Interface (BCI).

[10]  R. Ward,et al.  EMG and EOG artifacts in brain computer interface systems: A survey , 2007, Clinical Neurophysiology.

[11]  Moritz Grosse-Wentrup,et al.  Beamforming in Noninvasive Brain–Computer Interfaces , 2009, IEEE Transactions on Biomedical Engineering.

[12]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[13]  Sergio Cruces,et al.  Optimization of Alpha-Beta Log-Det Divergences and their Application in the Spatial Filtering of Two Class Motor Imagery Movements , 2017, Entropy.

[14]  R Leeb,et al.  Context-aware adaptive spelling in motor imagery BCI , 2016, Journal of neural engineering.

[15]  Cuntai Guan,et al.  Spatially Regularized Common Spatial Patterns for EEG Classification , 2010, 2010 20th International Conference on Pattern Recognition.

[16]  Seungjin Choi,et al.  Composite Common Spatial Pattern for Subject-to-Subject Transfer , 2009, IEEE Signal Processing Letters.

[17]  Klaus-Robert Müller,et al.  Combined Optimization of Spatial and Temporal Filters for Improving Brain-Computer Interfacing , 2006, IEEE Transactions on Biomedical Engineering.

[18]  Motoaki Kawanabe,et al.  Robust Spatial Filtering with Beta Divergence , 2013, NIPS.

[19]  R. Ward,et al.  Robust Common Spatial Patterns for EEG signal preprocessing , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Wei Wu,et al.  Classifying Single-Trial EEG During Motor Imagery by Iterative Spatio-Spectral Patterns Learning (ISSPL) , 2008, IEEE Transactions on Biomedical Engineering.

[21]  Z. Koles,et al.  Spatial patterns in the background EEG underlying mental disease in man. , 1994, Electroencephalography and clinical neurophysiology.

[22]  Qin Tang,et al.  L1-Norm-Based Common Spatial Patterns , 2012, IEEE Transactions on Biomedical Engineering.

[23]  Kaleb McDowell,et al.  Detection and classification of subject-generated artifacts in EEG signals using autoregressive models , 2012, Journal of Neuroscience Methods.

[24]  A. Ossadtchi,et al.  Latent variable method for automatic adaptation to background states in motor imagery BCI. , 2018, Journal of neural engineering.

[25]  Motoaki Kawanabe,et al.  Invariant Common Spatial Patterns: Alleviating Nonstationarities in Brain-Computer Interfacing , 2007, NIPS.

[26]  Emery N. Brown,et al.  A probabilistic framework for learning robust common spatial patterns , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Haixian Wang.  Harmonic Mean of Kullback–Leibler Divergences for Optimizing Multi-Class EEG Spatio-Temporal Filters , 2012, Neural Processing Letters.

[28]  Stefan Geyer,et al.  Imagery of voluntary movement of fingers, toes, and tongue activates corresponding body-part-specific motor representations. , 2003, Journal of neurophysiology.

[29]  Cuntai Guan,et al.  Mutual information-based selection of optimal spatial-temporal patterns for single-trial EEG-based BCIs , 2012, Pattern Recognit..

[30]  Gert Pfurtscheller,et al.  Characterization of four-class motor imagery EEG data for the BCI-competition 2005 , 2005, Journal of neural engineering.

[31]  Alan Edelman,et al.  The Geometry of Algorithms with Orthogonality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[32]  Kevin Warwick,et al.  Automated Artifact Removal From the Electroencephalogram , 2013, Clinical EEG and neuroscience.

[33]  Haixian Wang,et al.  Regularized Filters for L1-Norm-Based Common Spatial Patterns , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[34]  Moritz Grosse-Wentrup,et al.  Multisubject Learning for Common Spatial Patterns in Motor-Imagery BCI , 2011, Comput. Intell. Neurosci..

[35]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[36]  Mark D. Plumbley.  Geometrical methods for non-negative ICA: Manifolds, Lie groups and toral subalgebras , 2005, Neurocomputing.

[37]  Haixian Wang,et al.  Local Temporal Common Spatial Patterns for Robust Single-Trial EEG Classification , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[38]  M. Kawanabe,et al.  Improving BCI Performance by Modified Common Spatial Patterns with Robustly Averaged Covariance Matrices , 2009 .

[39]  Sergio Cruces,et al.  Generalized Alpha-Beta Divergences and Their Application to Robust Nonnegative Matrix Factorization , 2011, Entropy.

[40]  R. Ilmoniemi,et al.  Signal-space projection method for separating MEG or EEG into components , 1997, Medical and Biological Engineering and Computing.

[41]  Fabien Lotte,et al.  A Tutorial on EEG Signal Processing Techniques for Mental State Recognition in Brain-Computer Interfaces , 2014 .

[42]  Motoaki Kawanabe,et al.  Robust Common Spatial Filters with a Maxmin Approach , 2014, Neural Computation.

[43]  Robin Sibson,et al.  What is projection pursuit , 1987 .

[44]  Klaus-Robert Müller,et al.  Increase Information Transfer Rates in BCI by CSP Extension to Multi-class , 2003, NIPS.

[45]  Motoaki Kawanabe,et al.  Divergence-Based Framework for Common Spatial Patterns Algorithms , 2014, IEEE Reviews in Biomedical Engineering.

[46]  Wen Huang,et al.  A Riemannian BFGS Method for Nonconvex Optimization Problems , 2015, ENUMATH.

[47]  Jinglu Hu,et al.  A novel frequency band selection method for Common Spatial Pattern in Motor Imagery based Brain Computer Interface , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[48]  Isabelle Bloch,et al.  Subject-Specific Channel Selection Using Time Information for Motor Imagery Brain–Computer Interfaces , 2016, Cognitive Computation.

[49]  Heung-Il Suk,et al.  A Novel Bayesian Framework for Discriminative Feature Extraction in Brain-Computer Interfaces , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Cuntai Guan,et al.  Optimizing the Channel Selection and Classification Accuracy in EEG-Based BCI , 2011, IEEE Transactions on Biomedical Engineering.

[51]  Nadine Eberhardt,et al.  Bioelectrical Signal Processing In Cardiac And Neurological Applications , 2016 .

[52]  Brendan Z. Allison,et al.  Brain-Computer Interfaces: A Gentle Introduction , 2009 .

[53]  Motoaki Kawanabe,et al.  Improving Classification Performance of BCIs by Using Stationary Common Spatial Patterns and Unsupervised Bias Adaptation , 2011, HAIS.

[54]  Motoaki Kawanabe,et al.  Stationary Common Spatial Patterns: Towards robust classification of non-stationary EEG signals , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[55]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.

[56]  Isabelle Bloch,et al.  Time-frequency optimization for discrimination between imagination of right and left hand movements based on two bipolar electroencephalography channels , 2014, EURASIP Journal on Advances in Signal Processing.

[57]  Moritz Grosse-Wentrup,et al.  Multiclass Common Spatial Patterns and Information Theoretic Feature Extraction , 2008, IEEE Transactions on Biomedical Engineering.

[58]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update , 2018, Journal of neural engineering.

[59]  W. Samek,et al.  Group-wise Stationary Subspace Analysis-A novel method for studying non-stationarities , 2011 .

[60]  Isabelle Bloch,et al.  Automatic selection of the number of spatial filters for motor-imagery BCI , 2012, ESANN.

[61]  Terrence J. Sejnowski,et al.  Enhanced detection of artifacts in EEG data using higher-order statistics and independent component analysis , 2007, NeuroImage.

[62]  Cuntai Guan,et al.  Learning from other subjects helps reducing Brain-Computer Interface calibration time , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[63]  Cuntai Guan,et al.  Optimizing Spatial Filters by Minimizing Within-Class Dissimilarities in Electroencephalogram-Based Brain–Computer Interface , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[64]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[65]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[66]  Cleve B. Moler,et al.  Nineteen Dubious Ways to Compute the Exponential of a Matrix, Twenty-Five Years Later , 1978, SIAM Rev..

[67]  Begoña Garcia-Zapirain,et al.  EEG artifact removal—state-of-the-art and guidelines , 2015, Journal of neural engineering.

[68]  Motoaki Kawanabe,et al.  Stationary common spatial patterns for brain–computer interfacing , 2012, Journal of neural engineering.

[69]  Wojciech Samek,et al.  Transferring Subspaces Between Subjects in Brain--Computer Interfacing , 2012, IEEE Transactions on Biomedical Engineering.

[70]  Isabelle Bloch,et al.  Subject-specific time-frequency selection for multi-class motor imagery-based BCIs using few Laplacian EEG channels , 2017, Biomed. Signal Process. Control..

[71]  Seungjin Choi,et al.  Probabilistic Models for Common Spatial Patterns: Parameter-Expanded EM and Variational Bayes , 2012, AAAI.