Toward an Open-Ended BCI: A User-Centered Coadaptive Design

Brain-computer interfaces (BCIs) allow users to control a device by interpreting their brain activity. For simplicity, these devices are designed to be operated by purposefully modulating specific predetermined neurophysiological signals, such as the sensorimotor rhythm. However, the ability to modulate a given neurophysiological signal is highly variable across individuals, contributing to the inconsistent performance of BCIs for different users. These differences suggest that individuals who experience poor BCI performance with one class of brain signals might have good results with another. In order to take advantage of individual abilities as they relate to BCI control, we need to move beyond the current approaches. In this letter, we explore a new BCI design aimed at a more individualized and user-focused experience, which we call open-ended BCI. Individual users were given the freedom to discover their own mental strategies as opposed to being trained to modulate a given brain signal. They then underwent multiple coadaptive training sessions with the BCI. Our first open-ended BCI performed similarly to comparable BCIs while accommodating a wider variety of mental strategies without a priori knowledge of the specific brain signals any individual might use. Post hoc analysis revealed individual differences in terms of which sensory modality yielded optimal performance. We found a large and significant effect of individual differences in background training and expertise, such as in musical training, on BCI performance. Future research should be focused on finding more generalized solutions to user training and brain state decoding methods to fully utilize the abilities of different individuals in an open-ended BCI. Accounting for each individual's areas of expertise could have important implications on BCI training and BCI application design.

[1]  Jane Labadin,et al.  Feature selection based on mutual information , 2015, 2015 9th International Conference on IT in Asia (CITA).

[2]  Afsheen Afshar,et al.  Free-paced high-performance brain-computer interfaces. , 2007, Journal of neural engineering.

[3]  K. Müller,et al.  Psychological predictors of SMR-BCI performance , 2012, Biological Psychology.

[4]  Chih-Jen Lin,et al.  Probability Estimates for Multi-class Classification by Pairwise Coupling , 2003, J. Mach. Learn. Res..

[5]  Thierry Dutoit,et al.  Performance of the Emotiv Epoc headset for P300-based applications , 2013, Biomedical engineering online.

[6]  Melody Moore Jackson,et al.  Individual Characteristics and Their Effect on Predicting Mu Rhythm Modulation , 2010, Int. J. Hum. Comput. Interact..

[7]  Sebastian Stober,et al.  Deep Feature Learning for EEG Recordings , 2015, ArXiv.

[8]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[9]  C. Neuper,et al.  The effect of distinct mental strategies on classification performance for brain-computer interfaces. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[10]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[11]  N. Birbaumer,et al.  Brain-computer communication: self-regulation of slow cortical potentials for verbal communication. , 2001, Archives of physical medicine and rehabilitation.

[12]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[13]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[14]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[15]  Christian Mühl,et al.  Flaws in current human training protocols for spontaneous Brain-Computer Interfaces: lessons learned from instructional design , 2013, Front. Hum. Neurosci..

[16]  Boris Reuderink,et al.  Robustness of the Common Spatial Patterns algorithm in the BCI-pipeline , 2008 .

[17]  David B. Grayden,et al.  A Generalizable Brain-Computer Interface (BCI) Using Machine Learning for Feature Discovery , 2015, PloS one.

[18]  José del R. Millán,et al.  An Introduction to Brain-Computer Interfacing , 2007 .

[19]  B. Allison,et al.  BCI Demographics: How Many (and What Kinds of) People Can Use an SSVEP BCI? , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Sriram Subramanian,et al.  Predicting Mental Imagery-Based BCI Performance from Personality, Cognitive Profile and Neurophysiological Patterns , 2015, PloS one.

[21]  José del R. Millán,et al.  BNCI Horizon 2020: Towards a Roadmap for the BCI Community , 2015 .

[22]  Kim Dremstrup,et al.  Auditory and spatial navigation imagery in Brain–Computer Interface using optimized wavelets , 2008, Journal of Neuroscience Methods.

[23]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[24]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[25]  Gary E. Birch,et al.  A brain-controlled switch for asynchronous control applications , 2000, IEEE Trans. Biomed. Eng..

[26]  G. McArthur,et al.  Validation of the Emotiv EPOC® EEG gaming system for measuring research quality auditory ERPs , 2013, PeerJ.

[27]  Aleksandra Vuckovic,et al.  Using a motor imagery questionnaire to estimate the performance of a Brain–Computer Interface based on object oriented motor imagery , 2013, Clinical Neurophysiology.

[28]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[29]  Christa Neuper,et al.  Neurofeedback Training for BCI Control , 2009 .

[30]  J. Zygierewicz,et al.  Asynchronous BCI Based on Motor Imagery With Automated Calibration and Neurofeedback Training , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  J. Pineda,et al.  Learning to control brain rhythms: making a brain-computer interface possible , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  J. Mourino,et al.  Asynchronous BCI and local neural classifiers: an overview of the adaptive brain interface project , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  Chih-Jen Lin,et al.  Simple Probabilistic Predictions for Support Vector Regression , 2004 .

[34]  Brendan Z. Allison,et al.  Could Anyone Use a BCI? , 2010, Brain-Computer Interfaces.

[35]  Klaus-Robert Müller,et al.  Neurophysiological predictor of SMR-based BCI performance , 2010, NeuroImage.

[36]  David Ewins,et al.  The Emotiv EPOC neuroheadset: an inexpensive method of controlling assistive technologies using facial expressions and thoughts? , 2011 .

[37]  Klaus-Robert Müller,et al.  Covariate Shift Adaptation by Importance Weighted Cross Validation , 2007, J. Mach. Learn. Res..

[38]  Stefan Haufe,et al.  On the interpretation of weight vectors of linear models in multivariate neuroimaging , 2014, NeuroImage.

[39]  K. Müller,et al.  Finding stationary subspaces in multivariate time series. , 2009, Physical review letters.

[40]  Benjamin Blankertz,et al.  Common spatial pattern patches - An optimized filter ensemble for adaptive brain-computer interfaces , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[41]  Makoto Sato,et al.  Single-trial classification of vowel speech imagery using common spatial patterns , 2009, Neural Networks.

[42]  Gernot R. Müller-Putz,et al.  Individually Adapted Imagery Improves Brain-Computer Interface Performance in End-Users with Disability , 2015, PloS one.

[43]  Scott Makeig,et al.  Emotion Recognition from EEG during Self-Paced Emotional Imagery , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[44]  Stefan Haufe,et al.  Single-trial analysis and classification of ERP components — A tutorial , 2011, NeuroImage.

[45]  A. Frolov,et al.  Brain-Computer Interface Based on Generation of Visual Images , 2011, PloS one.

[46]  Gary E. Birch,et al.  Brain-computer interface design for asynchronous control applications: improvements to the LF-ASD asynchronous brain switch , 2004, IEEE Transactions on Biomedical Engineering.

[47]  Feng Wan,et al.  Implementation of SSVEP based BCI with Emotiv EPOC , 2012, 2012 IEEE International Conference on Virtual Environments Human-Computer Interfaces and Measurement Systems (VECIMS) Proceedings.

[48]  Klaus-Robert Müller,et al.  Co-adaptive calibration to improve BCI efficiency , 2011, Journal of neural engineering.

[49]  Maureen Clerc,et al.  An analysis of performance evaluation for motor-imagery based BCI , 2013, Journal of neural engineering.

[50]  R. Palaniappan,et al.  Classification of Mental Tasks Using Fixed and Adaptive Autoregressive Models of EEG Signals , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[51]  Klaus-Robert Muller,et al.  Finding stationary brain sources in EEG data , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[52]  F. Carrino,et al.  A self-paced BCI system to control an electric wheelchair: Evaluation of a commercial, low-cost EEG device , 2012, 2012 ISSNIP Biosignals and Biorobotics Conference: Biosignals and Robotics for Better and Safer Living (BRC).

[53]  G. Pfurtscheller,et al.  Designing optimal spatial filters for single-trial EEG classification in a movement task , 1999, Clinical Neurophysiology.

[54]  Suzanna Becker,et al.  A Brain-Computer Interface Based on Abstract Visual and Auditory Imagery: Evidence for an Effect of Artistic Training , 2017, HCI.

[55]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[56]  Hsuan-Tien Lin,et al.  A note on Platt’s probabilistic outputs for support vector machines , 2007, Machine Learning.

[57]  Pablo F. Diez,et al.  Asynchronous BCI control using high-frequency SSVEP , 2011, Journal of NeuroEngineering and Rehabilitation.

[58]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[59]  Adriane B. Randolph Not All Created Equal: Individual-Technology Fit of Brain-Computer Interfaces , 2012, 2012 45th Hawaii International Conference on System Sciences.

[60]  Jukka Heikkonen,et al.  A local neural classifier for the recognition of EEG patterns associated to mental tasks , 2002, IEEE Trans. Neural Networks.

[61]  Klaus-Robert Müller,et al.  Machine-Learning-Based Coadaptive Calibration for Brain-Computer Interfaces , 2011, Neural Computation.