Enhanced Motor Imagery Training Using a Hybrid BCI With Feedback

Goal: Motor imagery-related mu/beta rhythms, which can be voluntarily modulated by subjects, have been widely used in EEG-based brain computer interfaces (BCIs). Moreover, it has been suggested that motor imagery-specific EEG differences can be enhanced by feedback training. However, the differences observed in the EEGs of naive subjects are typically not sufficient to provide reliable EEG control and thus result in unintended feedback. Such feedback can frustrate subjects and impede training. In this study, a hybrid BCI paradigm combining motor imagery and steady-state visually evoked potentials (SSVEPs) has been proposed to provide effective continuous feedback for motor imagery training. Methods: During the initial training sessions, subjects must focus on flickering buttons to evoke SSVEPs as they perform motor imagery tasks. The output/feedback of the hybrid BCI is based on hybrid features consisting of motor imagery- and SSVEP-related brain signals. In this context, the SSVEP plays a more important role than motor imagery in generating feedback. As the training progresses, the subjects can gradually decrease their visual attention to the flickering buttons, provided that the feedback is still effective. In this case, the feedback is mainly based on motor imagery. Results: Our experimental results demonstrate that subjects generate distinguishable brain patterns of hand motor imagery after only five training sessions lasting approximately 1.5 h each. Conclusion: The proposed hybrid feedback paradigm can be used to enhance motor imagery training. Significance: This hybrid BCI system with feedback can effectively identify the intentions of the subjects.

[1]  J.D. Bayliss,et al.  Use of the evoked potential P3 component for control in a virtual apartment , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[2]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Jun Lu,et al.  Adaptive Spatio-Temporal Filtering for Movement Related Potentials in EEG-Based Brain–Computer Interfaces , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  G. Pfurtscheller,et al.  How many people are able to operate an EEG-based brain-computer interface (BCI)? , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Vera Kaiser,et al.  First Steps Toward a Motor Imagery Based Stroke BCI: New Strategy to Set up a Classifier , 2011, Front. Neurosci..

[6]  D.J. McFarland,et al.  Sensorimotor rhythm-based brain-computer interface (BCI): feature selection by regression improves performance , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Klaus-Robert Müller,et al.  Neurophysiological predictor of SMR-based BCI performance , 2010, NeuroImage.

[8]  G Pfurtscheller,et al.  Current trends in Graz Brain-Computer Interface (BCI) research. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[9]  Yuanqing Li,et al.  Joint feature re-extraction and classification using an iterative semi-supervised support vector machine algorithm , 2008, Machine Learning.

[10]  Stefan Haufe,et al.  On the interpretation of weight vectors of linear models in multivariate neuroimaging , 2014, NeuroImage.

[11]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[12]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[13]  Yuanqing Li,et al.  An EEG-Based BCI System for 2-D Cursor Control by Combining Mu/Beta Rhythm and P300 Potential , 2010, IEEE Transactions on Biomedical Engineering.

[14]  Reinhold Scherer,et al.  Study of On-Line Adaptive Discriminant Analysis for EEG-Based Brain Computer Interfaces , 2007, IEEE Transactions on Biomedical Engineering.

[15]  Cuntai Guan,et al.  Learning from feedback training data at a self-paced brain–computer interface , 2011, Journal of neural engineering.

[16]  J. Decety.  The neurophysiological basis of motor imagery , 1996, Behavioural Brain Research.

[17]  Jun Lu,et al.  Adaptive Laplacian filtering for sensorimotor rhythm-based brain–computer interfaces , 2013, Journal of neural engineering.

[18]  K. Lafleur,et al.  Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain–computer interface , 2013, Journal of neural engineering.

[19]  Shangkai Gao,et al.  A practical VEP-based brain-computer interface. , 2006, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[20]  A. Doud,et al.  Continuous Three-Dimensional Control of a Virtual Helicopter Using a Motor Imagery Based Brain-Computer Interface , 2011, PloS one.

[21]  G. Pfurtscheller,et al.  Enhancement of left-right sensorimotor EEG differences during feedback-regulated motor imagery. , 1999, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[22]  G. Pfurtscheller,et al.  Imagery of motor actions: differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG. , 2005, Brain research. Cognitive brain research.

[23]  Klaus-Robert Müller,et al.  The Berlin Brain-Computer Interface: Accurate performance from first-session in BCI-naive subjects , 2008, IEEE Transactions on Biomedical Engineering.

[24]  Jonathan R. Wolpaw,et al.  Brain-computer interfaces (BCIs) for communication and control , 2007, Assets '07.

[25]  Bin He,et al.  Brain–Computer Interfaces Using Sensorimotor Rhythms: Current State and Future Perspectives , 2014, IEEE Transactions on Biomedical Engineering.

[26]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[27]  J. Ushiba,et al.  Daily training with realistic visual feedback improves reproducibility of event-related desynchronisation following hand motor imagery , 2013, Clinical Neurophysiology.

[28]  P. Husar,et al.  A periodogram-based method for the detection of steady-state visually evoked potentials , 1998, IEEE Transactions on Biomedical Engineering.

[29]  Han-Jeong Hwang,et al.  Neurofeedback-based motor imagery training for brain–computer interface (BCI) , 2009, Journal of Neuroscience Methods.

[30]  Xiaorong Gao,et al.  Design and implementation of a brain-computer interface with high transfer rates , 2002, IEEE Transactions on Biomedical Engineering.

[31]  Xiaorong Gao,et al.  An online multi-channel SSVEP-based brain–computer interface using a canonical correlation analysis method , 2009, Journal of neural engineering.

[32]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[33]  Wei Wu,et al.  Frequency Recognition Based on Canonical Correlation Analysis for SSVEP-Based BCIs , 2006, IEEE Transactions on Biomedical Engineering.

[34]  J R Wolpaw,et al.  EEG-based communication and control: short-term role of feedback. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.