Optimized Motor Imagery Paradigm Based on Imagining Chinese Characters Writing Movement

Background: motor imagery (MI) is a mental representation of motor behavior. The MI-based brain computer interfaces (BCIs) can provide communication for the physically impaired. The performance of MI-based BCI mainly depends on the subject’s ability to self-modulate electroencephalogram signals. Proper training can help naive subjects learn to modulate brain activity proficiently. However, training subjects typically involve abstract motor tasks and are time-consuming. Methods: to improve the performance of naive subjects during motor imagery, a novel paradigm was presented that would guide naive subjects to modulate brain activity effectively. In this new paradigm, pictures of the left or right hand were used as cues for subjects to finish the motor imagery task. Fourteen healthy subjects (11 male, aged 22–25 years, and mean 23.6±1.16) participated in this study. The task was to imagine writing a Chinese character. Specifically, subjects could imagine hand movements corresponding to the sequence of writing strokes in the Chinese character. This paradigm was meant to find an effective and familiar action for most Chinese people, to provide them with a specific, extensively practiced task and help them modulate brain activity. Results: results showed that the writing task paradigm yielded significantly better performance than the traditional arrow paradigm (p < 0.001). Questionnaire replies indicated that most subjects thought that the new paradigm was easier. Conclusion: the proposed new motor imagery paradigm could guide subjects to help them modulate brain activity effectively. Results showed that there were significant improvements using new paradigm, both in classification accuracy and usability.

[1]  Klaus-Robert Müller,et al.  Spatio-spectral filters for improving the classification of single trial EEG , 2005, IEEE Transactions on Biomedical Engineering.

[2]  G. Pfurtscheller,et al.  Event-related synchronization (ERS) in the alpha band--an electrophysiological correlate of cortical idling: a review. , 1996, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[3]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[4]  Cuntai Guan,et al.  Robust filter bank common spatial pattern (RFBCSP) in motor-imagery-based brain-computer interface , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  J. Mattingley,et al.  Is the mirror neuron system involved in imitation? A short review and meta-analysis , 2009, Neuroscience & Biobehavioral Reviews.

[6]  Klaus-Robert Müller,et al.  The non-invasive Berlin Brain–Computer Interface: Fast acquisition of effective performance in untrained subjects , 2007, NeuroImage.

[7]  Martin Wolf,et al.  Single-trial classification of motor imagery differing in task complexity: a functional near-infrared spectroscopy study , 2011, Journal of NeuroEngineering and Rehabilitation.

[8]  Christa Neuper,et al.  Viewing Moving Objects in Virtual Reality Can Change the Dynamics of Sensorimotor EEG Rhythms , 2007, PRESENCE: Teleoperators and Virtual Environments.

[9]  J R Wolpaw,et al.  EEG-based communication and control: short-term role of feedback. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[10]  Adrian M. Owen,et al.  Complexity and familiarity enhance single-trial detectability of imagined movements with electroencephalography , 2014, Clinical Neurophysiology.

[11]  Yongyi Yang,et al.  Improving SVM classifier with prior knowledge in microcalcification detection1 , 2012, 2012 19th IEEE International Conference on Image Processing.

[12]  R. Hari.  Action-perception connection and the cortical mu rhythm. , 2006, Progress in brain research.

[13]  Klaus-Robert Müller,et al.  Neurophysiological predictor of SMR-based BCI performance , 2010, NeuroImage.

[14]  Manuel Rodriguez,et al.  Mu-rhythm changes during the planning of motor and motor imagery actions , 2013, Neuropsychologia.

[15]  Xingyu Wang,et al.  An adaptive P300-based control system , 2011, Journal of neural engineering.

[16]  Yuanqing Li,et al.  Classifying Motor Imagery EEG Signals by Iterative Channel Elimination according to Compound Weight , 2010, AICI.

[17]  Liqing Zhang,et al.  A Boosting-Based Spatial-Spectral Model for Stroke Patients’ EEG Analysis in Rehabilitation Training , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Andrea Petracca,et al.  A Classification Algorithm for Electroencephalography Signals by Self-Induced Emotional Stimuli , 2016, IEEE Transactions on Cybernetics.

[19]  G Pfurtscheller,et al.  Frequency component selection for an EEG-based brain to computer interface. , 1999, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[20]  C.W. Anderson,et al.  Comparison of linear, nonlinear, and feature selection methods for EEG signal classification , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Wei Wu,et al.  Multimodal BCIs: Target Detection, Multidimensional Control, and Awareness Evaluation in Patients With Disorder of Consciousness , 2016, Proceedings of the IEEE.

[22]  A. Cichocki,et al.  An optimized ERP brain–computer interface based on facial expression changes , 2014, Journal of neural engineering.

[23]  Klaus-Robert Müller,et al.  Machine Learning and Applications for Brain-Computer Interfacing , 2007, HCI.

[24]  Xingyu Wang,et al.  Optimized stimulus presentation patterns for an event-related potential EEG-based brain–computer interface , 2011, Medical & Biological Engineering & Computing.

[25]  Dewen Hu,et al.  Balancing a simulated inverted pendulum through motor imagery: An EEG-based real-time control paradigm , 2012, Neuroscience Letters.

[26]  Klaus-Robert Müller,et al.  Combined Optimization of Spatial and Temporal Filters for Improving Brain-Computer Interfacing , 2006, IEEE Transactions on Biomedical Engineering.

[27]  I. Zijdewind,et al.  Corticospinal excitability during observation and imagery of simple and complex hand tasks: Implications for motor rehabilitation , 2010, Behavioural Brain Research.

[28]  Xiaorong Gao,et al.  Exploring steady-state visual evoked potentials as an index for intermodal and crossmodal spatial attention. , 2011, Psychophysiology.

[29]  J. W. Kuhlman,et al.  EEG feedback training: enhancement of somatosensory cortical activity. , 1978, Electroencephalography and clinical neurophysiology.

[30]  G Pfurtscheller,et al.  Graphical display and statistical evaluation of event-related desynchronization (ERD). , 1977, Electroencephalography and clinical neurophysiology.

[31]  J. Wolpaw,et al.  Towards an independent brain–computer interface using steady state visual evoked potentials , 2008, Clinical Neurophysiology.

[32]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[33]  Rui Zhang,et al.  Enhanced Motor Imagery Training Using a Hybrid BCI With Feedback , 2015, IEEE Transactions on Biomedical Engineering.

[34]  B. Allison,et al.  The effects of self-movement, observation, and imagination on mu rhythms and readiness potentials (RP's): toward a brain-computer interface (BCI). , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[35]  Yu Zhang,et al.  Analysis and classification of speech imagery EEG for BCI , 2013, Biomed. Signal Process. Control..

[36]  Kyuwan Choi,et al.  Electroencephalography (EEG)-based neurofeedback training for brain–computer interface (BCI) , 2013, Experimental Brain Research.

[37]  Reza Boostani,et al.  An efficient hybrid linear and kernel CSP approach for EEG feature extraction , 2009, Neurocomputing.

[38]  Ruimin Wang,et al.  Classification of Four-Class Motor Imagery Employing Single-Channel Electroencephalography , 2014, PloS one.

[39]  Jing Luo,et al.  Sport expert's motor imagery: Functional imaging of professional motor skills and simple motor skills , 2010, Brain Research.

[40]  J. Pineda.  The functional significance of mu rhythms: Translating “seeing” and “hearing” into “doing” , 2005, Brain Research Reviews.

[41]  Hung T. Nguyen,et al.  Discrimination of left and right leg motor imagery for brain–computer interfaces , 2010, Medical & Biological Engineering & Computing.

[42]  Klaus-Robert Müller,et al.  The Berlin Brain-Computer Interface: Accurate performance from first-session in BCI-naive subjects , 2008, IEEE Transactions on Biomedical Engineering.

[43]  Ping Xue,et al.  Sub-band Common Spatial Pattern (SBCSP) for Brain-Computer Interface , 2007, 2007 3rd International IEEE/EMBS Conference on Neural Engineering.

[44]  Jie Li,et al.  A neurofeedback training paradigm for motor imagery based Brain-Computer Interface , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[45]  G. Pfurtscheller,et al.  Motor imagery and action observation: Modulation of sensorimotor brain rhythms during mental control of a brain–computer interface , 2009, Clinical Neurophysiology.

[46]  Bernhard Schölkopf,et al.  Support vector channel selection in BCI , 2004, IEEE Transactions on Biomedical Engineering.

[47]  Anton Nijholt,et al.  How Much Control Is Enough? Influence of Unreliable Input on User Experience , 2013, IEEE Transactions on Cybernetics.

[48]  H. Siebner,et al.  Effector‐independent representations of simple and complex imagined finger movements: a combined fMRI and TMS study , 2003, The European journal of neuroscience.

[49]  A. Kübler,et al.  Face stimuli effectively prevent brain–computer interface inefficiency in patients with neurodegenerative disease , 2013, Clinical Neurophysiology.

[50]  Gerwin Schalk,et al.  Dynamics of electrocorticographic (ECoG) activity in human temporal and frontal cortical areas during music listening , 2012, NeuroImage.

[51]  Toshiyuki Kondo,et al.  Effect of instructive visual stimuli on neurofeedback training for motor imagery-based brain-computer interface. , 2015, Human movement science.

[52]  G. Pfurtscheller,et al.  Imagery of motor actions: differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG. , 2005, Brain research. Cognitive brain research.

[53]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[54]  J. Wolpaw,et al.  Clinical Applications of Brain-Computer Interfaces: Current State and Future Prospects , 2009, IEEE Reviews in Biomedical Engineering.

[55]  Xingyu Wang,et al.  A P300 Brain-Computer Interface Based on a Modification of the Mismatch Negativity Paradigm , 2015, Int. J. Neural Syst..

[56]  Lin Zhang,et al.  An FDES-Based Shared Control Method for Asynchronous Brain-Actuated Robot , 2016, IEEE Transactions on Cybernetics.

[57]  Girijesh Prasad,et al.  Is Sensorimotor BCI Performance Influenced Differently by Mono, Stereo, or 3-D Auditory Feedback? , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[58]  G. Pfurtscheller,et al.  How many people are able to operate an EEG-based brain-computer interface (BCI)? , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[59]  Yuanqing Li,et al.  Control of a Wheelchair in an Indoor Environment Based on a Brain–Computer Interface and Automated Navigation , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[60]  A. Al-Ani,et al.  Effect of Feature and Channel Selection on EEG Classification , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[61]  G. Schalk,et al.  Decoding vowels and consonants in spoken and imagined words using electrocorticographic signals in humans , 2011, Journal of neural engineering.

[62]  G. Pfurtscheller.  Event-related synchronization (ERS): an electrophysiological correlate of cortical areas at rest. , 1992, Electroencephalography and Clinical Neurophysiology.

[63]  Cheolsoo Park,et al.  Classification of Motor Imagery BCI Using Multivariate Empirical Mode Decomposition , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[64]  J. Wolpaw,et al.  Brain-computer communication: unlocking the locked in. , 2001, Psychological bulletin.

[65]  Jonathan R Wolpaw,et al.  Brain–computer interface systems: progress and prospects , 2007, Expert review of medical devices.

[66]  Tzyy-Ping Jung,et al.  High-speed spelling with a noninvasive brain–computer interface , 2015, Proceedings of the National Academy of Sciences.

[67]  T. Martin McGinnity,et al.  Faster Self-Organizing Fuzzy Neural Network Training and a Hyperparameter Analysis for a Brain–Computer Interface , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[68]  Chong Liu,et al.  Classification of ECoG motor imagery tasks based on CSP and SVM , 2010, 2010 3rd International Conference on Biomedical Engineering and Informatics.

[69]  G. Pfurtscheller,et al.  EEG-based discrimination between imagination of right and left hand movement. , 1997, Electroencephalography and clinical neurophysiology.

[70]  Klaus-Robert Müller,et al.  Machine learning for real-time single-trial EEG-analysis: From brain–computer interfacing to mental state monitoring , 2008, Journal of Neuroscience Methods.