Closing the sensorimotor loop: Haptic feedback facilitates decoding of arm movement imagery

Brain-Computer Interfaces (BCIs) in combination with robot-assisted physical therapy may become a valuable tool for neurorehabilitation of patients with severe hemiparetic syndromes due to cerebrovascular brain damage (stroke) and other neurological conditions. A key aspect of this approach is reestablishing the disrupted sensorimotor feedback loop, i.e., determining the intended movement using a BCI and helping a human with impaired motor function to move the arm using a robot. It has not been studied yet, however, how artificially closing the sensorimotor feedback loop affects the BCI decoding performance. In this article, we investigate this issue in six healthy subjects, and present evidence that haptic feedback facilitates the decoding of arm movement intention. The results provide evidence of the feasibility of future rehabilitative efforts combining robot-assisted physical therapy with BCIs. Moreover, the results suggest that shared-control strategies in Brain-Machine Interfaces (BMIs) may benefit from haptic feedback.

[1]  G. Pfurtscheller,et al.  Event-related beta EEG-changes during passive and attempted foot movements in paraplegic patients , 2007, Brain Research.

[2]  J. A. Wilson,et al.  Two-dimensional movement control using electrocorticographic signals in humans , 2008, Journal of neural engineering.

[3]  C. Braun,et al.  Hand Movement Direction Decoded from MEG and EEG , 2008, The Journal of Neuroscience.

[4]  H. C. Dijkerman,et al.  Does motor imagery training improve hand function in chronic stroke patients? A pilot study , 2004, Clinical rehabilitation.

[5]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[6]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[7]  Moritz Grosse-Wentrup,et al.  Beamforming in Noninvasive Brain–Computer Interfaces , 2009, IEEE Transactions on Biomedical Engineering.

[8]  A. Tamhane,et al.  Multiple Comparison Procedures , 2009 .

[9]  T. Murphy,et al.  Plasticity during stroke recovery: from synapse to behaviour , 2009, Nature Reviews Neuroscience.

[10]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[11]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[12]  D. Wolfe,et al.  Nonparametric Statistical Methods. , 1974 .

[13]  Lalit Kalra,et al.  Stroke rehabilitation 2009: old chestnuts and new insights. , 2010, Stroke.

[14]  Kazuo Tanaka,et al.  Electroencephalogram-based control of an electric wheelchair , 2005, IEEE Transactions on Robotics.

[15]  S. Halder,et al.  Proprioceptive feedback in BCI , 2009, 2009 4th International IEEE/EMBS Conference on Neural Engineering.

[16]  G. R. Muller,et al.  Event-related beta EEG changes during wrist movements induced by functional electrical stimulation of forearm muscles in man , 2003, Neuroscience Letters.

[17]  G. Pfurtscheller,et al.  EEG-based discrimination between imagination of right and left hand movement. , 1997, Electroencephalography and clinical neurophysiology.

[18]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[19]  Andreas Schulze-Bonhage,et al.  Prediction of arm movement trajectories from ECoG-recordings in humans , 2008, Journal of Neuroscience Methods.

[20]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[21]  J R Wolpaw,et al.  Spatial filter selection for EEG-based communication. , 1997, Electroencephalography and clinical neurophysiology.

[22]  S. Page,et al.  Mental Practice in Chronic Stroke: Results of a Randomized, Placebo-Controlled Trial , 2007, Stroke.

[23]  A. Tamhane,et al.  Multiple Comparison Procedures , 1989 .

[24]  J. Wolpaw,et al.  Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface , 2005, Neurology.

[25]  Ethan R. Buch,et al.  Think to Move: a Neuromagnetic Brain-Computer Interface (BCI) System for Chronic Stroke , 2008, Stroke.

[26]  Monica A. Perez,et al.  Neural interface technology for rehabilitation: exploiting and promoting neuroplasticity. , 2010, Physical medicine and rehabilitation clinics of North America.

[27]  J. Wolpaw,et al.  Brain–computer interfaces in neurological rehabilitation , 2008, The Lancet Neurology.

[28]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[29]  José del R. Millán,et al.  Noninvasive brain-actuated control of a mobile robot by human EEG , 2004, IEEE Transactions on Biomedical Engineering.

[30]  Robert Riener,et al.  Robot-aided neurorehabilitation of the upper extremities , 2005, Medical and Biological Engineering and Computing.

[31]  G. Kwakkel,et al.  The impact of physical therapy on functional outcomes after stroke: what's the evidence? , 2004, Clinical rehabilitation.

[32]  Rajesh P. N. Rao,et al.  Generalized Features for Electrocorticographic BCIs , 2008, IEEE Transactions on Biomedical Engineering.