Neuronal ensemble control of prosthetic devices by a human with tetraplegia

Neuromotor prostheses (NMPs) aim to replace or restore lost motor functions in paralysed humans by routeing movement-related signals from the brain, around damaged parts of the nervous system, to external effectors. To translate preclinical results from intact animals to a clinically useful NMP, movement signals must persist in cortex after spinal cord injury and be engaged by movement intent when sensory inputs and limb movement are long absent. Furthermore, NMPs would require that intention-driven neuronal activity be converted into a control signal that enables useful tasks. Here we show initial results for a tetraplegic human (MN) using a pilot NMP. Neuronal ensemble activity recorded through a 96-microelectrode array implanted in primary motor cortex demonstrated that intended hand motion modulates cortical spiking patterns three years after spinal cord injury. Decoders were created, providing a ‘neural cursor’ with which MN opened simulated e-mail and operated devices such as a television, even while conversing. Furthermore, MN used neural control to open and close a prosthetic hand, and perform rudimentary actions with a multi-jointed robotic arm. These early results suggest that NMPs based upon intracortical neuronal ensemble spiking activity could provide a valuable new neurotechnology to restore independence for humans with paralysis.

[1]  W. D. Halliburton,et al.  Handbook of Physiology , 1870, Edinburgh Medical Journal.

[2]  F. Plum.  Handbook of Physiology. , 1960 .

[3]  D R Humphrey,et al.  Predicting Measures of Motor Performance from Multiple Cortical Spike Trains , 1970, Science.

[4]  E. Fetz,et al.  Operant Conditioning of Specific Patterns of Neural and Muscular Activity , 1971, Science.

[5]  E. Fetz,et al.  Operantly conditioned patterns on precentral unit activity and correlated responses in adjacent cells and contralateral muscles. , 1973, Journal of neurophysiology.

[6]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[7]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[8]  KM Jacobs,et al.  Reshaping the cortical motor map by unmasking latent intracortical connections , 1991, Science.

[9]  D. Humphrey,et al.  Motor control : concepts and issues , 1991 .

[10]  R. Waters,et al.  International Standards for Neurological and Functional Classification of Spinal Cord Injury , 1997, Spinal Cord.

[11]  R A Normann,et al.  The Utah intracortical Electrode Array: a recording structure for potential brain-computer interfaces. , 1997, Electroencephalography and clinical neurophysiology.

[12]  Graham H. Creasey,et al.  International Standards for Neurological and Functional Classification of Spinal Cord Injury. American Spinal Injury Association. , 1997 .

[13]  H. Alkadhi,et al.  Localization of the motor hand area to a knob on the precentral gyrus. A new landmark. , 1997, Brain : a journal of neurology.

[14]  L. Wiart,et al.  Clinical and functional evaluation of a gaze controlled system for the severely handicapped , 1998, Spinal Cord.

[15]  P. Kennedy,et al.  Restoration of neural output from a paralyzed patient by a direct brain connection , 1998, Neuroreport.

[16]  J. Donoghue,et al.  Neural discharge and local field potential oscillations in primate motor cortex during voluntary movements. , 1998, Journal of neurophysiology.

[17]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[18]  M. Erb,et al.  Reorganization in the primary motor cortex after spinal cord injury - A functional Magnetic Resonance (fMRI) study. , 1999, Restorative neurology and neuroscience.

[19]  K. S Guillory,et al.  A 100-channel system for real time detection and storage of extracellular spike waveforms , 1999, Journal of Neuroscience Methods.

[20]  J. Donoghue,et al.  Gaze Direction Modulates Finger Movement Activation Patterns in Human Cerebral Cortex , 1999, The Journal of Neuroscience.

[21]  J. Donoghue,et al.  Plasticity and primary motor cortex. , 2000, Annual review of neuroscience.

[22]  E. Bizzi,et al.  Cortical correlates of learning in monkeys adapting to a new dynamical environment. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[23]  P R Kennedy,et al.  Direct control of a computer from the human central nervous system. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[24]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[25]  E. Halgren,et al.  Motor-cortical activity in tetraplegics , 2001, Nature.

[26]  Dawn M. Taylor,et al.  Extraction algorithms for cortical control of arm prosthetics , 2001, Current Opinion in Neurobiology.

[27]  P Sabbah,et al.  Sensorimotor cortical activity in patients with complete spinal cord injury: a functional magnetic resonance imaging study. , 2002, Journal of neurotrauma.

[28]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[29]  W. McIlroy,et al.  Adaptation in the motor cortex following cervical spinal cord injury , 2002, Neurology.

[30]  S. Meagher.  Instant neural control of a movement signal , 2002 .

[31]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[32]  William Z Rymer,et al.  Guest Editorial Brain–Computer Interface Technology: A Review of the Second International Meeting , 2001 .

[33]  Melody Moore,et al.  Using human extra-cortical local field potentials to control a switch. , 2004, Journal of neural engineering.

[34]  Michael J. Black,et al.  Modeling and decoding motor cortical activity using a switching Kalman filter , 2004, IEEE Transactions on Biomedical Engineering.

[35]  Andrew B Schwartz,et al.  Cortical neural prosthetics. , 2004, Annual review of neuroscience.

[36]  A. Jackson,et al.  A demographic profile of new traumatic spinal cord injuries: change and stability over 30 years. , 2004, Archives of physical medicine and rehabilitation.

[37]  Jaimie F Borisoff,et al.  Real-Time Control of a Video Game With a Direct Brain–Computer Interface , 2004, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[38]  P.R. Kennedy,et al.  Computer control using human intracortical local field potentials , 2004, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[40]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[41]  Bernhard Graimann,et al.  Toward a direct brain interface based on human subdural recordings and wavelet-packet analysis , 2004, IEEE Transactions on Biomedical Engineering.

[42]  L. Paninski,et al.  Spatiotemporal tuning of motor cortical neurons for hand position and velocity. , 2004, Journal of neurophysiology.

[43]  G. Pfurtscheller,et al.  EEG-based neuroprosthesis control: A step towards clinical practice , 2005, Neuroscience Letters.

[44]  J.P. Donoghue,et al.  Reliability of signals from a chronically implanted, silicon-based electrode array in non-human primate primary motor cortex , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[45]  J. Si,et al.  Closed-loop cortical control of direction using support vector machines , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[46]  R. Normann,et al.  A method for pneumatically inserting an array of penetrating electrodes into cortical tissue , 2006, Annals of Biomedical Engineering.

[47]  J. Donoghue,et al.  Sensors for brain-computer interfaces , 2006, IEEE Engineering in Medicine and Biology Magazine.