Bidirectional control of a one-dimensional robotic actuator by operant conditioning of a single unit in rat motor cortex

The design of efficient neuroprosthetic devices has become a major challenge for the long-term goal of restoring autonomy to motor-impaired patients. One approach for brain control of actuators consists in decoding the activity pattern obtained by simultaneously recording large neuronal ensembles in order to predict in real-time the subject's intention, and move the prosthesis accordingly. An alternative way is to assign the output of one or a few neurons by operant conditioning to control the prosthesis with rules defined by the experimenter, and rely on the functional adaptation of these neurons during learning to reach the desired behavioral outcome. Here, several motor cortex neurons were recorded simultaneously in head-fixed awake rats and were conditioned, one at a time, to modulate their firing rate up and down in order to control the speed and direction of a one-dimensional actuator carrying a water bottle. The goal was to maintain the bottle in front of the rat's mouth, allowing it to drink. After learning, all conditioned neurons modulated their firing rate, effectively controlling the bottle position so that the drinking time was increased relative to chance. The mean firing rate averaged over all bottle trajectories depended non-linearly on position, so that the mouth position operated as an attractor. Some modifications of mean firing rate were observed in the surrounding neurons, but to a lesser extent. Notably, the conditioned neuron reacted faster and led to a better control than surrounding neurons, as calculated by using the activity of those neurons to generate simulated bottle trajectories. Our study demonstrates the feasibility, even in the rodent, of using a motor cortex neuron to control a prosthesis in real-time bidirectionally. The learning process includes modifications of the activity of neighboring cortical neurons, while the conditioned neuron selectively leads the activity patterns associated with the prosthesis control.

[1]  John P. Cunningham,et al.  A High-Performance Neural Prosthesis Enabled by Control Algorithm Design , 2012, Nature Neuroscience.

[2]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[3]  C.R. Miller,et al.  Suitability of the Cingulate Cortex for Neural Control , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[5]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[6]  E. Fetz,et al.  Operantly conditioned patterns on precentral unit activity and correlated responses in adjacent cells and contralateral muscles. , 1973, Journal of neurophysiology.

[7]  S. Solla,et al.  Toward the Restoration of Hand Use to a Paralyzed Monkey: Brain-Controlled Functional Electrical Stimulation of Forearm Muscles , 2009, PloS one.

[8]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[9]  J. Basmajian,et al.  Control and training of individual motor units. , 1963, Science.

[10]  Kip A Ludwig,et al.  Naïve coadaptive cortical control , 2005, Journal of neural engineering.

[11]  Tirin Moore,et al.  Selective Attention from Voluntary Control of Neurons in Prefrontal Cortex , 2011, Science.

[12]  Yves Frégnac,et al.  “Master” Neurons Induced by Operant Conditioning in Rat Motor Cortex during a Brain-Machine Interface Task , 2013, The Journal of Neuroscience.

[13]  W. Schultz,et al.  Operant Conditioning of Primate Prefrontal Neurons , 2010, Journal of neurophysiology.

[14]  Y. Sakurai,et al.  Conditioned enhancement of firing rates and synchrony of hippocampal neurons and firing rates of motor cortical neurons in rats , 2013, The European journal of neuroscience.

[15]  J. Basmajian,et al.  Inhibition of Neighboring Motoneurons in Conscious Control of Single Spinal Motoneurons , 1974, Science.

[16]  E. Fetz,et al.  Direct control of paralyzed muscles by cortical neurons , 2008, Nature.

[17]  Christof Koch,et al.  On-line, voluntary control of human temporal lobe neurons , 2010, Nature.

[18]  R. Andersen,et al.  Volitional Control of Neural Activity Relies on the Natural Motor Repertoire , 2013, Current Biology.

[19]  Yael Niv,et al.  OPERANT CONDITIONING , 1974, Scholarpedia.

[20]  R. Lemon Descending pathways in motor control. , 2008, Annual review of neuroscience.

[21]  Dragan F. Dimitrov,et al.  Reversible large-scale modification of cortical networks during neuroprosthetic control , 2011, Nature Neuroscience.

[22]  Guy M McKhann,et al.  Cortical control of a prosthetic arm for self-feeding. , 2008, Neurosurgery.

[23]  Emanuel Todorov,et al.  Structured variability of muscle activations supports the minimal intervention principle of motor control. , 2009, Journal of neurophysiology.

[24]  Miguel A. L. Nicolelis,et al.  Real-time control of a robot arm using simultaneously recorded neurons in the motor cortex , 1999, Nature Neuroscience.

[25]  James L Olds Operant conditioning of single unit responses. , 1965 .

[26]  E. Fetz,et al.  Volitional control of single cortical neurons in a brain–machine interface , 2011, Journal of neural engineering.

[27]  Edward M. Schmidt,et al.  Single neuron recording from motor cortex as a possible source of signals for control of external devices , 2006, Annals of Biomedical Engineering.

[28]  Aaron C. Koralek,et al.  Temporally Precise Cell-Specific Coherence Develops in Corticostriatal Networks during Learning , 2013, Neuron.

[29]  J. Carmena,et al.  Emergence of a Stable Cortical Map for Neuroprosthetic Control , 2009, PLoS biology.

[30]  S. Meagher Instant neural control of a movement signal , 2002 .

[31]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[32]  Aaron C. Koralek,et al.  Corticostriatal plasticity is necessary for learning intentional neuroprosthetic skills , 2012, Nature.

[33]  C. Bruce,et al.  Operant Conditioning of Single-Unit Response Patterns in Visual Cortex , 1974, Science.

[34]  E. Fetz Operant Conditioning of Cortical Unit Activity , 1969, Science.

[35]  Nicholas G Hatsopoulos,et al.  Incorporating Feedback from Multiple Sensory Modalities Enhances Brain–Machine Interface Control , 2010, The Journal of Neuroscience.

[36]  E. Fetz,et al.  Operant Conditioning of Specific Patterns of Neural and Muscular Activity , 1971, Science.