“Master” Neurons Induced by Operant Conditioning in Rat Motor Cortex during a Brain-Machine Interface Task

Operant control of a prosthesis by neuronal cortical activity is one of the successful strategies for implementing brain-machine interfaces (BMI), by which the subject learns to exert a volitional control of goal-directed movements. However, it remains unknown if the induced brain circuit reorganization affects preferentially the conditioned neurons whose activity controlled the BMI actuator during training. Here, multiple extracellular single-units were recorded simultaneously in the motor cortex of head-fixed behaving rats. The firing rate of a single neuron was used to control the position of a one-dimensional actuator. Each time the firing rate crossed a predefined threshold, a water bottle moved toward the rat, until the cumulative displacement of the bottle allowed the animal to drink. After a learning period, most (88%) conditioned neurons raised their activity during the trials, such that the time to reward decreased across sessions: the conditioned neuron fired strongly, reliably and swiftly after trial onset, although no explicit instruction in the learning rule imposed a fast neuronal response. Moreover, the conditioned neuron fired significantly earlier and more strongly than nonconditioned neighboring neurons. During the first training sessions, an increase in firing rate variability was seen only for the highly conditionable neurons. This variability then decreased while the conditioning effect increased. These findings suggest that modifications during training target preferentially the neuron chosen to control the BMI, which acts then as a “master” neuron, leading in time the reconfiguration of activity in the local cortical network.

[1]  R. Morris,et al.  Making memories last: the synaptic tagging and capture hypothesis , 2010, Nature Reviews Neuroscience.

[2]  M. Hallett,et al.  Modulation of cortical motor output maps during development of implicit and explicit knowledge. , 1994, Science.

[3]  R. Andersen,et al.  Coding of intention in the posterior parietal cortex , 1997, Nature.

[4]  Miguel A L Nicolelis,et al.  Reduction of Single-Neuron Firing Uncertainty by Cortical Ensembles during Motor Skill Learning , 2004, The Journal of Neuroscience.

[5]  L. Pinneo On noise in the nervous system. , 1966, Psychological review.

[6]  E. Evarts Pyramidal tract activity associated with a conditioned hand movement in the monkey. , 1966, Journal of neurophysiology.

[7]  E. Evarts,et al.  Relation of pyramidal tract activity to force exerted during voluntary movement. , 1968, Journal of neurophysiology.

[8]  J. Basmajian,et al.  Inhibition of Neighboring Motoneurons in Conscious Control of Single Spinal Motoneurons , 1974, Science.

[9]  K. Molina-Luna,et al.  Dopamine in Motor Cortex Is Necessary for Skill Learning and Synaptic Plasticity , 2009, PloS one.

[10]  John P. Cunningham,et al.  Single-Neuron Stability during Repeated Reaching in Macaque Premotor Cortex , 2007, The Journal of Neuroscience.

[11]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[12]  K Sakai,et al.  Neuronal tuning and associative mechanisms in form representation. , 1994, Learning & memory.

[13]  Byron M. Yu,et al.  Neural Variability in Premotor Cortex Provides a Signature of Motor Preparation , 2006, The Journal of Neuroscience.

[14]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[15]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[16]  Charles D. Woody,et al.  Changes in membrane currents during Pavlovian conditioning of single cortical neurons , 1991, Brain Research.

[17]  L Rispal-Padel,et al.  Synaptic plasticity in the thalamo-cortical pathway as one of the neurobiological correlates of forelimb flexion conditioning: electrophysiological investigation in the cat. , 1994, Journal of neurophysiology.

[18]  Eilon Vaadia,et al.  Trial-to-Trial Variability of Single Cells in Motor Cortices Is Dynamically Modified during Visuomotor Adaptation , 2009, The Journal of Neuroscience.

[19]  D. Alkon,et al.  AHP reductions in rabbit hippocampal neurons during conditioning correlate with acquisition of the learned response , 1988, Brain Research.

[20]  Mikhail A Lebedev,et al.  Stable Ensemble Performance with Single-neuron Variability during Reaching Movements in Primates , 2022 .

[21]  Maik C. Stüttgen,et al.  The Head-fixed Behaving Rat—Procedures and Pitfalls , 2010, Somatosensory & motor research.

[22]  E. Fetz,et al.  Operant Conditioning of Specific Patterns of Neural and Muscular Activity , 1971, Science.

[23]  C.R. Miller,et al.  Suitability of the Cingulate Cortex for Neural Control , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  J. Basmajian,et al.  Control and training of individual motor units. , 1963, Science.

[25]  J. Byrne Cellular analysis of associative learning. , 1987, Physiological reviews.

[26]  James L Olds Operant conditioning of single unit responses. , 1965 .

[27]  W. Schultz Behavioral dopamine signals , 2007, Trends in Neurosciences.

[28]  Edi Barkai,et al.  Long‐term modifications in intrinsic neuronal properties and rule learning in rats , 2003, The European journal of neuroscience.

[29]  M. Moulins,et al.  Dynamic construction of a neural network from multiple pattern generators in the lobster stomatogastric nervous system , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[30]  J. Disterhoft,et al.  Trace Eyeblink Conditioning Increases CA1 Excitability in a Transient and Learning-Specific Manner , 1996, The Journal of Neuroscience.

[31]  Jeffrey S Bowers,et al.  On the biological plausibility of grandmother cells: implications for neural network theories in psychology and neuroscience. , 2009, Psychological review.

[32]  Edward M. Schmidt,et al.  Single neuron recording from motor cortex as a possible source of signals for control of external devices , 2006, Annals of Biomedical Engineering.

[33]  E. Fetz Operant Conditioning of Cortical Unit Activity , 1969, Science.

[34]  D. Alkon,et al.  Conditioning-specific membrane changes of rabbit hippocampal neurons measured in vitro. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[35]  M. Merzenich,et al.  Cortical remodelling induced by activity of ventral tegmental dopamine neurons , 2001, Nature.

[36]  H. Higashi,et al.  Direct and indirect actions of dopamine on the membrane potential in medium spiny neurons of the mouse neostriatum. , 2002, Journal of neurophysiology.

[37]  E. Schmidt,et al.  Fine control of operantly conditioned firing patterns of cortical neurons , 1978, Experimental Neurology.

[38]  Clement Osei Atiemo,et al.  Dopaminergic Modulation of Motor Maps in Rat Motor Cortex: An In Vivo Study , 2009, Neuroscience.

[39]  Andreas R. Luft,et al.  Dopaminergic modulation of receptive fields in rat sensorimotor cortex , 2011, NeuroImage.

[40]  Marc W Slutzky,et al.  Statistical assessment of the stability of neural movement representations. , 2011, Journal of neurophysiology.

[41]  E. Bizzi,et al.  Motor Learning with Unstable Neural Representations , 2007, Neuron.

[42]  R. Andersen,et al.  Cognitive Control Signals for Neural Prosthetics , 2004, Science.

[43]  E. Fetz,et al.  Direct control of paralyzed muscles by cortical neurons , 2008, Nature.

[44]  Kip A Ludwig,et al.  Naïve coadaptive cortical control , 2005, Journal of neural engineering.

[45]  Byron M. Yu,et al.  Single-Trial Neural Correlates of Arm Movement Preparation , 2011, Neuron.

[46]  D. Debanne,et al.  Long-term plasticity of intrinsic excitability: learning rules and mechanisms. , 2003, Learning & memory.

[47]  D R Humphrey,et al.  Predicting Measures of Motor Performance from Multiple Cortical Spike Trains , 1970, Science.

[48]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[49]  E. Ahissar,et al.  A neuronal analogue of state-dependent learning , 2000, Nature.

[50]  E. Fetz,et al.  Operantly conditioned patterns on precentral unit activity and correlated responses in adjacent cells and contralateral muscles. , 1973, Journal of neurophysiology.

[51]  J. Donoghue,et al.  Learning-induced LTP in neocortex. , 2000, Science.