Intra-day signal instabilities affect decoding performance in an intracortical neural interface system

OBJECTIVE Motor neural interface systems (NIS) aim to convert neural signals into motor prosthetic or assistive device control, allowing people with paralysis to regain movement or control over their immediate environment. Effector or prosthetic control can degrade if the relationship between recorded neural signals and intended motor behavior changes. Therefore, characterizing both biological and technological sources of signal variability is important for a reliable NIS. APPROACH To address the frequency and causes of neural signal variability in a spike-based NIS, we analyzed within-day fluctuations in spiking activity and action potential amplitude recorded with silicon microelectrode arrays implanted in the motor cortex of three people with tetraplegia (BrainGate pilot clinical trial, IDE). MAIN RESULTS 84% of the recorded units showed a statistically significant change in apparent firing rate (3.8 ± 8.71 Hz or 49% of the mean rate) across several-minute epochs of tasks performed on a single session, and 74% of the units showed a significant change in spike amplitude (3.7 ± 6.5 µV or 5.5% of mean spike amplitude). 40% of the recording sessions showed a significant correlation in the occurrence of amplitude changes across electrodes, suggesting array micro-movement. Despite the relatively frequent amplitude changes, only 15% of the observed within-day rate changes originated from recording artifacts such as spike amplitude change or electrical noise, while 85% of the rate changes most likely emerged from physiological mechanisms. Computer simulations confirmed that systematic rate changes of individual neurons could produce a directional 'bias' in the decoded neural cursor movements. Instability in apparent neuronal spike rates indeed yielded a directional bias in 56% of all performance assessments in participant cursor control (n = 2 participants, 108 and 20 assessments over two years), resulting in suboptimal performance in these sessions. SIGNIFICANCE We anticipate that signal acquisition and decoding methods that can adapt to the reported instabilities will further improve the performance of intracortically-based NISs.

[1]  Miriam Zacksenhouse,et al.  Cortical Ensemble Adaptation to Represent Velocity of an Artificial Actuator Controlled by a Brain-Machine Interface , 2005, The Journal of Neuroscience.

[2]  B L McNaughton,et al.  Circadian rhythm of synaptic excitability in rat and monkey central nervous system. , 1977, Science.

[3]  Konrad P. Kording,et al.  Sensory Adaptation and Short Term Plasticity as Bayesian Correction for a Changing Brain , 2010, PloS one.

[4]  Richard B. Ivry,et al.  Flexible Cognitive Strategies during Motor Learning , 2011, PLoS Comput. Biol..

[5]  Michael J. Black,et al.  Point-and-Click Cursor Control With an Intracortical Neural Interface System by Humans With Tetraplegia , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Michael J. Black,et al.  Neural control of computer cursor velocity by decoding motor cortical spiking activity in humans with tetraplegia , 2008, Journal of neural engineering.

[7]  Yali Amit,et al.  Single-unit stability using chronically implanted multielectrode arrays. , 2009, Journal of neurophysiology.

[8]  E. Bizzi,et al.  Motor Learning with Unstable Neural Representations , 2007, Neuron.

[9]  G. Buzsáki,et al.  Temporal Interaction between Single Spikes and Complex Spike Bursts in Hippocampal Pyramidal Cells , 2001, Neuron.

[10]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[11]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[12]  J.P. Donoghue,et al.  Reliability of signals from a chronically implanted, silicon-based electrode array in non-human primate primary motor cortex , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  N. Hatsopoulos,et al.  Propagating waves mediate information transfer in the motor cortex , 2006, Nature Neuroscience.

[14]  Emery N. Brown,et al.  Dynamic Analysis of Neural Encoding by Point Process Adaptive Filtering , 2004, Neural Computation.

[15]  R. Andersen,et al.  Selecting the signals for a brain–machine interface , 2004, Current Opinion in Neurobiology.

[16]  B. Costello,et al.  The human volatilome: volatile organic compounds (VOCs) in exhaled breath, skin emanations, urine, feces and saliva , 2014, Journal of breath research.

[17]  Wei Wu,et al.  Bayesian Population Decoding of Motor Cortical Activity Using a Kalman Filter , 2006, Neural Computation.

[18]  J D Simeral,et al.  Continuous neuronal ensemble control of simulated arm reaching by a human with tetraplegia , 2011, Journal of neural engineering.

[19]  L. Paninski,et al.  Common-input models for multiple neural spike-train data , 2007, Network.

[20]  Matthew Fellows,et al.  Robustness of neuroprosthetic decoding algorithms , 2003, Biological Cybernetics.

[21]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[22]  J. Csicsvari,et al.  Massively parallel recording of unit and local field potentials with silicon-based electrodes. , 2003, Journal of neurophysiology.

[23]  Liam Paninski,et al.  Population decoding of motor cortical activity using a generalized linear model with hidden states , 2010, Journal of Neuroscience Methods.

[24]  L R Hochberg,et al.  Efficient Decoding With Steady-State Kalman Filter in Neural Interface Systems , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  Trent J. Bradberry,et al.  Reconstructing Three-Dimensional Hand Movements from Noninvasive Electroencephalographic Signals , 2010, The Journal of Neuroscience.

[26]  Mikhail A Lebedev,et al.  Stable Ensemble Performance with Single-neuron Variability during Reaching Movements in Primates , 2022 .

[27]  John P. Cunningham,et al.  A High-Performance Neural Prosthesis Enabled by Control Algorithm Design , 2012, Nature Neuroscience.

[28]  Justin C. Sanchez,et al.  Quantifying long-term microelectrode array functionality using chronic in vivo impedance testing , 2012, Journal of neural engineering.

[29]  Michael J. Black,et al.  Assistive technology and robotic control using motor cortex ensemble‐based neural interface systems in humans with tetraplegia , 2007, The Journal of physiology.

[30]  Prabhat,et al.  Inferring Attentional State and Kinematics from Motor Cortical Firing Rates , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[31]  Wei Wu,et al.  Real-Time Decoding of Nonstationary Neural Activity in Motor Cortex , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[33]  Marc W. Slutzky,et al.  Control of a biomimetic brain machine interface with local field potentials: Performance and stability of a static decoder over 200 days , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[34]  Marc W Slutzky,et al.  Statistical assessment of the stability of neural movement representations. , 2011, Journal of neurophysiology.

[35]  V. Gilja,et al.  Neural Recording Stability of Chronic Electrode Arrays in Freely Behaving Primates , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[36]  K. I. Blum,et al.  Experience-Dependent Changes in Extracellular Spike Amplitude May Reflect Regulation of Dendritic Action Potential Back-Propagation in Rat Hippocampal Pyramidal Cells , 2001, The Journal of Neuroscience.

[37]  Steven M Chase,et al.  Control of a brain–computer interface without spike sorting , 2009, Journal of neural engineering.

[38]  E. Bizzi,et al.  Neuronal Correlates of Motor Performance and Motor Learning in the Primary Motor Cortex of Monkeys Adapting to an External Force Field , 2001, Neuron.

[39]  E. Fetz,et al.  Compact movable microwire array for long-term chronic unit recording in cerebral cortex of primates. , 2007, Journal of neurophysiology.

[40]  Krishna V. Shenoy,et al.  Challenges and Opportunities for Next-Generation Intracortically Based Neural Prostheses , 2011, IEEE Transactions on Biomedical Engineering.

[41]  Eran Stark,et al.  Predicting Movement from Multiunit Activity , 2007, The Journal of Neuroscience.

[42]  Dawn M. Taylor,et al.  Direct Cortical Control of 3D Neuroprosthetic Devices , 2002, Science.

[43]  A. Schwartz,et al.  High-performance neuroprosthetic control by an individual with tetraplegia , 2013, The Lancet.

[44]  William J Tyler,et al.  A quantitative overview of biophysical forces impinging on neural function , 2013, Physical biology.

[45]  Nicholas G. Hatsopoulos,et al.  Brain-machine interface: Instant neural control of a movement signal , 2002, Nature.

[46]  L. Miller,et al.  Accurate decoding of reaching movements from field potentials in the absence of spikes , 2012, Journal of neural engineering.

[47]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[48]  J. Krakauer,et al.  An Implicit Plan Overrides an Explicit Strategy during Visuomotor Adaptation , 2006, The Journal of Neuroscience.

[49]  R.R. Harrison,et al.  Validation of adaptive threshold spike detector for neural recording , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[50]  Michael J. Black,et al.  Neural control of cursor trajectory and click by a human with tetraplegia 1000 days after implant of an intracortical microelectrode array , 2011 .

[51]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.

[52]  S. Meagher.  Instant neural control of a movement signal , 2002 .

[53]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[54]  Robert F. Kirsch,et al.  Command of an upper extremity FES system using a simple set of commands , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[55]  Bradley Greger,et al.  The functional consequences of chronic, physiologically effective intracortical microstimulation. , 2011, Progress in brain research.

[56]  C. Koch,et al.  On the origin of the extracellular action potential waveform: A modeling study. , 2006, Journal of neurophysiology.

[57]  L. Miller,et al.  Decoding the rat forelimb movement direction from epidural and intracortical field potentials , 2011, Journal of neural engineering.

[58]  Jiping He,et al.  Neuron selection and visual training for population vector based cortical control , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[59]  M. Schieber,et al.  Rapid Changes in Throughput from Single Motor Cortex Neurons to Muscle Activity , 2007, Science.

[60]  Teresa H. Y. Meng,et al.  HermesB: A Continuous Neural Recording System for Freely Behaving Primates , 2007, IEEE Transactions on Biomedical Engineering.

[61]  Robert D Flint,et al.  Local field potentials allow accurate decoding of muscle activity. , 2012, Journal of neurophysiology.

[62]  Robert E Kass,et al.  Functional network reorganization during learning in a brain-computer interface paradigm , 2008, Proceedings of the National Academy of Sciences.

[63]  John P. Cunningham,et al.  Single-Neuron Stability during Repeated Reaching in Macaque Premotor Cortex , 2007, The Journal of Neuroscience.

[64]  Vikash Gilja,et al.  Long-term Stability of Neural Prosthetic Control Signals from Silicon Cortical Arrays in Rhesus Macaque Motor Cortex , 2010 .

[65]  S. Solla,et al.  Toward the Restoration of Hand Use to a Paralyzed Monkey: Brain-Controlled Functional Electrical Stimulation of Forearm Muscles , 2009, PloS one.

[66]  J. Carmena,et al.  Emergence of a Stable Cortical Map for Neuroprosthetic Control , 2009, PLoS biology.