A spiking network model of short-term active memory

Studies of cortical neurons in monkeys performing short-term memory tasks have shown that information about a stimulus can be maintained by persistent neuron firing for periods of many seconds after removal of the stimulus. The mechanism by which this sustained activity is initiated and maintained is unknown. In this article we present a spiking neural network model of short-term memory and use it to investigate the hypothesis that recurrent, or “re-entrant,” networks with constant connection strengths are sufficient to store graded information temporarily. The synaptic weights that enable the network to mimic the input-output characteristics of an active memory module are computed using an optimization procedure for recurrent networks with non-spiking neurons. This network is then transformed into one with spiking neurons by interpreting the continuous output values of the nonspiking model neurons as spiking probabilities. The behavior of the model neurons in this spiking network is compared with that of 179 single units previously recorded in monkey inferotemporal (IT) cortex during the performance of a short-term memory task. The spiking patterns of almost every model neuron are found to resemble closely those of IT neurons. About 40% of the IT neuron firing patterns are also found to be of the same types as those of model neurons. A property of the spiking model is that the neurons cannot maintain precise graded activity levels indefinitely, but eventually relax to one of a few constant activities called fixed-point attractors. The noise introduced into the model by the randomness of spiking causes the network to jump between these attractors. This switching between attractor states generates spike trains with a characteristic statistical temporal structure. We found evidence for the same kind of structure in the spike trains from about half of the IT neurons in our test set. These results show that the behavior of many real cortical memory neurons is consistent with an active storage mechanism based on recurrent activity in networks with fixed synaptic strengths.

[1]  B. Mandelbrot,et al.  RANDOM WALK MODELS FOR THE SPIKE ACTIVITY OF A SINGLE NEURON. , 1964, Biophysical journal.

[2]  J. Fuster,et al.  INTERVAL ANALYSIS OF CELL DISCHARGE IN SPONTANEOUS AND OPTICALLY MODULATED ACTIVITY IN THE VISUAL SYSTEM. , 1965, Archives italiennes de biologie.

[3]  D. R. Smith,et al.  A STATISTICAL ANALYSIS OF THE CONTINUAL ACTIVITY OF SINGLE CORTICAL NEURONES IN THE CAT UNANAESTHETIZED ISOLATED FOREBRAIN. , 1965, Biophysical journal.

[4]  J. D. Cowan,et al.  Statistical Mechanics of Nervous Nets , 1968 .

[5]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[6]  J. Fuster Unit activity in prefrontal cortex during delayed-response performance: neuronal correlates of transient memory. , 1973, Journal of neurophysiology.

[7]  H Niki,et al.  Prefrontal unit activity during delayed alternation in the monkey. I. Relation to direction of response. , 1974, Brain research.

[8]  J. Fuster,et al.  Delayed-matching and delayed-response deficit from cooling dorsolateral prefrontal cortex in monkeys. , 1976, Journal of comparative and physiological psychology.

[9]  J. Fuster,et al.  Inferotemporal neurons distinguish and retain behaviorally relevant features of visual stimuli. , 1981, Science.

[10]  H. Spinnler The prefrontal cortex, Anatomy, physiology, and neuropsychology of the frontal lobe, J.M. Fuster. Raven Press, New York (1980), IX-222 pages , 1981 .

[11]  J. Fuster,et al.  Cellular discharge in the dorsolateral prefrontal cortex of the monkey in cognitive tasks , 1982, Experimental Neurology.

[12]  J M Fuster,et al.  Neuronal firing in the inferotemporal cortex of the monkey in a visual memory task , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  J. Fuster Behavioral electrophysiology of the prefrontal cortex , 1984, Trends in Neurosciences.

[14]  J. Fuster The prefrontal cortex, mediator of cross-temporal contingencies. , 1985, Human neurobiology.

[15]  J. Fuster,et al.  Functional interactions between inferotemporal and prefrontal cortex in a cognitive task , 1985, Brain Research.

[16]  Henry C. Tuckwell,et al.  Introduction to theoretical neurobiology , 1988 .

[17]  Javier Quintana,et al.  Prefrontal representation of stimulus attributes during delay tasks. I. Unit activity in cross-temporal integration of sensory and sensory-motor information , 1988, Brain Research.

[18]  J. Fuster,et al.  Prefrontal representation of stimulus attributes during delay tasks. II. The role of behavioral significance , 1988, Brain Research.

[19]  Richard A. Andersen,et al.  A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons , 1988, Nature.

[20]  J. Fuster,et al.  Effects of cooling parietal cortex on prefrontal units in delay tasks , 1989, Brain Research.

[21]  J. Changeux,et al.  A Simple Model of Prefrontal Cortex Function in Delayed-Response Tasks , 1989, Journal of Cognitive Neuroscience.

[22]  G. Holmes The prefrontal cortex: Anatomy, physiology, and neuropsychology of the frontal lobe (2nd ed.) , 1989 .

[23]  Ronald J. Williams,et al.  Gradient-Based Learning Algorithms for Recurrent Networks , 1989 .

[24]  Daniel J. Amit,et al.  Attractor neural networks and biological reality: associative memory and learning , 1989, Future Gener. Comput. Syst..

[25]  J M Fuster,et al.  Behavioral electrophysiology of the prefrontal cortex of the primate. , 1990, Progress in brain research.

[26]  P. Goldman-Rakic,et al.  Visuospatial coding in primate prefrontal neurons revealed by oculomotor paradigms. , 1990, Journal of neurophysiology.

[27]  J. Fuster Inferotemporal units in selective visual attention and short-term memory. , 1990, Journal of neurophysiology.

[28]  David Zipser,et al.  Recurrent Network Model of the Neural Mechanism of Short-Term Active Memory , 1991, Neural Computation.

[29]  Y. Miyashita,et al.  Neural organization for the long-term memory of paired associates , 1991, Nature.

[30]  R. Desimone,et al.  A neural mechanism for working and recognition memory in inferior temporal cortex. , 1991, Science.

[31]  Christof Koch,et al.  Cortical Cells Should Fire Regularly, But Do Not , 1999, Neural Computation.

[32]  D. Zipser,et al.  Identification models of the nervous system , 1992, Neuroscience.