Precise Spatiotemporal Patterns among Visual Cortical Areas and Their Relation to Visual Stimulus Processing

Visual processing shows a highly distributed organization in which the presentation of a visual stimulus simultaneously activates neurons in multiple columns across several cortical areas. It has been suggested that precise spatiotemporal activity patterns within and across cortical areas play a key role in higher cognitive, motor, and visual functions. In the visual system, these patterns have been proposed to take part in binding stimulus features into a coherent object, i.e., to be involved in perceptual grouping. Using voltage-sensitive dye imaging (VSDI) in behaving monkeys (Macaca fascicularis, males), we simultaneously measured neural population activity in the primary visual cortex (V1) and extrastriate cortex (V2, V4) at high spatial and temporal resolution. We detected time point population events (PEs) in the VSDI signal of each pixel and found that they reflect transient increased neural activation within local populations by establishing their relation to spiking and local field potential activity. Then, we searched for repeating space and time relations between the detected PEs. We demonstrate the following: (1) spatiotemporal patterns occurring within (horizontal) and across (vertical) early visual areas repeat significantly above chance level; (2) information carried in only a few patterns can be used to reliably discriminate between stimulus categories on a single-trial level; (3) the spatiotemporal patterns yielding high classification performance are characterized by late temporal occurrence and top-down propagation, which are consistent with cortical mechanisms involving perceptual grouping. The pattern characteristics and the robust relation between the patterns and the stimulus categories suggest that spatiotemporal activity patterns play an important role in cortical mechanisms of higher visual processing.

[1]  Amiram Grinvald,et al.  VSDI: a new era in functional imaging of cortical dynamics , 2004, Nature Reviews Neuroscience.

[2]  S. Ullman,et al.  Retinotopic Axis Specificity and Selective Clustering of Feedback Projections from V2 to V1 in the Owl Monkey , 2005, The Journal of Neuroscience.

[3]  R N Lemon,et al.  Precise spatiotemporal repeating patterns in monkey primary and supplementary motor areas occur at chance levels. , 2000, Journal of neurophysiology.

[4]  A. Grinvald,et al.  Long-term voltage-sensitive dye imaging reveals cortical dynamics in behaving monkeys. , 2002, Journal of neurophysiology.

[5]  John O'Keefe,et al.  Independent rate and temporal coding in hippocampal pyramidal cells , 2003, Nature.

[6]  G L Gerstein,et al.  Favored patterns in spike trains. II. Application. , 1983, Journal of neurophysiology.

[7]  T. Wiesel,et al.  Columnar specificity of intrinsic horizontal and corticocortical connections in cat visual cortex , 1989, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  Ralf Engbert,et al.  Microsaccades uncover the orientation of covert attention , 2003, Vision Research.

[9]  A. Grinvald,et al.  Relationship between intrinsic connections and functional architecture revealed by optical imaging and in vivo targeted biocytin injections in primate striate cortex. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Nikos K. Logothetis,et al.  Nonmonotonic noise tuning of BOLD fMRI signal to natural images in the visual cortex of the anesthetized monkey , 2001, Current Biology.

[11]  E. Vaadia,et al.  Spatiotemporal structure of cortical activity: properties and behavioral relevance. , 1998, Journal of neurophysiology.

[12]  Rodrigo F. Salazar,et al.  Directed interactions between visual areas and their role in processing image structure and expectancy , 2004, The European journal of neuroscience.

[13]  J. Bullier,et al.  The role of feedback connections in shaping the responses of visual cortical neurons. , 2001, Progress in brain research.

[14]  E. Bienenstock A model of neocortex , 1995 .

[15]  Jennifer A. Mangels,et al.  Predictive Codes for Forthcoming Perception in the Frontal Cortex , 2006, Science.

[16]  W. Singer,et al.  Stimulus-dependent synchronization of neuronal responses in the visual cortex of the awake macaque monkey , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[18]  H C Tuckwell,et al.  Repeating triplets of spikes and oscillations in the mitral cell discharges of freely breathing rats , 1999, The European journal of neuroscience.

[19]  Brendon O. Watson,et al.  Internal Dynamics Determine the Cortical Response to Thalamic Stimulation , 2005, Neuron.

[20]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[21]  R. Goebel,et al.  The role of feedback in shaping neural representations in cat visual cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[22]  R. Frostig,et al.  Cortical point-spread function and long-range lateral interactions revealed by real-time optical imaging of macaque monkey primary visual cortex , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  W. Singer,et al.  Synchronization of oscillatory neuronal responses in cat striate cortex: Temporal properties , 1992, Visual Neuroscience.

[24]  D. Georgescauld Local Cortical Circuits, An Electrophysiological Study , 1983 .

[25]  Ohad Ben-Shahar,et al.  Stochastic Emergence of Repeating Cortical Motifs in Spontaneous Membrane Potential Fluctuations In Vivo , 2007, Neuron.

[26]  V. Bringuier,et al.  Horizontal propagation of visual activity in the synaptic integration field of area 17 neurons. , 1999, Science.

[27]  Yuji Ikegaya,et al.  Synfire Chains and Cortical Songs: Temporal Modules of Cortical Activity , 2004, Science.

[28]  Amiram Grinvald,et al.  Dural substitute for long-term imaging of cortical activity in behaving monkeys and its clinical implications , 2002, Journal of Neuroscience Methods.

[29]  Barry J. Richmond,et al.  Response Features Determining Spike Times , 1999, Neural plasticity.

[30]  S Ullman,et al.  Sequence seeking and counter streams: a computational model for bidirectional information flow in the visual cortex. , 1995, Cerebral cortex.

[31]  E. Vaadia,et al.  Spatiotemporal firing patterns in the frontal cortex of behaving monkeys. , 1993, Journal of neurophysiology.

[32]  Asohan Amarasingham,et al.  At what time scale does the nervous system operate? , 2003, Neurocomputing.

[33]  M. A. Smith,et al.  Spatial and Temporal Scales of Neuronal Correlation in Primary Visual Cortex , 2008, The Journal of Neuroscience.

[34]  R. Eckhorn,et al.  Oscillatory and non-oscillatory synchronizations in the visual cortex and their possible roles in associations of visual features. , 1994, Progress in brain research.

[35]  H. Spekreijse,et al.  Two distinct modes of sensory processing observed in monkey primary visual cortex (V1) , 2001, Nature Neuroscience.

[36]  A Grinvald,et al.  Coherent spatiotemporal patterns of ongoing activity revealed by real-time optical imaging coupled with single-unit recording in the cat visual cortex. , 1995, Journal of neurophysiology.

[37]  W. Singer,et al.  Temporal coding in the visual cortex: new vistas on integration in the nervous system , 1992, Trends in Neurosciences.

[38]  Z. Nadasdy,et al.  Neurons of the cerebral cortex exhibit precise interspike timing in correspondence to behavior. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[39]  A Grinvald,et al.  Long-Term Optical Imaging and Spectroscopy Reveal Mechanisms Underlying the Intrinsic Signal and Stability of Cortical Maps in V1 of Behaving Monkeys , 2000, The Journal of Neuroscience.

[40]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[41]  J. M. Hupé,et al.  Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons , 1998, Nature.

[42]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[43]  A. Grinvald,et al.  Imaging Cortical Dynamics at High Spatial and Temporal Resolution with Novel Blue Voltage-Sensitive Dyes , 1999, Neuron.

[44]  J. B. Levitt,et al.  Circuits for Local and Global Signal Integration in Primary Visual Cortex , 2002, The Journal of Neuroscience.

[45]  P König,et al.  Synchronization of oscillatory neuronal responses between striate and extrastriate visual cortical areas of the cat. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[46]  W. Singer,et al.  Interhemispheric synchronization of oscillatory neuronal responses in cat visual cortex , 1991, Science.

[47]  P Girard,et al.  Feedback connections act on the early part of the responses in monkey visual cortex. , 2001, Journal of neurophysiology.

[48]  P. Roelfsema Cortical algorithms for perceptual grouping. , 2006, Annual review of neuroscience.

[49]  Daniel Lehmann,et al.  Modeling Compositionality by Dynamic Binding of Synfire Chains , 2004, Journal of Computational Neuroscience.

[50]  C. Malsburg Nervous Structures with Dynamical Links , 1985 .

[51]  D. C. Essen,et al.  The visual field representation in striate cortex of the macaque monkey: Asymmetries, anisotropies, and individual variability , 1984, Vision Research.

[52]  B J Richmond,et al.  Stochastic nature of precisely timed spike patterns in visual system neuronal responses. , 1999, Journal of neurophysiology.

[53]  E. Seidemann,et al.  Optimal decoding of correlated neural population responses in the primate visual cortex , 2006, Nature Neuroscience.

[54]  Paul Schrater,et al.  Shape perception reduces activity in human primary visual cortex , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[55]  A Grinvald,et al.  In-vivo Optical Imaging of Cortical Architecture and Dynamics , 1999 .

[56]  M. Abeles Role of the cortical neuron: integrator or coincidence detector? , 1982, Israel journal of medical sciences.

[57]  Daniel J. Kersten,et al.  Object Perception: Generative Image Models and Bayesian Inference , 2002, Biologically Motivated Computer Vision.

[58]  J. O’Keefe,et al.  Neuronal computations underlying the firing of place cells and their role in navigation , 1996, Hippocampus.

[59]  R. Yuste,et al.  Attractor dynamics of network UP states in the neocortex , 2003, Nature.

[60]  A. Grinvald,et al.  Spatiotemporal Dynamics of Sensory Responses in Layer 2/3 of Rat Barrel Cortex Measured In Vivo by Voltage-Sensitive Dye Imaging Combined with Whole-Cell Voltage Recordings and Neuron Reconstructions , 2003, The Journal of Neuroscience.

[61]  R. Yuste,et al.  Dynamics of Spontaneous Activity in Neocortical Slices , 2001, Neuron.

[62]  C. Gilbert,et al.  Spatial integration and cortical dynamics. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[63]  Jean Bennett,et al.  Lateral Connectivity and Contextual Interactions in Macaque Primary Visual Cortex , 2002, Neuron.

[64]  P A Salin,et al.  Corticocortical connections in the visual system: structure and function. , 1995, Physiological reviews.

[65]  B. Richmond,et al.  Latency: another potential code for feature binding in striate cortex. , 1996, Journal of neurophysiology.

[66]  J. Lund,et al.  Widespread periodic intrinsic connections in the tree shrew visual cortex. , 1982, Science.

[67]  Daniel Lehmann,et al.  A Model for Representing the Dynamics of a System of Synfire Chains , 2005, Journal of Computational Neuroscience.

[68]  Bernard L. Strehler,et al.  Time structure and stimulus dependence of precisely replicating patterns present in monkey cortical neuronal spike trains , 1987, Brain Research.

[69]  Yoram Ben-Shaul,et al.  Temporally precise cortical firing patterns are associated with distinct action segments. , 2006, Journal of neurophysiology.

[70]  S. Palmer Common region: A new principle of perceptual grouping , 1992, Cognitive Psychology.