Information-Geometric Measure for Neural Spikes

This study introduces information-geometric measures to analyze neural firing patterns by taking not only the second-order but also higher-order interactions among neurons into account. Information geometry provides useful tools and concepts for this purpose, including the orthogonality of coordinate parameters and the Pythagoras relation in the Kullback-Leibler divergence. Based on this orthogonality, we show a novel method for analyzing spike firing patterns by decomposing the interactions of neurons of various orders. As a result, purely pairwise, triple-wise, and higher-order interactions are singled out. We also demonstrate the benefits of our proposal by using several examples.

[1]  A. Aertsen,et al.  Spike synchronization and rate modulation differentially involved in motor cortical function. , 1997, Science.

[2]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[3]  Pieter R. Roelfsema,et al.  The Effects of Pair-wise and Higher-order Correlations on the Firing Rate of a Postsynaptic Neuron , 1998, Neural Computation.

[4]  J. Csicsvari,et al.  Replay and Time Compression of Recurring Spike Sequences in the Hippocampus , 1999, The Journal of Neuroscience.

[5]  Sonja Grün,et al.  Unitary joint events in multiple neuron spiking activity: detection, significance, and interpretation , 1996 .

[6]  A. Aertsen,et al.  Neuronal assemblies , 1989, IEEE Transactions on Biomedical Engineering.

[7]  J. Skilling,et al.  Algorithms and Applications , 1985 .

[8]  G. P. Moore,et al.  Neuronal spike trains and stochastic point processes. II. Simultaneous spike trains. , 1967, Biophysical journal.

[9]  Stuart N. Baker,et al.  An Accurate Measure of the Instantaneous Discharge Probability, with Application to Unitary Joint-Event Analysis , 2000, Neural Computation.

[10]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[11]  Shun-ichi Amari.  Information Geometry of Neural Networks , 2000, PRICAI.

[12]  Kathryn B. Laskey,et al.  Neural Coding: Higher-Order Temporal Patterns in the Neurostatistics of Cell Assemblies , 2000, Neural Computation.

[13]  Günther Palm,et al.  Detecting higher-order interactions among the spiking events in a group of neurons , 1995, Biological Cybernetics.

[14]  Thomas Wennekers,et al.  Spatial and Temporal Stochastic Interaction in Neuronal Assemblies , 2003 .

[15]  Sonja Grün,et al.  Detecting unitary events without discretization of time , 1999, Journal of Neuroscience Methods.

[16]  William Bialek,et al.  Reading a Neural Code , 1991, NIPS.

[17]  J. Donoghue,et al.  Neuronal Interactions Improve Cortical Population Coding of Movement Direction , 1999, The Journal of Neuroscience.

[18]  TJ Gawne,et al.  How independent are the messages carried by adjacent inferior temporal cortical neurons? , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[19]  M. Tatsuno,et al.  Examples of Applications of Information-geometric Measure to Neural Data 1.1.1 Coincident Ring 1.1.2 Mutual Information between Ring and Behavior 1.1.4 Experimental Data 1.2.2 Mutual Information between Behavior and Ring , 2002 .

[20]  R. Reid,et al.  Temporal Coding of Visual Information in the Thalamus , 2000, The Journal of Neuroscience.

[21]  M. Tovée,et al.  Representational capacity of face coding in monkeys. , 1996, Cerebral cortex.

[22]  S. Einum,et al.  Cortical ensemble activity increasingly predicts behaviour outcomes during learning of a motor task , 2022 .

[23]  Kathryn B. Laskey,et al.  Comparing Different Measures of Spatio-Temporal Patterns in Neural Activity , 1998 .

[24]  A. W. Kemp,et al.  Kendall's Advanced Theory of Statistics. , 1994 .

[25]  Sonja Grün,et al.  Unitary Events in Multiple Single-Neuron Spiking Activity: II. Nonstationary Data , 2002, Neural Computation.

[26]  A. Aertsen,et al.  Response synchronization in the visual cortex , 1993, Current Opinion in Neurobiology.

[27]  T. Sejnowski,et al.  Correlated neuronal activity and the flow of neural information , 2001, Nature Reviews Neuroscience.

[28]  S. Amari.  Differential Geometry of Curved Exponential Families-Curvatures and Information Loss , 1982 .

[29]  Stefano Panzeri,et al.  How Well Can We Estimate the Information Carried in Neuronal Responses from Limited Samples? , 1997, Neural Computation.

[30]  Stefano Panzeri,et al.  The Upward Bias in Measures of Information Derived from Limited Data Samples , 1995, Neural Computation.

[31]  R N Lemon,et al.  Precise spatiotemporal repeating patterns in monkey primary and supplementary motor areas occur at chance levels. , 2000, Journal of neurophysiology.

[32]  M. Tovée,et al.  Information encoding and the responses of single neurons in the primate temporal visual cortex. , 1993, Journal of neurophysiology.

[33]  R. Wurtz,et al.  Visual and oculomotor functions of monkey substantia nigra pars reticulata. I. Relation of visual and auditory responses to saccades. , 1983, Journal of neurophysiology.

[34]  Igor V. Tetko,et al.  Fast combinatorial methods to estimate the probability of complex temporal patterns of spikes , 1997, Biological Cybernetics.

[35]  Shun-ichi Amari,et al.  Methods of information geometry , 2000 .

[36]  Stefano Panzeri,et al.  On Decoding the Responses of a Population of Neurons from Short Time Windows , 1999, Neural Computation.

[37]  L M Optican,et al.  Primate striate and prestriate cortical neurons during discrimination. I. simultaneous temporal encoding of information about color and pattern. , 1996, Journal of neurophysiology.

[38]  Shun-ichi Amari,et al.  Information geometry of Boltzmann machines , 1992, IEEE Trans. Neural Networks.

[39]  A. Aertsen,et al.  On the significance of correlations among neuronal spike trains , 2004, Biological Cybernetics.

[40]  B. McNaughton,et al.  Reactivation of Hippocampal Cell Assemblies: Effects of Behavioral State, Experience, and EEG Dynamics , 1999, The Journal of Neuroscience.

[41]  M. Nicolelis,et al.  Reconstructing the Engram: Simultaneous, Multisite, Many Single Neuron Recordings , 1997, Neuron.

[42]  Barry J. Richmond,et al.  Unbiased measures of transmitted information and channel capacity from multivariate neuronal data , 1991, Biological Cybernetics.

[43]  L M Optican,et al.  Primate striate and prestriate cortical neurons during discrimination. II. separable temporal codes for color and pattern. , 1996, Journal of neurophysiology.

[44]  Shun-ichi Amari,et al.  Information geometry on hierarchy of probability distributions , 2001, IEEE Trans. Inf. Theory.

[45]  Hiroyuki Ito,et al.  Model Dependence in Quantification of Spike Interdependence by Joint Peri-Stimulus Time Histogram , 2000, Neural Computation.

[46]  E T Rolls,et al.  Correlations and the encoding of information in the nervous system , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[47]  I. Csiszar,et al.  Topological property of f-divergence , 1967 .

[48]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[49]  R. Hampson,et al.  The significance of neural ensemble codes during behavior and cognition. , 1997, Annual review of neuroscience.

[50]  E. Niebur,et al.  Growth patterns in the developing brain detected by using continuum mechanical tensor maps , 2022 .

[51]  Arup Roy,et al.  Rate Limitations of Unitary Event Analysis , 2000, Neural Computation.

[52]  Stefano Panzeri,et al.  Analytical estimates of limited sampling biases in different information measures. , 1996, Network.

[53]  Jonathan D. Victor,et al.  Metric-space analysis of spike trains: theory, algorithms and application , 1998, q-bio/0309031.

[54]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[55]  B J Richmond,et al.  Excess synchrony in motor cortical neurons provides redundant direction information with that from coarse temporal measures. , 2001, Journal of neurophysiology.

[56]  G. Laurent,et al.  Who reads temporal information contained across synchronized and oscillatory spike trains? , 1998, Nature.

[57]  B L McNaughton,et al.  Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. , 1998, Journal of neurophysiology.

[58]  Shun-ichi Amari,et al.  Statistical inference under multiterminal rate restrictions: A differential geometric approach , 1989, IEEE Trans. Inf. Theory.

[59]  A. Aertsen,et al.  Dynamics of neuronal interactions in monkey cortex in relation to behavioural events , 1995, Nature.

[60]  A. Parker,et al.  Sense and the single neuron: probing the physiology of perception. , 1998, Annual review of neuroscience.

[61]  Stefan Rotter,et al.  Statistical Significance of Coincident Spikes: Count-Based Versus Rate-Based Statistics , 2002, Neural Computation.

[62]  Stefan Rotter,et al.  Single-trial estimation of neuronal firing rates: From single-neuron spike trains to population activity , 1999, Journal of Neuroscience Methods.

[63]  J. F. C. Kingman,et al.  Information and Exponential Families in Statistical Theory , 1980 .

[64]  J. Lisman.  Bursts as a unit of neural information: making unreliable synapses reliable , 1997, Trends in Neurosciences.

[65]  L. Optican,et al.  Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. III. Information theoretic analysis. , 1987, Journal of neurophysiology.

[66]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[67]  Neil D. Lawrence,et al.  Advances in Neural Information Processing Systems 14 , 2002 .

[68]  A. Treves,et al.  The representational capacity of the distributed encoding of information provided by populations of neurons in primate temporal visual cortex , 1997, Experimental Brain Research.

[69]  W. Singer,et al.  Temporal coding in the visual cortex: new vistas on integration in the nervous system , 1992, Trends in Neurosciences.

[70]  William Bialek,et al.  Synergy in a Neural Code , 2000, Neural Computation.

[71]  Stefano Panzeri,et al.  A Unified Approach to the Study of Temporal, Correlational, and Rate Coding , 1999, Neural Computation.

[72]  Barry J. Richmond,et al.  Decoding cortical neuronal signals: Network models, information estimation and spatial tuning , 1994, Journal of Computational Neuroscience.

[73]  Shun-ichi Amari,et al.  Differential-geometrical methods in statistics , 1985 .

[74]  E. Vaadia,et al.  Spatiotemporal structure of cortical activity: properties and behavioral relevance. , 1998, Journal of neurophysiology.

[75]  L. Optican,et al.  Lateral geniculate neurons in behaving primates. II. Encoding of visual information in the temporal shape of the response. , 1991, Journal of neurophysiology.

[76]  M. Kendall,et al.  Kendall's advanced theory of statistics , 1995 .

[77]  M. Kendall.  Theoretical Statistics , 1956, Nature.

[78]  S. Panzeri,et al.  An exact method to quantify the information transmitted by different mechanisms of correlational coding. , 2003, Network.

[79]  Shun-ichi Amari,et al.  Information-Geometric Decomposition in Spike Analysis , 2001, NIPS.

[80]  Kenji Kawano,et al.  Global and fine information coded by single neurons in the temporal visual cortex , 1999, Nature.

[81]  C. Gross,et al.  Neural ensemble coding in inferior temporal cortex. , 1994, Journal of neurophysiology.

[82]  Stefan Rotter,et al.  Analysis of higher-order neuronal interactions based on conditional inference , 2003, Biological Cybernetics.

[83]  M K Habib,et al.  Dynamics of neuronal firing correlation: modulation of "effective connectivity". , 1989, Journal of neurophysiology.

[84]  Masato Okada,et al.  How does the information-geometric measure depend on underlying neural mechanisms? , 2003, Neurocomputing.

[85]  E. Jaynes.  On the rationale of maximum-entropy methods , 1982, Proceedings of the IEEE.

[86]  Tatsuya Kimura,et al.  Cerebellar complex spikes encode both destinations and errors in arm movements , 1998, Nature.

[87]  Sonja Grün,et al.  Unitary Events in Multiple Single-Neuron Spiking Activity: I. Detection and Significance , 2002, Neural Computation.

[88]  G L Gerstein,et al.  Detecting spatiotemporal firing patterns among simultaneously recorded single neurons. , 1988, Journal of neurophysiology.

[89]  B J Richmond,et al.  Stochastic nature of precisely timed spike patterns in visual system neuronal responses. , 1999, Journal of neurophysiology.

[90]  H. Spitzer,et al.  Temporal encoding of two-dimensional patterns by single units in primate primary visual cortex. I. Stimulus-response relations. , 1990, Journal of neurophysiology.

[91]  M. Tsukada,et al.  Temporal pattern discrimination of impulse sequences in the computer-simulated nerve cells , 2004, Biological Cybernetics.

[92]  A. Aertsen,et al.  Representation of cooperative firing activity among simultaneously recorded neurons. , 1985, Journal of neurophysiology.

[93]  G. Palm.  Evidence, information, and surprise , 1981, Biological Cybernetics.

[94]  C. R. Rao,et al.  Information and the Accuracy Attainable in the Estimation of Statistical Parameters , 1992 .

[95]  I. Csiszár.  $I$-Divergence Geometry of Probability Distributions and Minimization Problems , 1975 .

[96]  B L McNaughton,et al.  Dynamics of the hippocampal ensemble code for space. , 1993, Science.

[97]  E. Vaadia,et al.  Spatiotemporal firing patterns in the frontal cortex of behaving monkeys. , 1993, Journal of neurophysiology.

[98]  Yutaka Sakai,et al.  Synchronous Firing and Higher-Order Interactions in Neuron Pool , 2003, Neural Computation.