Information-Geometric Measures as Robust Estimators of Connection Strengths and External Inputs

Information geometry has been suggested to provide a powerful tool for analyzing multineuronal spike trains. Among several advantages of this approach, a significant property is the close link between information-geometric measures and neural network architectures. Previous modeling studies established that the first- and second-order information-geometric measures corresponded to the number of external inputs and the connection strengths of the network, respectively. This relationship was, however, limited to a symmetrically connected network, and the number of neurons used in the parameter estimation of the log-linear model needed to be known. Recently, simulation studies of biophysical model neurons have suggested that information geometry can estimate the relative change of connection strengths and external inputs even with asymmetric connections. Inspired by these studies, we analytically investigated the link between the information-geometric measures and the neural network structure with asymmetrically connected networks of N neurons. We focused on the information-geometric measures of orders one and two, which can be derived from the two-neuron log-linear model, because unlike higher-order measures, they can be easily estimated experimentally. Considering the equilibrium state of a network of binary model neurons that obey stochastic dynamics, we analytically showed that the corrected first- and second-order information-geometric measures provided robust and consistent approximation of the external inputs and connection strengths, respectively. These results suggest that information-geometric measures provide useful insights into the neural network architecture and that they will contribute to the study of system-level neuroscience.

[1]  R. Kass,et al.  Multiple neural spike train data analysis: state-of-the-art and future challenges , 2004, Nature Neuroscience.

[2]  Sonja Grün,et al.  Theory of the Snowflake Plot and Its Relations to Higher-Order Analysis Methods , 2005, Neural Computation.

[3]  Shun-ichi Amari,et al.  Information-Geometric Measure for Neural Spikes , 2002, Neural Computation.

[4]  Shigeru Shinomoto,et al.  A Method for Selecting the Bin Size of a Time Histogram , 2007, Neural Computation.

[5]  Roberto Tagliaferri,et al.  A novel information geometric approach to variable selection in MLP networks , 2005, Neural Networks.

[6]  A. Aertsen,et al.  Spike synchronization and rate modulation differentially involved in motor cortical function. , 1997, Science.

[7]  Sompolinsky,et al.  Theory of correlations in stochastic neural networks. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[8]  Shun-ichi Amari,et al.  A Comparison of Descriptive Models of a Single Spike Train by Information-Geometric Measure , 2006, Neural Computation.

[9]  B L McNaughton,et al.  Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. , 1998, Journal of neurophysiology.

[10]  Sidarta Ribeiro,et al.  Multielectrode recordings: the next steps , 2002, Current Opinion in Neurobiology.

[11]  G. Buzsáki Large-scale recording of neuronal ensembles , 2004, Nature Neuroscience.

[12]  B L McNaughton,et al.  Coordinated Reactivation of Distributed Memory Traces in Primate Neocortex , 2002, Science.

[13]  Shun-ichi Amari,et al.  Methods of information geometry , 2000 .

[14]  T. Sejnowski,et al.  Discovering Spike Patterns in Neuronal Responses , 2004, The Journal of Neuroscience.

[15]  Conor J. Houghton,et al.  A New Multineuron Spike Train Metric , 2008, Neural Computation.

[16]  Stefano Panzeri,et al.  Information-theoretic methods for studying population codes , 2010, Neural Networks.

[17]  Shun-ichi Amari,et al.  Information geometry on hierarchy of probability distributions , 2001, IEEE Trans. Inf. Theory.

[18]  M. Wilson,et al.  Temporally Structured Replay of Awake Hippocampal Ensemble Activity during Rapid Eye Movement Sleep , 2001, Neuron.

[19]  Sonja Grün,et al.  Unitary Events in Multiple Single-Neuron Spiking Activity: I. Detection and Significance , 2002, Neural Computation.

[20]  G L Gerstein,et al.  Detecting spatiotemporal firing patterns among simultaneously recorded single neurons. , 1988, Journal of neurophysiology.

[21]  Kazushi Ikeda Information Geometry of Interspike Intervals in Spiking Neurons , 2005, Neural Computation.

[22]  J. Csicsvari,et al.  Replay and Time Compression of Recurring Spike Sequences in the Hippocampus , 1999, The Journal of Neuroscience.

[23]  M K Habib,et al.  Dynamics of neuronal firing correlation: modulation of "effective connectivity". , 1989, Journal of neurophysiology.

[24]  B L McNaughton,et al.  Dynamics of the hippocampal ensemble code for space. , 1993, Science.

[25]  Shun-ichi Amari,et al.  Conditional Mixture Model for Correlated Neuronal Spikes , 2010, Neural Computation.

[26]  D. Perkel,et al.  Simultaneously Recorded Trains of Action Potentials: Analysis and Functional Interpretation , 1969, Science.

[27]  Robert E Kass,et al.  Statistical issues in the analysis of neuronal data. , 2005, Journal of neurophysiology.

[28]  Bruce L McNaughton,et al.  Methodological Considerations on the Use of Template Matching to Study Long-Lasting Memory Trace Replay , 2006, The Journal of Neuroscience.

[29]  Masato Okada,et al.  Investigation of Possible Neural Architectures Underlying Information-Geometric Measures , 2004, Neural Computation.

[30]  Shun-ichi Amari,et al.  Differential-geometrical methods in statistics , 1985 .

[31]  Masato Okada,et al.  Estimating Spiking Irregularities Under Changing Environments , 2006, Neural Computation.

[32]  Yutaka Sakai,et al.  Synchronous Firing and Higher-Order Interactions in Neuron Pool , 2003, Neural Computation.