Measuring Integrated Information from the Decoding Perspective

Accumulating evidence indicates that the capacity to integrate information in the brain is a prerequisite for consciousness. Integrated Information Theory (IIT) of consciousness provides a mathematical approach to quantifying the information integrated in a system, called integrated information, Φ. Integrated information is defined theoretically as the amount of information a system generates as a whole, above and beyond the amount of information its parts independently generate. IIT predicts that the amount of integrated information in the brain should reflect levels of consciousness. Empirical evaluation of this theory requires computing integrated information from neural data acquired from experiments, although difficulties with using the original measure Φ precludes such computations. Although some practical measures have been previously proposed, we found that these measures fail to satisfy the theoretical requirements as a measure of integrated information. Measures of integrated information should satisfy the lower and upper bounds as follows: The lower bound of integrated information should be 0 and is equal to 0 when the system does not generate information (no information) or when the system comprises independent parts (no integration). The upper bound of integrated information is the amount of information generated by the whole system. Here we derive the novel practical measure Φ* by introducing a concept of mismatched decoding developed from information theory. We show that Φ* is properly bounded from below and above, as required, as a measure of integrated information. We derive the analytical expression of Φ* under the Gaussian assumption, which makes it readily applicable to experimental data. Our novel measure Φ* can generally be used as a measure of integrated information in research on consciousness, and also as a tool for network analysis on diverse areas of biology.

[1]  Giulio Tononi,et al.  Integrated Information in Discrete Dynamical Systems: Motivation and Theoretical Framework , 2008, PLoS Comput. Biol..

[2]  Shun-ichi Amari,et al.  Unified framework for information integration based on information geometry , 2015, Proceedings of the National Academy of Sciences.

[3]  G. Tononi,et al.  Triggering sleep slow waves by transcranial magnetic stimulation , 2007, Proceedings of the National Academy of Sciences.

[4]  C. Koch,et al.  Consciousness: here, there and everywhere? , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[5]  UnCheol Lee,et al.  Propofol induction reduces the capacity for neural information integration: Implications for the mechanism of consciousness and general anesthesia , 2008, Consciousness and Cognition.

[6]  Masato Okada,et al.  Information Loss Associated with Imperfect Observation and Mismatched Decoding , 2011, Front. Comput. Neurosci..

[7]  Larissa Albantakis,et al.  From the Phenomenology to the Mechanisms of Consciousness: Integrated Information Theory 3.0 , 2014, PLoS Comput. Biol..

[8]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[9]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[10]  R. Quiroga,et al.  Extracting information from neuronal populations : information theory and decoding approaches , 2022 .

[11]  A. Seth,et al.  Causal density and integrated information as measures of conscious level , 2011, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[12]  G. Tononi Information integration: its relevance to brain function and consciousness. , 2010, Archives italiennes de biologie.

[13]  Mélanie Boly,et al.  Measuring the fading consciousness in the human brain. , 2011, Current opinion in neurology.

[14]  G. Tononi Consciousness as Integrated Information: a Provisional Manifesto , 2008, The Biological Bulletin.

[15]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[16]  Andrea Pigorini,et al.  Multivariate autoregressive models with exogenous inputs for intracerebral responses to direct electrical stimulation of the human brain , 2012, Front. Hum. Neurosci..

[17]  D. Chalmers Facing Up to the Problem of Consciousness , 1995 .

[18]  Giulio Tononi,et al.  Qualia: The Geometry of Integrated Information , 2009, PLoS Comput. Biol..

[19]  G. Tononi,et al.  Breakdown in cortical effective connectivity during midazolam-induced loss of consciousness , 2010, Proceedings of the National Academy of Sciences.

[20]  G. Tononi,et al.  Breakdown of Cortical Effective Connectivity During Sleep , 2005, Science.

[21]  G. Tononi An information integration theory of consciousness , 2004, BMC Neuroscience.

[22]  G. Tononi,et al.  Consciousness and Anesthesia , 2008, Science.

[23]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[24]  Zenas C. Chao,et al.  Large-Scale Information Flow in Conscious and Unconscious States: an ECoG Study in Monkeys , 2013, PloS one.

[25]  Jens Timmer,et al.  Handbook of Time Series Analysis , 2006 .

[26]  W. Wildman,et al.  Theoretical Neuroscience , 2014 .

[27]  Ay Nihat,et al.  Information Geometry on Complexity and Stochastic Interaction , 2001 .

[28]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[29]  Toru Yanagawa,et al.  ar X iv : 1 50 5 . 04 36 8 v 1 [ q-bi o . N C ] 1 7 M ay 2 01 5 1 Measuring integrated information from the decoding perspective , 2015 .

[30]  Adam B Barrett A comment on Tononi & Koch (2015) ‘Consciousness: here, there and everywhere?’ , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[31]  Arend Hintze,et al.  Integrated Information Increases with Fitness in the Evolution of Animats , 2011, PLoS Comput. Biol..

[32]  G. Tononi,et al.  Stimulus Set Meaningfulness and Neurophysiological Differentiation: A Functional Magnetic Resonance Imaging Study , 2014, bioRxiv.

[33]  Marcello Massimini,et al.  Recovery of cortical effective connectivity and recovery of consciousness in vegetative patients , 2012, Brain : a journal of neurology.

[34]  P. Latham,et al.  Synergy, Redundancy, and Independence in Population Codes, Revisited , 2005, The Journal of Neuroscience.

[35]  G. Tononi,et al.  A Theoretically Based Index of Consciousness Independent of Sensory Processing and Behavior , 2013, Science Translational Medicine.

[36]  G Tononi,et al.  Integrated information theory of consciousness: an updated account. , 2012, Archives italiennes de biologie.

[37]  Gordon Pipa,et al.  Transfer entropy—a model-free measure of effective connectivity for the neurosciences , 2010, Journal of Computational Neuroscience.

[38]  Anil K. Seth,et al.  Practical Measures of Integrated Information for Time-Series Data , 2011, PLoS Comput. Biol..

[39]  Shlomo Shamai,et al.  On information rates for mismatched decoders , 1994, IEEE Trans. Inf. Theory.

[40]  G. Tononi,et al.  Unresponsiveness ≠ Unconsciousness , 2012, Anesthesiology.

[41]  S. Bressler,et al.  Granger Causality: Basic Theory and Application to Neuroscience , 2006, q-bio/0608035.

[42]  Shun-ichi Amari,et al.  Methods of information geometry , 2000 .

[43]  Kazuya Ishibashi,et al.  Mismatched Decoding in the Brain , 2010, The Journal of Neuroscience.