Interpretation of the Precision Matrix and Its Application in Estimating Sparse Brain Connectivity during Sleep Spindles from Human Electrocorticography Recordings

The correlation method from brain imaging has been used to estimate functional connectivity in the human brain. However, brain regions might show very high correlation even when the two regions are not directly connected due to the strong interaction of the two regions with common input from a third region. One previously proposed solution to this problem is to use a sparse regularized inverse covariance matrix or precision matrix (SRPM) assuming that the connectivity structure is sparse. This method yields partial correlations to measure strong direct interactions between pairs of regions while simultaneously removing the influence of the rest of the regions, thus identifying regions that are conditionally independent. To test our methods, we first demonstrated conditions under which the SRPM method could indeed find the true physical connection between a pair of nodes for a spring-mass example and an RC circuit example. The recovery of the connectivity structure using the SRPM method can be explained by energy models using the Boltzmann distribution. We then demonstrated the application of the SRPM method for estimating brain connectivity during stage 2 sleep spindles from human electrocorticography (ECoG) recordings using an electrode array. The ECoG recordings that we analyzed were from a 32-year-old male patient with long-standing pharmaco-resistant left temporal lobe complex partial epilepsy. Sleep spindles were automatically detected using delay differential analysis and then analyzed with SRPM and the Louvain method for community detection. We found spatially localized brain networks within and between neighboring cortical areas during spindles, in contrast to the case when sleep spindles were not present.

[1]  John Shawe-Taylor,et al.  Sparse network-based models for patient classification using fMRI , 2013, NeuroImage.

[2]  M. Raichle,et al.  Cortical network functional connectivity in the descent to sleep , 2009, Proceedings of the National Academy of Sciences.

[3]  Pablo A. Parrilo,et al.  Latent variable graphical model selection via convex optimization , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[4]  T. Sejnowski,et al.  Non-Linear Dynamical Analysis of EEG Time Series Distinguishes Patients with Parkinson’s Disease from Healthy Individuals , 2013, Front. Neurol..

[5]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[6]  M. Lowe,et al.  Antidepressant Effect on Connectivity of the Mood-Regulating Circuit: An fMRI Study , 2005, Neuropsychopharmacology.

[7]  R. Stickgold,et al.  Sleep-dependent memory consolidation and reconsolidation. , 2007, Sleep medicine.

[8]  Edward T. Bullmore,et al.  Modular and Hierarchically Modular Organization of Brain Networks , 2010, Front. Neurosci..

[9]  B. Biswal,et al.  Functional connectivity in the motor cortex of resting human brain using echo‐planar mri , 1995, Magnetic resonance in medicine.

[10]  Michael Kremliovsky,et al.  Using delay differential equations as dynamical classifiers , 2008 .

[11]  Kaustubh Supekar,et al.  Estimation of functional connectivity in fMRI data using stability selection-based sparse partial correlation with elastic net penalty , 2012, NeuroImage.

[12]  Shiqian Ma,et al.  Sparse Inverse Covariance Selection via Alternating Linearization Methods , 2010, NIPS.

[13]  Alfred O. Hero,et al.  $l_{0}$ Sparse Inverse Covariance Estimation , 2014, IEEE Transactions on Signal Processing.

[14]  M. Thase,et al.  Increased Amygdala and Decreased Dorsolateral Prefrontal BOLD Responses in Unipolar Depression: Related and Independent Features , 2007, Biological Psychiatry.

[15]  Jean-François Gagnon,et al.  Sleep and quantitative EEG in neurodegenerative disorders. , 2004, Journal of psychosomatic research.

[16]  V. Haughton,et al.  Mapping functionally related regions of brain with functional connectivity MR imaging. , 2000, AJNR. American journal of neuroradiology.

[17]  Mark W. Woolrich,et al.  Network modelling methods for FMRI , 2011, NeuroImage.

[18]  Jorge Nocedal,et al.  Newton-Like Methods for Sparse Inverse Covariance Estimation , 2012, NIPS.

[19]  Wesley K. Thompson,et al.  MATLAB toolbox for functional connectivity , 2009, NeuroImage.

[20]  Manuel S. Schröter,et al.  Development of a Large-Scale Functional Brain Network during Human Non-Rapid Eye Movement Sleep , 2010, The Journal of Neuroscience.

[21]  B. Biswal,et al.  Functional connectivity of default mode network components: Correlation, anticorrelation, and causality , 2009, Human brain mapping.

[22]  Jessika Weiss,et al.  Graphical Models In Applied Multivariate Statistics , 2016 .

[23]  Bingni W. Brunton,et al.  Extracting spatial–temporal coherent patterns in large-scale neural recordings using dynamic mode decomposition , 2014, Journal of Neuroscience Methods.

[24]  J. Born,et al.  Learning-Dependent Increases in Sleep Spindle Density , 2002, The Journal of Neuroscience.

[25]  Pradeep Ravikumar,et al.  BIG & QUIC: Sparse Inverse Covariance Estimation for a Million Variables , 2013, NIPS.

[26]  Pradeep Ravikumar,et al.  Sparse inverse covariance matrix estimation using quadratic approximation , 2011, MLSLP.

[27]  T. Sejnowski,et al.  Thalamocortical oscillations in the sleeping and aroused brain. , 1993, Science.

[28]  Alfred Meier-Koll,et al.  Walking through a Maze Alters the Architecture of Sleep , 1999, Perceptual and motor skills.

[29]  P. Anderer,et al.  Interrater reliability for sleep scoring according to the Rechtschaffen & Kales and the new AASM standard , 2009, Journal of sleep research.

[30]  A. Kleinschmidt,et al.  Electroencephalographic signatures of attentional and cognitive default modes in spontaneous brain activity fluctuations at rest , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[31]  Olaf Sporns,et al.  Weight-conserving characterization of complex functional brain networks , 2011, NeuroImage.

[32]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[33]  M. Czisch,et al.  Sleep Spindles and Hippocampal Functional Connectivity in Human NREM Sleep , 2011, The Journal of Neuroscience.

[34]  A. McIntosh,et al.  Functional Connectivity of the Medial Temporal Lobe Relates to Learning and Awareness , 2003, The Journal of Neuroscience.

[35]  P. Ronhovde,et al.  Multiresolution community detection for megascale networks by information-based replica correlations. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  Jonathan D. Power,et al.  Intrinsic and Task-Evoked Network Architectures of the Human Brain , 2014, Neuron.

[37]  Justin L. Vincent,et al.  Spontaneous neuronal activity distinguishes human dorsal and ventral attention systems. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[38]  Somayeh Sojoudi,et al.  Equivalence of graphical lasso and thresholding for sparse graphs , 2014, 2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[39]  Ulrik Brandes,et al.  On Modularity Clustering , 2008, IEEE Transactions on Knowledge and Data Engineering.

[40]  J. Rapoport,et al.  Simple models of human brain functional networks , 2012, Proceedings of the National Academy of Sciences.

[41]  Jesper Andersson,et al.  A multi-modal parcellation of human cerebral cortex , 2016, Nature.

[42]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[43]  R. Stickgold,et al.  Memory consolidation and reconsolidation: what is the role of sleep? , 2005, Trends in Neurosciences.

[44]  Stuart M Fogel,et al.  Learning‐dependent changes in sleep spindles and Stage 2 sleep , 2006, Journal of sleep research.

[45]  P. Skudlarski,et al.  Detection of functional connectivity using temporal correlations in MR images , 2002, Human brain mapping.

[46]  A. Chesson,et al.  The American Academy of Sleep Medicine (AASM) Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications , 2007 .

[47]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[48]  Adam J. Rothman,et al.  Sparse permutation invariant covariance estimation , 2008, 0801.4837.

[49]  G. Molnárka,et al.  Implicit extension ofTaylor series method with numerical derivatives for initial value problems , 2005 .

[50]  I. Fried,et al.  Sleep Spindles in Humans: Insights from Intracranial EEG and Unit Recordings , 2011, The Journal of Neuroscience.

[51]  T. Sejnowski Neural Networks: Sleep and memory , 1995, Current Biology.

[52]  Manuel Schabus,et al.  Sleep spindles and their significance for declarative memory consolidation. , 2004, Sleep.

[53]  Alexandre d'Aspremont,et al.  Model Selection Through Sparse Max Likelihood Estimation Model Selection Through Sparse Maximum Likelihood Estimation for Multivariate Gaussian or Binary Data , 2022 .

[54]  Julie Carrier,et al.  Topography of age-related changes in sleep spindles , 2013, Neurobiology of Aging.

[55]  Alexander S. Ecker,et al.  Improved Estimation and Interpretation of Correlations in Neural Circuits , 2015, PLoS Comput. Biol..

[56]  John Doyle,et al.  Study of the brain functional network using synthetic data , 2014, 2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[57]  Olaf Sporns,et al.  The Non-Random Brain: Efficiency, Economy, and Complex Dynamics , 2010, Front. Comput. Neurosci..

[58]  Simon W. Moore,et al.  Efficient Physical Embedding of Topologically Complex Information Processing Networks in Brains and Computer Circuits , 2010, PLoS Comput. Biol..

[59]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[60]  Terrence J. Sejnowski,et al.  Delay Differential Analysis of Time Series , 2015, Neural Computation.

[61]  J. Reichardt,et al.  Statistical mechanics of community detection. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[62]  G. Molnárka,et al.  Implicit Extension of Taylor Series Method with Numerical Derivatives , 2003 .

[63]  Eric Halgren,et al.  Rotating waves during human sleep spindles organize global patterns of activity that repeat precisely through the night , 2016, eLife.

[64]  A. Chesson,et al.  The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology, and Techinical Specifications , 2007 .

[65]  Michael I. Jordan Graphical Models , 1998 .

[66]  F. Takens Detecting strange attractors in turbulence , 1981 .

[67]  M. Yuan,et al.  Model selection and estimation in the Gaussian graphical model , 2007 .

[68]  J. Born,et al.  The contribution of sleep to hippocampus-dependent memory consolidation , 2007, Trends in Cognitive Sciences.

[69]  Pietro Perona,et al.  Sleep spindle detection: crowdsourcing and evaluating performance of experts, non-experts, and automated methods , 2014, Nature Methods.

[70]  Yikai Wang,et al.  An Efficient and Reliable Statistical Method for Estimating Functional Connectivity in Large Scale Brain Networks Using Partial Correlation , 2016, Front. Neurosci..

[71]  C. Smith,et al.  Sleep spindles and learning potential. , 2007, Behavioral neuroscience.

[72]  Kevin E. Bassler,et al.  Improved community structure detection using a modified fine-tuning strategy , 2009, ArXiv.

[73]  Danielle S Bassett,et al.  Brain graphs: graphical models of the human brain connectome. , 2011, Annual review of clinical psychology.

[74]  Carlyle T. Smith,et al.  Impaired motor memory for a pursuit rotor task following Stage 2 sleep loss in college students , 1994, Journal of sleep research.

[75]  R. Stickgold,et al.  Practice with Sleep Makes Perfect Sleep-Dependent Motor Skill Learning , 2002, Neuron.

[76]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[77]  Terrence J. Sejnowski,et al.  Delay Differential Analysis of Electroencephalographic Data , 2015, Neural Computation.

[78]  R. Tibshirani,et al.  Sparse inverse covariance estimation with the graphical lasso. , 2008, Biostatistics.

[79]  Thomas Penzel,et al.  Inter-rater agreement in sleep stage classification between centers with different backgrounds , 2008 .

[80]  Vinod Menon,et al.  Functional connectivity in the resting brain: A network analysis of the default mode hypothesis , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[81]  L. Parsons,et al.  Interregional connectivity to primary motor cortex revealed using MRI resting state images , 1999, Human brain mapping.

[82]  Eswar Damaraju,et al.  Tracking whole-brain connectivity dynamics in the resting state. , 2014, Cerebral cortex.

[83]  Christoforos Anagnostopoulos,et al.  Estimating time-varying brain connectivity networks from functional MRI time series , 2013, NeuroImage.

[84]  G. Tononi,et al.  Reduced sleep spindle activity in schizophrenia patients. , 2007, The American journal of psychiatry.

[85]  G. Lawton Why do we sleep? , 2000, Nature Neuroscience.

[86]  O. Sporns,et al.  Network centrality in the human functional connectome. , 2012, Cerebral cortex.

[87]  Scott T. Grafton,et al.  Dynamic reconfiguration of human brain networks during learning , 2010, Proceedings of the National Academy of Sciences.

[88]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[89]  Terrence J. Sejnowski,et al.  Interactive reportWhy do we sleep?1 , 2000 .

[90]  Maurizio Corbetta,et al.  The human brain is intrinsically organized into dynamic, anticorrelated functional networks. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[91]  Terrence J. Sejnowski,et al.  Non-Linear Dynamical Classification of Short Time Series of the Rössler System in High Noise Regimes , 2013, Front. Neurol..

[92]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[93]  Goran Marjanovic,et al.  On ${l}_{q}$ Optimization and Sparse Inverse Covariance Selection , 2014, IEEE Transactions on Signal Processing.

[94]  J. Born,et al.  Declarative memory consolidation: mechanisms acting during human sleep. , 2004, Learning & memory.

[95]  Vito Volterra,et al.  Theory of Functionals and of Integral and Integro-Differential Equations , 2005 .

[96]  Jean-Baptiste Poline,et al.  Brain covariance selection: better individual functional connectivity models using population prior , 2010, NIPS.