Learning moment closure in reaction-diffusion systems with spatial dynamic Boltzmann distributions.

Many physical systems are described by probability distributions that evolve in both time and space. Modeling these systems is often challenging due to their large state space and analytically intractable or computationally expensive dynamics. To address these problems, we study a machine-learning approach to model reduction based on the Boltzmann machine. Given the form of the reduced model Boltzmann distribution, we introduce an autonomous differential equation system for the interactions appearing in the energy function. The reduced model can treat systems in continuous space (described by continuous random variables), for which we formulate a variational learning problem using the adjoint method to determine the right-hand sides of the differential equations. This approach can be used to enforce a reduced physical model by a suitable parametrization of the differential equations. The parametrization we employ uses the basis functions from finite-element methods, which can be used to model any physical system. One application domain for such physics-informed learning algorithms is to modeling reaction-diffusion systems. We study a lattice version of the Rössler chaotic oscillator, which illustrates the accuracy of the moment closure approximation made by the method and its dimensionality reduction power.

[1]  Erik De Schutter,et al.  Monte Carlo Methods for Simulating Realistic Synaptic Microphysiology Using MCell , 2000 .

[2]  Kun Zhao Fluid simulation with dynamic Boltzmann machine in batch manner , 2017 .

[3]  Diederich Hinrichsen,et al.  Mathematical Systems Theory I , 2006, IEEE Transactions on Automatic Control.

[4]  D. Mattis,et al.  The uses of quantum field theory in diffusion-limited reactions , 1998 .

[5]  Il Memming Park,et al.  BLACK BOX VARIATIONAL INFERENCE FOR STATE SPACE MODELS , 2015, 1511.07367.

[6]  L. Petzold,et al.  Reaction rates for mesoscopic reaction-diffusion kinetics. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[7]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[8]  Sami El Boustani,et al.  Prediction of spatiotemporal patterns of neural activity from pairwise correlations. , 2009, Physical review letters.

[9]  Heinz Koeppl,et al.  A variational approach to moment-closure approximations for the kinetics of biomolecular reaction networks. , 2017, The Journal of chemical physics.

[10]  G. W. Ford,et al.  Lectures in statistical mechanics , 1963 .

[11]  Jun Wang,et al.  Unsupervised Generative Modeling Using Matrix Product States , 2017, Physical Review X.

[12]  Scott B. Baden,et al.  Fast Monte Carlo Simulation Methods for Biological Reaction-Diffusion Systems in Solution and on Surfaces , 2008, SIAM J. Sci. Comput..

[13]  Tiago Ramalho,et al.  Simulation of stochastic network dynamics via entropic matching. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[15]  Eric Mjolsness,et al.  Learning dynamic Boltzmann distributions as reduced models of spatial chemical kinetics. , 2018, The Journal of chemical physics.

[16]  Geoffrey E. Hinton,et al.  Factored 3-Way Restricted Boltzmann Machines For Modeling Natural Images , 2010, AISTATS.

[17]  Geoffrey E. Hinton,et al.  Learning Multilevel Distributed Representations for High-Dimensional Sequences , 2007, AISTATS.

[18]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  John P. Cunningham,et al.  Linear dynamical neural population models through nonlinear embeddings , 2016, NIPS.

[20]  Terrence J. Sejnowski,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cognitive Sciences.

[21]  B. M. Fulk MATH , 1992 .

[22]  Shengtai Li,et al.  Adjoint Sensitivity Analysis for Differential-Algebraic Equations: The Adjoint DAE System and Its Numerical Solution , 2002, SIAM J. Sci. Comput..

[23]  M. Khammash,et al.  The finite state projection algorithm for the solution of the chemical master equation. , 2006, The Journal of chemical physics.

[24]  R. Herzog,et al.  Algorithms for PDE‐constrained optimization , 2010 .

[25]  C. Gardiner Stochastic Methods: A Handbook for the Natural and Social Sciences , 2009 .

[26]  Heinz Koeppl,et al.  Marginal process framework: A model reduction tool for Markov jump processes. , 2018, Physical review. E.

[27]  M. Doi Second quantization representation for classical many-particle system , 1976 .

[28]  Cyrus Shahabi,et al.  Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting , 2017, ICLR.

[29]  J. Herskowitz,et al.  Proceedings of the National Academy of Sciences, USA , 1996, Current Biology.

[30]  Otto E. Rössler,et al.  Irregular Oscillations in a Realistic Abstract Quadratic Mass Action System , 1980 .

[31]  Geoffrey E. Hinton,et al.  The Recurrent Temporal Restricted Boltzmann Machine , 2008, NIPS.

[32]  Giovanni Bellesia,et al.  Population dynamics, information transfer, and spatial organization in a chemical reaction network under spatial confinement and crowding conditions. , 2016, Physical review. E.

[33]  Eric Mjolsness,et al.  Model reduction for stochastic CaMKII reaction kinetics in synapses by graph-constrained correlation dynamics. , 2015, Physical biology.

[34]  Eric Mjolsness,et al.  Prospects for Declarative Mathematical Modeling of Complex Biological Systems , 2018, Bulletin of Mathematical Biology.

[35]  A. V. Balakrishnan,et al.  Symposium on Optimization , 1970 .

[36]  Takayuki Osogami,et al.  Seven neurons memorizing sequences of alphabetical images via spike-timing dependent plasticity , 2015, Scientific Reports.

[37]  Henry D. I. Abarbanel,et al.  Predicting the Future: Completing Models of Observed Complex Systems , 2013 .

[38]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Andreas Ruttor,et al.  Efficient statistical inference for stochastic reaction processes. , 2009, Physical review letters.

[40]  Tretyakov,et al.  Extinction, survival, and dynamical phase transition of branching annihilating random walk. , 1992, Physical review letters.

[41]  G. A. Okrokvertskhov,et al.  Statistical properties of dynamical chaos. , 2004, Mathematical biosciences and engineering : MBE.

[42]  Takayuki Osogami,et al.  Nonlinear Dynamic Boltzmann Machines for Time-Series Prediction , 2017, AAAI.

[43]  David J. Schwab,et al.  A high-bias, low-variance introduction to Machine Learning for physicists , 2018, Physics reports.

[44]  Geoffrey E. Hinton,et al.  Variational Learning for Switching State-Space Models , 2000, Neural Computation.

[45]  Matthias Troyer,et al.  Solving the quantum many-body problem with artificial neural networks , 2016, Science.

[46]  Cian O'Donnell,et al.  The population tracking model: A simple, scalable statistical model for neural population data , 2016, bioRxiv.

[47]  G. Kane Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[48]  R. V. Gamkrelidze,et al.  Extremal problems in linear topological spaces. I. , 2005, Mathematical systems theory.

[49]  Yiannis N. Kaznessis,et al.  A closure scheme for chemical master equations , 2013, Proceedings of the National Academy of Sciences.

[50]  Henry D. I. Abarbanel,et al.  Predicting the Future , 2013 .

[51]  Cian O'Donnell,et al.  The population tracking model: A simple, scalable statistical model for neural population data , 2016 .

[52]  Marco Gori,et al.  Adaptive Processing of Sequences and Data Structures , 1998, Lecture Notes in Computer Science.

[53]  L. Goddard Information Theory , 1962, Nature.

[54]  Paul Smolensky,et al.  Information processing in dynamical systems: foundations of harmony theory , 1986 .

[55]  Philipp Thomas,et al.  Rigorous elimination of fast stochastic variables from the linear noise approximation using projection operators. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[56]  S. Dreyfus The numerical solution of variational problems , 1962 .

[57]  Dizan Vasquez,et al.  A survey on motion prediction and risk assessment for intelligent vehicles , 2014 .