-
Data-driven dynamical coarse-graining for condensed matter systems
Authors:
Mauricio J. del Razo,
Daan Crommelin,
Peter G. Bolhuis
Abstract:
Simulations of condensed matter systems often focus on the dynamics of a few distinguished components but require integrating the dynamics of the full system. A prime example is a molecular dynamics simulation of a (macro)molecule in solution, where both the molecules(s) and the solvent dynamics needs to be integrated. This renders the simulations computationally costly and often unfeasible for ph…
▽ More
Simulations of condensed matter systems often focus on the dynamics of a few distinguished components but require integrating the dynamics of the full system. A prime example is a molecular dynamics simulation of a (macro)molecule in solution, where both the molecules(s) and the solvent dynamics needs to be integrated. This renders the simulations computationally costly and often unfeasible for physically or biologically relevant time scales. Standard coarse graining approaches are capable of reproducing equilibrium distributions and structural features but do not properly include the dynamics. In this work, we develop a stochastic data-driven coarse-graining method inspired by the Mori-Zwanzig formalism. This formalism shows that macroscopic systems with a large number of degrees of freedom can in principle be well described by a small number of relevant variables plus additional noise and memory terms. Our coarse-graining method consists of numerical integrators for the distinguished components of the system, where the noise and interaction terms with other system components are substituted by a random variable sampled from a data-driven model. Applying our methodology on three different systems -- a distinguished particle under a harmonic potential and under a bistable potential; and a dimer with two metastable configurations -- we show that the resulting coarse-grained models are not only capable of reproducing the correct equilibrium distributions but also the dynamic behavior due to temporal correlations and memory effects. Our coarse-graining method requires data from full-scale simulations to be parametrized, and can in principle be extended to different types of models beyond Langevin dynamics.
△ Less
Submitted 30 June, 2023;
originally announced June 2023.
-
Stochastic parameterization with VARX processes
Authors:
Nick Verheul,
Daan Crommelin
Abstract:
In this study we investigate a data-driven stochastic methodology to parameterize small-scale features in a prototype multiscale dynamical system, the Lorenz '96 (L96) model. We propose to model the small-scale features using a vector autoregressive process with exogenous variable (VARX), estimated from given sample data. To reduce the number of parameters of the VARX we impose a diagonal structur…
▽ More
In this study we investigate a data-driven stochastic methodology to parameterize small-scale features in a prototype multiscale dynamical system, the Lorenz '96 (L96) model. We propose to model the small-scale features using a vector autoregressive process with exogenous variable (VARX), estimated from given sample data. To reduce the number of parameters of the VARX we impose a diagonal structure on its coefficient matrices. We apply the VARX to two different configurations of the 2-layer L96 model, one with common parameter choices giving unimodal invariant probability distributions for the L96 model variables, and one with non-standard parameters giving trimodal distributions. We show through various statistical criteria that the proposed VARX performs very well for the unimodal configuration, while keeping the number of parameters linear in the number of model variables. We also show that the parameterization performs accurately for the very challenging trimodal L96 configuration by allowing for a dense (non-diagonal) VARX covariance matrix.
△ Less
Submitted 7 October, 2020;
originally announced October 2020.
-
Resampling with neural networks for stochastic parameterization in multiscale systems
Authors:
Daan Crommelin,
Wouter Edeling
Abstract:
In simulations of multiscale dynamical systems, not all relevant processes can be resolved explicitly. Taking the effect of the unresolved processes into account is important, which introduces the need for paramerizations. We present a machine-learning method, used for the conditional resampling of observations or reference data from a fully resolved simulation. It is based on the probabilistic cl…
▽ More
In simulations of multiscale dynamical systems, not all relevant processes can be resolved explicitly. Taking the effect of the unresolved processes into account is important, which introduces the need for paramerizations. We present a machine-learning method, used for the conditional resampling of observations or reference data from a fully resolved simulation. It is based on the probabilistic classiffcation of subsets of reference data, conditioned on macroscopic variables. This method is used to formulate a parameterization that is stochastic, taking the uncertainty of the unresolved scales into account. We validate our approach on the Lorenz 96 system, using two different parameter settings which are challenging for parameterization methods.
△ Less
Submitted 3 April, 2020;
originally announced April 2020.
-
Stochastic Climate Theory
Authors:
Georg A. Gottwald,
Daan T. Crommelin,
Christian L. E. Franzke
Abstract:
In this chapter we review stochastic modelling methods in climate science. First we provide a conceptual framework for stochastic modelling of deterministic dynamical systems based on the Mori-Zwanzig formalism. The Mori-Zwanzig equations contain a Markov term, a memory term and a term suggestive of stochastic noise. Within this framework we express standard model reduction methods such as averagi…
▽ More
In this chapter we review stochastic modelling methods in climate science. First we provide a conceptual framework for stochastic modelling of deterministic dynamical systems based on the Mori-Zwanzig formalism. The Mori-Zwanzig equations contain a Markov term, a memory term and a term suggestive of stochastic noise. Within this framework we express standard model reduction methods such as averaging and homogenization which eliminate the memory term. We further discuss ways to deal with the memory term and how the type of noise depends on the underlying deterministic chaotic system. Secondly, we review current approaches in stochastic data-driven models. We discuss how the drift and diffusion coefficients of models in the form of stochastic differential equations can be estimated from observational data. We pay attention to situations where the data stems from multi scale systems, a relevant topic in the context of data from the climate system. Furthermore, we discuss the use of discrete stochastic processes (Markov chains) for e.g. stochastic subgrid-scale modeling and other topics in climate science.
△ Less
Submitted 22 December, 2016;
originally announced December 2016.
-
Stochastic Parameterization: Towards a new view of Weather and Climate Models
Authors:
Judith Berner,
Ulrich Achatz,
Lauriane Batte,
Lisa Bengtsson,
Alvaro De La Camara,
Daan Crommelin,
Hannah Christensen,
Matteo Colangeli,
Stamen Dolaptchiev,
Christian L. E. Franzke,
Petra Friederichs,
Peter Imkeller,
Heikki Jarvinen,
Stephan Juricke,
Vassili Kitsios,
Franois Lott,
Valerio Lucarini,
Salil Mahajan,
Timothy N. Palmer,
Cecile Penland,
Jin-Song Von Storch,
Mirjana Sakradzija,
Michael Weniger,
Antje Weisheimer,
Paul D. Williams
, et al. (1 additional authors not shown)
Abstract:
The last decade has seen the success of stochastic parameterizations in short-term, medium-range and seasonal forecasts: operational weather centers now routinely use stochastic parameterization schemes to better represent model inadequacy and improve the quantification of forecast uncertainty. Developed initially for numerical weather prediction, the inclusion of stochastic parameterizations not…
▽ More
The last decade has seen the success of stochastic parameterizations in short-term, medium-range and seasonal forecasts: operational weather centers now routinely use stochastic parameterization schemes to better represent model inadequacy and improve the quantification of forecast uncertainty. Developed initially for numerical weather prediction, the inclusion of stochastic parameterizations not only provides better estimates of uncertainty, but it is also extremely promising for reducing longstanding climate biases and relevant for determining the climate response to external forcing. This article highlights recent developments from different research groups which show that the stochastic representation of unresolved processes in the atmosphere, oceans, land surface and cryosphere of comprehensive weather and climate models (a) gives rise to more reliable probabilistic forecasts of weather and climate and (b) reduces systematic model bias. We make a case that the use of mathematically stringent methods for the derivation of stochastic dynamic equations will lead to substantial improvements in our ability to accurately simulate weather and climate at all scales. Recent work in mathematics, statistical mechanics and turbulence is reviewed, its relevance for the climate problem demonstrated, and future research directions outlined.
△ Less
Submitted 20 March, 2017; v1 submitted 29 October, 2015;
originally announced October 2015.