-
Bridging statistical mechanics and thermodynamics away from equilibrium: a data-driven approach for learning internal variables and their dynamics
Authors:
Weilun Qiu,
Shenglin Huang,
Celia Reina
Abstract:
Thermodynamics with internal variables is a common approach in continuum mechanics to model inelastic (i.e., non-equilibrium) material behavior. While this approach is computationally and theoretically attractive, it currently lacks a well-established statistical mechanics foundation. As a result, internal variables are typically chosen phenomenologically and lack a direct link to the underlying p…
▽ More
Thermodynamics with internal variables is a common approach in continuum mechanics to model inelastic (i.e., non-equilibrium) material behavior. While this approach is computationally and theoretically attractive, it currently lacks a well-established statistical mechanics foundation. As a result, internal variables are typically chosen phenomenologically and lack a direct link to the underlying physics which hinders the predictability of the theory. To address these challenges, we propose a machine learning approach that is consistent with the principles of statistical mechanics and thermodynamics. The proposed approach leverages the following techniques (i) the information bottleneck (IB) method to ensure that the learned internal variables are functions of the microstates and are capable of capturing the salient feature of the microscopic distribution; (ii) conditional normalizing flows to represent arbitrary probability distributions of the microscopic states as functions of the state variables; and (iii) Variational Onsager Neural Networks (VONNs) to guarantee thermodynamic consistency and Markovianity of the learned evolution equations. The resulting framework, called IB-VONNs, is tested on two problems of colloidal systems, governed at the microscale by overdamped Langevin dynamics. The first one is a prototypical model for a colloidal particle in an optical trap, which can be solved analytically, and thus ideal to verify the framework. The second problem is a one-dimensional phase-transforming system, whose macroscopic description still lacks a statistical mechanics foundation under general conditions. The results in both cases indicate that the proposed machine learning strategy can indeed bridge statistical mechanics and thermodynamics with internal variables away from equilibrium.
△ Less
Submitted 29 January, 2025;
originally announced January 2025.
-
Variational Onsager Neural Networks (VONNs): A thermodynamics-based variational learning strategy for non-equilibrium PDEs
Authors:
Shenglin Huang,
Zequn He,
Bryan Chem,
Celia Reina
Abstract:
We propose a thermodynamics-based learning strategy for non-equilibrium evolution equations based on Onsager's variational principle, which allows to write such PDEs in terms of two potentials: the free energy and the dissipation potential. Specifically, these two potentials are learned from spatio-temporal measurements of macroscopic observables via proposed neural network architectures that stro…
▽ More
We propose a thermodynamics-based learning strategy for non-equilibrium evolution equations based on Onsager's variational principle, which allows to write such PDEs in terms of two potentials: the free energy and the dissipation potential. Specifically, these two potentials are learned from spatio-temporal measurements of macroscopic observables via proposed neural network architectures that strongly enforce the satisfaction of the second law of thermodynamics. The method is applied to three distinct physical processes aimed at highlighting the robustness and versatility of the proposed approach. These include (i) the phase transformation of a coiled-coil protein, characterized by a non-convex free-energy density; (ii) the one-dimensional dynamic response of a three-dimensional viscoelastic solid, which leverages the variational formulation as a tool for obtaining reduced order models; and (iii) linear and nonlinear diffusion models, characterized by a lack of uniqueness of the free energy and dissipation potentials. These illustrative examples showcase the possibility of learning partial differential equations through their variational action density (i.e., a function instead), by leveraging the thermodynamic structure intrinsic to mechanical and multiphysics problems.
△ Less
Submitted 16 December, 2021;
originally announced December 2021.
-
Second-order fast-slow dynamics of non-ergodic Hamiltonian systems: Thermodynamic interpretation and simulation
Authors:
Matthias Klar,
Karsten Matthies,
Celia Reina,
Johannes Zimmer
Abstract:
A class of fast-slow Hamiltonian systems with potential $U_\varepsilon$ describing the interaction of non-ergodic fast and slow degrees of freedom is studied. The parameter $\varepsilon$ indicates the typical timescale ratio of the fast and slow degrees of freedom. It is known that the Hamiltonian system converges for $\varepsilon\to0$ to a homogenised Hamiltonian system. We study the situation wh…
▽ More
A class of fast-slow Hamiltonian systems with potential $U_\varepsilon$ describing the interaction of non-ergodic fast and slow degrees of freedom is studied. The parameter $\varepsilon$ indicates the typical timescale ratio of the fast and slow degrees of freedom. It is known that the Hamiltonian system converges for $\varepsilon\to0$ to a homogenised Hamiltonian system. We study the situation where $\varepsilon$ is small but positive. First, we rigorously derive the second-order corrections to the homogenised (slow) degrees of freedom. They can be decomposed into explicitly given terms that oscillate rapidly around zero and terms that trace the average motion of the corrections, which are given as the solution to an inhomogeneous linear system of differential equations. Then, we analyse the energy of the fast degrees of freedom expanded to second-order from a thermodynamic point of view. In particular, we define and expand to second-order a temperature, an entropy and external forces and show that they satisfy to leading-order, as well as on average to second-order, thermodynamic energy relations akin to the first and second law of thermodynamics. Finally, we analyse for a specific fast-slow Hamiltonian system the second-order asymptotic expansion of the slow degrees of freedom from a numerical point of view. Their approximation quality for short and long time frames and their total computation time are compared with those of the solution to the original fast-slow Hamiltonian system of similar accuracy.
△ Less
Submitted 12 November, 2021; v1 submitted 9 March, 2021;
originally announced March 2021.
-
How to find the evolution operator of dissipative PDEs from particle fluctuations?
Authors:
Xiaoguai Li,
Nicolas Dirr,
Peter Embacher,
Johannes Zimmer,
Celia Reina
Abstract:
Dissipative processes abound in most areas of sciences and can often be abstractly written as $\partial_t z = K(z) δS(z)/δz$, which is a gradient flow of the entropy $S$. Although various techniques have been developed to compute the entropy, the calculation of the operator $K$ from underlying particle models is a major long-standing challenge. Here, we show that discretizations of diffusion opera…
▽ More
Dissipative processes abound in most areas of sciences and can often be abstractly written as $\partial_t z = K(z) δS(z)/δz$, which is a gradient flow of the entropy $S$. Although various techniques have been developed to compute the entropy, the calculation of the operator $K$ from underlying particle models is a major long-standing challenge. Here, we show that discretizations of diffusion operators $K$ can be numerically computed from particle fluctuations via an infinite-dimensional fluctuation-dissipation relation, provided the particles are in local equilibrium with Gaussian fluctuations. A salient feature of the method is that $K$ can be fully pre-computed, enabling macroscopic simulations of arbitrary admissible initial data, without any need of further particle simulations. We test this coarse-graining procedure for a zero-range process in one space dimension and obtain an excellent agreement with the analytical solution for the macroscopic density evolution. This example serves as a blueprint for a new multiscale paradigm, where full dissipative evolution equations --- and not only parameters --- can be numerically computed from particles.
△ Less
Submitted 15 November, 2018; v1 submitted 15 May, 2018;
originally announced May 2018.
-
Entropy production and the geometry of dissipative evolution equations
Authors:
Celia Reina,
Johannes Zimmer
Abstract:
Purely dissipative evolution equations are often cast as gradient flow structures, $\dot{\mathbf{z}}=K(\mathbf{z})DS(\mathbf{z})$, where the variable $\mathbf{z}$ of interest evolves towards the maximum of a functional $S$ according to a metric defined by an operator $K$. While the functional often follows immediately from physical considerations (e.g., the thermodynamic entropy), the operator…
▽ More
Purely dissipative evolution equations are often cast as gradient flow structures, $\dot{\mathbf{z}}=K(\mathbf{z})DS(\mathbf{z})$, where the variable $\mathbf{z}$ of interest evolves towards the maximum of a functional $S$ according to a metric defined by an operator $K$. While the functional often follows immediately from physical considerations (e.g., the thermodynamic entropy), the operator $K$ and the associated geometry does not necessarily so (e.g., Wasserstein geometry for diffusion). In this paper, we present a variational statement in the sense of maximum entropy production that directly delivers a relationship between the operator $K$ and the constraints of the system. In particular, the Wasserstein metric naturally arises here from the conservation of mass or energy, and depends on the Onsager resistivity tensor, which, itself, may be understood as another metric, as in the Steepest Entropy Ascent formalism. This new variational principle is exemplified here for the simultaneous evolution of conserved and non-conserved quantities in open systems. It thus extends the classical Onsager flux-force relationships and the associated variational statement to variables that do not have a flux associated to them. We further show that the metric structure $K$ is intimately linked to the celebrated Freidlin-Wentzell theory of stochastically perturbed gradient flows, and that the proposed variational principle encloses an infinite-dimensional fluctuation-dissipation statement.
△ Less
Submitted 4 November, 2015; v1 submitted 1 July, 2015;
originally announced July 2015.
-
Gauged Laplacians on quantum Hopf bundles
Authors:
Giovanni Landi,
Cesare Reina,
Alessandro Zampini
Abstract:
We study gauged Laplacian operators on line bundles on a quantum 2-dimensional sphere. Symmetry under the (co)-action of a quantum group allows for their complete diagonalization. These operators describe `excitations moving on the quantum sphere' in the field of a magnetic monopole. The energies are not invariant under the exchange monopole/antimonopole, that is under inverting the direction of…
▽ More
We study gauged Laplacian operators on line bundles on a quantum 2-dimensional sphere. Symmetry under the (co)-action of a quantum group allows for their complete diagonalization. These operators describe `excitations moving on the quantum sphere' in the field of a magnetic monopole. The energies are not invariant under the exchange monopole/antimonopole, that is under inverting the direction of the magnetic field. There are potential applications to models of quantum Hall effect.
△ Less
Submitted 18 November, 2008; v1 submitted 22 January, 2008;
originally announced January 2008.
-
Noncommutative families of instantons
Authors:
Giovanni Landi,
Chiara Pagani,
Cesare Reina,
Walter D. van Suijlekom
Abstract:
We construct $θ$-deformations of the classical groups SL(2,H) and Sp(2). Coacting on the basic instanton on a noncommutative four-sphere $S^4_θ$, we construct a noncommutative family of instantons of charge 1. The family is parametrized by the quantum quotient of $SL_θ(2,H)$ by $Sp_θ(2)$.
We construct $θ$-deformations of the classical groups SL(2,H) and Sp(2). Coacting on the basic instanton on a noncommutative four-sphere $S^4_θ$, we construct a noncommutative family of instantons of charge 1. The family is parametrized by the quantum quotient of $SL_θ(2,H)$ by $Sp_θ(2)$.
△ Less
Submitted 15 May, 2008; v1 submitted 3 October, 2007;
originally announced October 2007.
-
Quantum spin coverings and statistics
Authors:
Ludwik Dabrowski,
Cesare Reina
Abstract:
SL_q(2) at odd roots of unity q^l =1 is studied as a quantum cover of the complex rotation group SO(3,C), in terms of the associated Hopf algebras of (quantum) polynomial functions. We work out the irreducible corepresentations, the decomposition of their tensor products and a coquasitriangular structure, with the associated braiding (or statistics). As an example, the case l=3 is discussed in d…
▽ More
SL_q(2) at odd roots of unity q^l =1 is studied as a quantum cover of the complex rotation group SO(3,C), in terms of the associated Hopf algebras of (quantum) polynomial functions. We work out the irreducible corepresentations, the decomposition of their tensor products and a coquasitriangular structure, with the associated braiding (or statistics). As an example, the case l=3 is discussed in detail.
△ Less
Submitted 14 August, 2002; v1 submitted 12 August, 2002;
originally announced August 2002.