-
New universal Lyapunov functions for non-linear reaction networks
Authors:
A. N. Gorban
Abstract:
In 1961, Rényi discovered a rich family of non-classical Lyapunov functions for kinetics of the Markov chains, or, what is the same, for the linear kinetic equations. This family was parameterised by convex functions on the positive semi-axis. After works of Csiszár and Morimoto, these functions became widely known as $f$-divergences or the Csiszár--Morimoto divergences. These Lyapunov functions a…
▽ More
In 1961, Rényi discovered a rich family of non-classical Lyapunov functions for kinetics of the Markov chains, or, what is the same, for the linear kinetic equations. This family was parameterised by convex functions on the positive semi-axis. After works of Csiszár and Morimoto, these functions became widely known as $f$-divergences or the Csiszár--Morimoto divergences. These Lyapunov functions are universal in the following sense: they depend only on the state of equilibrium, not on the kinetic parameters themselves.
Despite many years of research, no such wide family of universal Lyapunov functions has been found for nonlinear reaction networks. For general non-linear networks with detailed or complex balance, the classical thermodynamics potentials remain the only universal Lyapunov functions.
We constructed a rich family of new universal Lyapunov functions for {\em any non-linear reaction network} with detailed or complex balance. These functions are parameterised by compact subsets of the projective space. They are universal in the same sense: they depend only on the state of equilibrium and on the network structure, but not on the kinetic parameters themselves.
The main elements and operations in the construction of the new Lyapunov functions are partial equilibria of reactions and convex envelopes of families of functions.
△ Less
Submitted 17 July, 2019; v1 submitted 14 February, 2019;
originally announced February 2019.
-
Hilbert's Sixth Problem: the endless road to rigour
Authors:
Alexander N. Gorban
Abstract:
Introduction to the special issue of Phil. Trans. R. Soc. A 376, 2018, `Hilbert's Sixth Problem'. The essence of the Sixth Problem is discussed and the content of this issue is introduced.
In 1900, David Hilbert presented 23 problems for the advancement of mathematical science. Hilbert's Sixth Problem proposed the expansion of the axiomatic method outside of mathematics, in physics and beyond. I…
▽ More
Introduction to the special issue of Phil. Trans. R. Soc. A 376, 2018, `Hilbert's Sixth Problem'. The essence of the Sixth Problem is discussed and the content of this issue is introduced.
In 1900, David Hilbert presented 23 problems for the advancement of mathematical science. Hilbert's Sixth Problem proposed the expansion of the axiomatic method outside of mathematics, in physics and beyond. Its title was shocking: "Mathematical Treatment of the Axioms of Physics." Axioms of physics did not exist and were not expected. During further explanation, Hilbert specified this problem with special focus on probability and "the limiting processes, ... which lead from the atomistic view to the laws of motion of continua". The programmatic call was formulated "to treat, by means of axioms, those physical sciences in which already today mathematics plays an important part." This issue presents a modern slice of the work on the Sixth Problem, from quantum probability to fluid dynamics and machine learning, and from review of solid mathematical and physical results to opinion pieces with new ambitious ideas. Some expectations were broken: The continuum limit of atomistic kinetics may differ from the classical fluid dynamics. The "curse of dimensionality" in machine learning turns into the "blessing of dimensionality" that is closely related to statistical physics. Quantum probability facilitates the modelling of geological uncertainty and hydrocarbon reservoirs. And many other findings are presented.
△ Less
Submitted 9 March, 2018;
originally announced March 2018.
-
Hilbert's 6th Problem: Exact and Approximate Hydrodynamic Manifolds for Kinetic Equations
Authors:
A. N. Gorban,
I. Karlin
Abstract:
The problem of the derivation of hydrodynamics from the Boltzmann equation and related dissipative systems is formulated as the problem of slow invariant manifold in the space of distributions. We review a few instances where such hydrodynamic manifolds were found analytically both as the result of summation of the Chapman--Enskog asymptotic expansion and by the direct solution of the invariance e…
▽ More
The problem of the derivation of hydrodynamics from the Boltzmann equation and related dissipative systems is formulated as the problem of slow invariant manifold in the space of distributions. We review a few instances where such hydrodynamic manifolds were found analytically both as the result of summation of the Chapman--Enskog asymptotic expansion and by the direct solution of the invariance equation. These model cases, comprising Grad's moment systems, both linear and nonlinear, are studied in depth in order to gain understanding of what can be expected for the Boltzmann equation. Particularly, the dispersive dominance and saturation of dissipation rate of the exact hydrodynamics in the short-wave limit and the viscosity modification at high divergence of the flow velocity are indicated as severe obstacles to the resolution of Hilbert's 6th Problem. Furthermore, we review the derivation of the approximate hydrodynamic manifold for the Boltzmann equation using Newton's iteration and avoiding smallness parameters, and compare this to the exact solutions. Additionally, we discuss the problem of projection of the Boltzmann equation onto the approximate hydrodynamic invariant manifold using entropy concepts. Finally, a set of hypotheses is put forward where we describe open questions and set a horizon for what can be derived exactly or proven about the hydrodynamic manifolds for the Boltzmann equation in the future.
△ Less
Submitted 3 October, 2013; v1 submitted 1 October, 2013;
originally announced October 2013.
-
Selection theorem for systems with inheritance
Authors:
A. N. Gorban
Abstract:
The problem of finite-dimensional asymptotics of infinite-dimensional dynamic systems is studied. A non-linear kinetic system with conservation of supports for distributions has generically finite-dimensional asymptotics. Such systems are apparent in many areas of biology, physics (the theory of parametric wave interaction), chemistry and economics. This conservation of support has a biological…
▽ More
The problem of finite-dimensional asymptotics of infinite-dimensional dynamic systems is studied. A non-linear kinetic system with conservation of supports for distributions has generically finite-dimensional asymptotics. Such systems are apparent in many areas of biology, physics (the theory of parametric wave interaction), chemistry and economics. This conservation of support has a biological interpretation: inheritance. The finite-dimensional asymptotics demonstrates effects of "natural" selection. Estimations of the asymptotic dimension are presented. After some initial time, solution of a kinetic equation with conservation of support becomes a finite set of narrow peaks that become increasingly narrow over time and move increasingly slowly. It is possible that these peaks do not tend to fixed positions, and the path covered tends to infinity as t goes to infinity. The drift equations for peak motion are obtained. Various types of distribution stability are studied: internal stability (stability with respect to perturbations that do not extend the support), external stability or uninvadability (stability with respect to strongly small perturbations that extend the support), and stable realizability (stability with respect to small shifts and extensions of the density peaks). Models of self-synchronization of cell division are studied, as an example of selection in systems with additional symmetry. Appropriate construction of the notion of typicalness in infinite-dimensional space is discussed, and the notion of "completely thin" sets is introduced.
Key words: Dynamics; Attractor; Evolution; Entropy; Natural selection
△ Less
Submitted 3 October, 2008; v1 submitted 19 May, 2004;
originally announced May 2004.
-
Constructive Methods of Invariant Manifolds for Kinetic Problems
Authors:
A. N. Gorban,
I. V. Karlin,
A. Yu. Zinovyev
Abstract:
We present the Constructive Methods of Invariant Manifolds for model reduction in physical and chemical kinetics, developed during last two decades. The problem of reduced description is studied as a problem of constructing the slow invariant manifold. The invariance conditions are formulated as the differential equation for a manifold immersed in the phase space (the invariance equation). The e…
▽ More
We present the Constructive Methods of Invariant Manifolds for model reduction in physical and chemical kinetics, developed during last two decades. The problem of reduced description is studied as a problem of constructing the slow invariant manifold. The invariance conditions are formulated as the differential equation for a manifold immersed in the phase space (the invariance equation). The equation of motion for immersed manifolds is obtained (the film extension of the dynamics). Invariant manifolds are fixed points for this equation, and slow invariant manifolds are Lyapunov stable fixed points, thus slowness is presented as stability. A collection of methods for construction of slow invariant manifolds is presented, in particular the analogue of KAM methods for dissipative systems. We systematically consider a discrete analogue of the slow (stable) positively invariant manifolds for dissipative systems, invariant grids. The following examples of applications are presented: Nonperturbative deviation of physically consistent hydrodynamics from the Boltzmann equation and from the reversible dynamics, for Knudsen numbers ~ 1; construction of the moment equations for nonequilibrium media and their dynamical correction (instead of extension of list of variables) to gain more accuracy in description of highly nonequilibrium flows; invariant grids for chemical reactions; universal continuous media description of dilute polymeric solution, etc.
△ Less
Submitted 13 April, 2004; v1 submitted 2 November, 2003;
originally announced November 2003.
-
Uniqueness of thermodynamic projector and kinetic basis of molecular individualism
Authors:
A. N. Gorban,
I. V. Karlin
Abstract:
Three results are presented: First, we solve the problem of persistence of dissipation for reduction of kinetic models. Kinetic equations with thermodynamic Lyapunov functions are studied. Uniqueness of the thermodynamic projector is proven: There exists only one projector which transforms the arbitrary vector field equipped with the given Lyapunov function into a vector field with the same Lyap…
▽ More
Three results are presented: First, we solve the problem of persistence of dissipation for reduction of kinetic models. Kinetic equations with thermodynamic Lyapunov functions are studied. Uniqueness of the thermodynamic projector is proven: There exists only one projector which transforms the arbitrary vector field equipped with the given Lyapunov function into a vector field with the same Lyapunov function for a given anzatz manifold which is not tangent to the Lyapunov function levels. Moreover, from the requirement of persistence of the {\it sign} of dissipation follows that the {\it value} of dissipation (the entropy production) persists too. The explicit construction of this {\it thermodynamic projector} is described. Second, we use this projector for developing the short memory approximation and coarse-graining for general nonlinear dynamic systems. We prove that in this approximation the entropy production grows. ({\it The theorem about entropy overproduction.}) In example we apply the thermodynamic projector to derivation the equations of reduced kinetics for the Fokker-Planck equation. The new class of closures is developed: The kinetic multipeak polyhedrons. Distributions of this type are expected to appear in each kinetic model with multidimensional instability as universally, as Gaussian distribution appears for stable systems. The number of possible relatively stable states of nonequilibrium system grows as $2^m$, and the number of macroscopic parameters is in order $mn$, where $n$ is the dimension of configuration space, and $m$ is the number of independent unstable directions in this space. The elaborated class of closures and equations pretends to describe the effects of "molecular individualism". This is the third result.
△ Less
Submitted 5 April, 2004; v1 submitted 27 September, 2003;
originally announced September 2003.
-
Legendre Integrators, Post-Processing and Quasiequilibrium
Authors:
A. N. Gorban,
P. A. Gorban,
I. V. Karlin
Abstract:
A toolbox for the development and reduction of the dynamical models of nonequilibrium systems is presented. The main components of this toolbox are: Legendre integrators, dynamical postprocessing, and thermodynamic projector.
Thermodynamic projector is the tool to transform almost arbitrary anzatz to a thermodynamically consistent model, the postprocessing is the cheapest way to improve the so…
▽ More
A toolbox for the development and reduction of the dynamical models of nonequilibrium systems is presented. The main components of this toolbox are: Legendre integrators, dynamical postprocessing, and thermodynamic projector.
Thermodynamic projector is the tool to transform almost arbitrary anzatz to a thermodynamically consistent model, the postprocessing is the cheapest way to improve the solution, obtained by the Legendre integrators. Legendre Integrators give the opportunity to solve linear equations instead of nonlinear ones for quasiequilibrium (MaxEnt) approximations.
The essentially new element of this toolbox, the method of thermodynamic projector, is demonstrated on application to FENE-P model of polymer kinetic theory. The multy-peak model of polymer dynamics is developed. The simplest example, discussed in details, is the two peaks model for Gaussian manifold instability in polymer dynamics. This type of models opens a way to create the computational models for the "molecular individualism".
△ Less
Submitted 25 August, 2003;
originally announced August 2003.
-
Geometry of irreversibility: The film of nonequilibrium states
Authors:
A. N. Gorban,
I. V. Karlin
Abstract:
A general geometrical framework of nonequilibrium thermodynamics is developed. The notion of macroscopically definable ensembles is developed. The thesis about macroscopically definable ensembles is suggested. This thesis should play the same role in the nonequilibrium thermodynamics, as the Church-Turing thesis in the theory of computability. The primitive macroscopically definable ensembles ar…
▽ More
A general geometrical framework of nonequilibrium thermodynamics is developed. The notion of macroscopically definable ensembles is developed. The thesis about macroscopically definable ensembles is suggested. This thesis should play the same role in the nonequilibrium thermodynamics, as the Church-Turing thesis in the theory of computability. The primitive macroscopically definable ensembles are described. These are ensembles with macroscopically prepared initial states. The method for computing trajectories of primitive macroscopically definable nonequilibrium ensembles is elaborated. These trajectories are represented as sequences of deformed equilibrium ensembles and simple quadratic models between them. The primitive macroscopically definable ensembles form the manifold in the space of ensembles. We call this manifold the film of nonequilibrium states. The equation for the film and the equation for the ensemble motion on the film are written down. The notion of the invariant film of non-equilibrium states, and the method of its approximate construction transform the the problem of nonequilibrium kinetics into a series of problems of equilibrium statistical physics. The developed methods allow us to solve the problem of macro-kinetics even when there are no autonomous equations of macro-kinetics.
△ Less
Submitted 17 August, 2003;
originally announced August 2003.
-
Generalized Additive Entropies in Fully Developed Turbulence
Authors:
Patrick Ilg,
Iliya V. Karlin,
Alexander N. Gorban
Abstract:
We explore a possible application of the additive generalization of the Boltzmann-Gibbs-Shannon entropy proposed in [A.N. Gorban, I.V. Karlin, Phys. Rev. E, 67:016104 (2003)] to fully developed turbulence. The predicted probability distribution functions are compared with those obtained from Tsallis' entropy and with experimental data. Consequences of the existence of hidden subsystems are illus…
▽ More
We explore a possible application of the additive generalization of the Boltzmann-Gibbs-Shannon entropy proposed in [A.N. Gorban, I.V. Karlin, Phys. Rev. E, 67:016104 (2003)] to fully developed turbulence. The predicted probability distribution functions are compared with those obtained from Tsallis' entropy and with experimental data. Consequences of the existence of hidden subsystems are illustrated.
△ Less
Submitted 28 May, 2003;
originally announced May 2003.
-
Quasi-Equilibrium Closure Hierarchies for The Boltzmann Equation
Authors:
A. N. Gorban,
I. V. Karlin
Abstract:
In this paper, explicit method of constructing approximations (the Triangle Entropy Method) is developed for nonequilibrium problems. This method enables one to treat any complicated nonlinear functionals that fit best the physics of a problem (such as, for example, rates of processes) as new independent variables.
The work of the method was demonstrated on the Boltzmann's--type kinetics. New…
▽ More
In this paper, explicit method of constructing approximations (the Triangle Entropy Method) is developed for nonequilibrium problems. This method enables one to treat any complicated nonlinear functionals that fit best the physics of a problem (such as, for example, rates of processes) as new independent variables.
The work of the method was demonstrated on the Boltzmann's--type kinetics. New macroscopic variables are introduced (moments of the Boltzmann collision integral, or scattering rates). They are treated as independent variables rather than as infinite moment series. This approach gives the complete account of rates of scattering processes. Transport equations for scattering rates are obtained (the second hydrodynamic chain), similar to the usual moment chain (the first hydrodynamic chain). Various examples of the closure of the first, of the second, and of the mixed hydrodynamic chains are considered for the hard spheres model. It is shown, in particular, that the complete account of scattering processes leads to a renormalization of transport coefficients.
The method gives the explicit solution for the closure problem, provides thermodynamic properties of reduced models, and can be applied to any kinetic equation with a thermodynamic Lyapunov function.
△ Less
Submitted 25 May, 2005; v1 submitted 26 May, 2003;
originally announced May 2003.
-
Irreversibility in the short memory approximation
Authors:
Iliya V. Karlin,
Larisa L. Tatarinova,
Alexander N. Gorban,
Hans Christian Ottinger
Abstract:
A recently introduced systematic approach to derivations of the macroscopic dynamics from the underlying microscopic equations of motions in the short-memory approximation [Gorban et al, Phys. Rev. E, 63, 066124 (2001)] is presented in detail. The essence of this method is a consistent implementation of Ehrenfest's idea of coarse-graining, realized via a matched expansion of both the microscopic…
▽ More
A recently introduced systematic approach to derivations of the macroscopic dynamics from the underlying microscopic equations of motions in the short-memory approximation [Gorban et al, Phys. Rev. E, 63, 066124 (2001)] is presented in detail. The essence of this method is a consistent implementation of Ehrenfest's idea of coarse-graining, realized via a matched expansion of both the microscopic and the macroscopic motions. Applications of this method to a derivation of the nonlinear Vlasov-Fokker-Planck equation, diffusion equation and hydrodynamic equations of the fluid with a long-range mean field interaction are presented in full detail. The advantage of the method is illustrated by the computation of the post-Navier-Stokes approximation of the hydrodynamics which is shown to be stable unlike the Burnett hydrodynamics.
△ Less
Submitted 18 May, 2003;
originally announced May 2003.
-
Hydrodynamics from Grad's equations: What can we learn from exact solutions?
Authors:
Iliya V. Karlin,
Alexander N. Gorban
Abstract:
A detailed treatment of the classical Chapman-Enskog derivation of hydrodynamics is given in the framework of Grad's moment equations. Grad's systems are considered as the minimal kinetic models where the Chapman-Enskog method can be studied exactly, thereby providing the basis to compare various approximations in extending the hydrodynamic description beyond the Navier-Stokes approximation. Vario…
▽ More
A detailed treatment of the classical Chapman-Enskog derivation of hydrodynamics is given in the framework of Grad's moment equations. Grad's systems are considered as the minimal kinetic models where the Chapman-Enskog method can be studied exactly, thereby providing the basis to compare various approximations in extending the hydrodynamic description beyond the Navier-Stokes approximation. Various techniques, such as the method of partial summation, Pade approximants, and invariance principle are compared both in linear and nonlinear situations.
△ Less
Submitted 14 October, 2012; v1 submitted 24 September, 2002;
originally announced September 2002.
-
The additive generalization of the Boltzmann entropy
Authors:
Alexander N. Gorban,
Iliya V. Karlin,
Hans Christian Ottinger
Abstract:
There exists only one generalization of the classical Boltzmann-Gibbs-Shannon entropy functional to a one-parametric family of additive entropy functionals. We find analytical solution to the corresponding extension of the classical ensembles, and discuss in some detail the example of the deformation of the uncorrelated state.
There exists only one generalization of the classical Boltzmann-Gibbs-Shannon entropy functional to a one-parametric family of additive entropy functionals. We find analytical solution to the corresponding extension of the classical ensembles, and discuss in some detail the example of the deformation of the uncorrelated state.
△ Less
Submitted 13 September, 2002;
originally announced September 2002.
-
Family of additive entropy functions out of thermodynamic limit
Authors:
Alexander N. Gorban,
Iliya V. Karlin
Abstract:
Starting with the additivity condition for Lyapunov functions of master equation, we derive a one-parametric family of entropy functions which may be appropriate for a description of certain effects of finiteness of statistical systems, in particular, distribution functions with long tails. This one-parametric family is different from Tsallis entropies, and is essentially a convex combination of…
▽ More
Starting with the additivity condition for Lyapunov functions of master equation, we derive a one-parametric family of entropy functions which may be appropriate for a description of certain effects of finiteness of statistical systems, in particular, distribution functions with long tails. This one-parametric family is different from Tsallis entropies, and is essentially a convex combination of the Boltzmann-Gibbs-Shannon entropy and the entropy function introduced by Burg. An example of how longer tails are described within the present approach is worked out for the canonical ensemble. In addition, we discuss a possible origin of a hidden statistical dependence, and give explicit recipes how to construct corresponding generalizations of master equation.
△ Less
Submitted 24 May, 2002;
originally announced May 2002.
-
Singularities of Transition Processes in Dynamical Systems: Qualitative Theory of Critical Delays
Authors:
A. N. Gorban
Abstract:
The paper gives a systematic analysis of singularities of transition processes in dynamical systems. General dynamical systems with dependence on parameter are studied. A system of relaxation times is constructed. Each relaxation time depends on three variables: initial conditions, parameters $k$ of the system and accuracy $ε$ of the relaxation. The singularities of relaxation times as functions…
▽ More
The paper gives a systematic analysis of singularities of transition processes in dynamical systems. General dynamical systems with dependence on parameter are studied. A system of relaxation times is constructed. Each relaxation time depends on three variables: initial conditions, parameters $k$ of the system and accuracy $ε$ of the relaxation. The singularities of relaxation times as functions of $(x_0,k)$ under fixed $ε$ are studied. The classification of different bifurcations (explosions) of limit sets is performed. The relations between the singularities of relaxation times and bifurcations of limit sets are studied. The peculiarities of dynamics which entail singularities of transition processes without bifurcations are described as well. The analogue of the Smale order for general dynamical systems under perturbations is constructed. It is shown that the perturbations simplify the situation: the interrelations between the singularities of relaxation times and other peculiarities of dynamics for general dynamical system under small perturbations are the same as for the Morse-Smale systems.
△ Less
Submitted 18 June, 2004; v1 submitted 19 March, 1997;
originally announced March 1997.
