-
The entropy production of stationary diffusions
Authors:
Lancelot Da Costa,
Grigorios A. Pavliotis
Abstract:
The entropy production rate is a central quantity in non-equilibrium statistical physics, scoring how far a stochastic process is from being time-reversible. In this paper, we compute the entropy production of diffusion processes at non-equilibrium steady-state under the condition that the time-reversal of the diffusion remains a diffusion. We start by characterising the entropy production of both…
▽ More
The entropy production rate is a central quantity in non-equilibrium statistical physics, scoring how far a stochastic process is from being time-reversible. In this paper, we compute the entropy production of diffusion processes at non-equilibrium steady-state under the condition that the time-reversal of the diffusion remains a diffusion. We start by characterising the entropy production of both discrete and continuous-time Markov processes. We investigate the time-reversal of time-homogeneous stationary diffusions and recall the most general conditions for the reversibility of the diffusion property, which includes hypoelliptic and degenerate diffusions, and locally Lipschitz vector fields. We decompose the drift into its time-reversible and irreversible parts, or equivalently, the generator into symmetric and antisymmetric operators. We show the equivalence with a decomposition of the backward Kolmogorov equation considered in hypocoercivity theory, and a decomposition of the Fokker-Planck equation in GENERIC form. The main result shows that when the time-irreversible part of the drift is in the range of the volatility matrix (almost everywhere) the forward and time-reversed path space measures of the process are mutually equivalent, and evaluates the entropy production. When this does not hold, the measures are mutually singular and the entropy production is infinite. We verify these results using exact numerical simulations of linear diffusions. We illustrate the discrepancy between the entropy production of non-linear diffusions and their numerical simulations in several examples and illustrate how the entropy production can be used for accurate numerical simulation. Finally, we discuss the relationship between time-irreversibility and sampling efficiency, and how we can modify the definition of entropy production to score how far a process is from being generalised reversible.
△ Less
Submitted 16 June, 2023; v1 submitted 9 December, 2022;
originally announced December 2022.
-
On Bayesian Mechanics: A Physics of and by Beliefs
Authors:
Maxwell J. D. Ramstead,
Dalton A. R. Sakthivadivel,
Conor Heins,
Magnus Koudahl,
Beren Millidge,
Lancelot Da Costa,
Brennan Klein,
Karl J. Friston
Abstract:
The aim of this paper is to introduce a field of study that has emerged over the last decade called Bayesian mechanics. Bayesian mechanics is a probabilistic mechanics, comprising tools that enable us to model systems endowed with a particular partition (i.e., into particles), where the internal states (or the trajectories of internal states) of a particular system encode the parameters of beliefs…
▽ More
The aim of this paper is to introduce a field of study that has emerged over the last decade called Bayesian mechanics. Bayesian mechanics is a probabilistic mechanics, comprising tools that enable us to model systems endowed with a particular partition (i.e., into particles), where the internal states (or the trajectories of internal states) of a particular system encode the parameters of beliefs about external states (or their trajectories). These tools allow us to write down mechanical theories for systems that look as if they are estimating posterior probability distributions over the causes of their sensory states. This provides a formal language for modelling the constraints, forces, potentials, and other quantities determining the dynamics of such systems, especially as they entail dynamics on a space of beliefs (i.e., on a statistical manifold). Here, we will review the state of the art in the literature on the free energy principle, distinguishing between three ways in which Bayesian mechanics has been applied to particular systems (i.e., path-tracking, mode-tracking, and mode-matching). We go on to examine a duality between the free energy principle and the constrained maximum entropy principle, both of which lie at the heart of Bayesian mechanics, and discuss its implications.
△ Less
Submitted 1 February, 2023; v1 submitted 23 May, 2022;
originally announced May 2022.
-
Sparse coupling and Markov blankets: A comment on "How particular is the physics of the Free Energy Principle?" by Aguilera, Millidge, Tschantz and Buckley
Authors:
Conor Heins,
Lancelot Da Costa
Abstract:
In this commentary, we respond to a technical analysis of the Free Energy Principle (hereafter: FEP) presented in "How particular is the physics of the Free Energy Principle" by Aguilera et al. In the target article, the authors analyzed certain sparsely coupled stochastic differential equations whose non-equilibrium steady-state densities are claimed--in previous FEP literature--to have a Markov…
▽ More
In this commentary, we respond to a technical analysis of the Free Energy Principle (hereafter: FEP) presented in "How particular is the physics of the Free Energy Principle" by Aguilera et al. In the target article, the authors analyzed certain sparsely coupled stochastic differential equations whose non-equilibrium steady-state densities are claimed--in previous FEP literature--to have a Markov blanket. The authors demonstrate that in general, Markov blankets are not guaranteed to follow from sparse coupling. The current commentary explains the relationship between sparse coupling and Markov blankets in the case of Gaussian steady-state densities. We precisely derive conditions under which causal coupling leads--or does not lead--to Markov blankets. Importantly, our derivations hold for both linear and non-linear stochastic differential equations. This result may shed light on the sorts of systems which we expect to have Markov blankets. Future work should focus on verifying whether these sorts of constraints are satisfied in realistic models of sparsely coupled systems.
△ Less
Submitted 29 May, 2022; v1 submitted 20 May, 2022;
originally announced May 2022.
-
The free energy principle made simpler but not too simple
Authors:
Karl Friston,
Lancelot Da Costa,
Noor Sajid,
Conor Heins,
Kai Ueltzhöffer,
Grigorios A. Pavliotis,
Thomas Parr
Abstract:
This paper provides a concise description of the free energy principle, starting from a formulation of random dynamical systems in terms of a Langevin equation and ending with a Bayesian mechanics that can be read as a physics of sentience. It rehearses the key steps using standard results from statistical physics. These steps entail (i) establishing a particular partition of states based upon con…
▽ More
This paper provides a concise description of the free energy principle, starting from a formulation of random dynamical systems in terms of a Langevin equation and ending with a Bayesian mechanics that can be read as a physics of sentience. It rehearses the key steps using standard results from statistical physics. These steps entail (i) establishing a particular partition of states based upon conditional independencies that inherit from sparsely coupled dynamics, (ii) unpacking the implications of this partition in terms of Bayesian inference and (iii) describing the paths of particular states with a variational principle of least action. Teleologically, the free energy principle offers a normative account of self-organisation in terms of optimal Bayesian design and decision-making, in the sense of maximising marginal likelihood or Bayesian model evidence. In summary, starting from a description of the world in terms of random dynamical systems, we end up with a description of self-organisation as sentient behaviour that can be interpreted as self-evidencing; namely, self-assembly, autopoiesis or active inference.
△ Less
Submitted 30 May, 2023; v1 submitted 17 January, 2022;
originally announced January 2022.
