-
The free energy principle made simpler but not too simple
Authors:
Karl Friston,
Lancelot Da Costa,
Noor Sajid,
Conor Heins,
Kai Ueltzhöffer,
Grigorios A. Pavliotis,
Thomas Parr
Abstract:
This paper provides a concise description of the free energy principle, starting from a formulation of random dynamical systems in terms of a Langevin equation and ending with a Bayesian mechanics that can be read as a physics of sentience. It rehearses the key steps using standard results from statistical physics. These steps entail (i) establishing a particular partition of states based upon con…
▽ More
This paper provides a concise description of the free energy principle, starting from a formulation of random dynamical systems in terms of a Langevin equation and ending with a Bayesian mechanics that can be read as a physics of sentience. It rehearses the key steps using standard results from statistical physics. These steps entail (i) establishing a particular partition of states based upon conditional independencies that inherit from sparsely coupled dynamics, (ii) unpacking the implications of this partition in terms of Bayesian inference and (iii) describing the paths of particular states with a variational principle of least action. Teleologically, the free energy principle offers a normative account of self-organisation in terms of optimal Bayesian design and decision-making, in the sense of maximising marginal likelihood or Bayesian model evidence. In summary, starting from a description of the world in terms of random dynamical systems, we end up with a description of self-organisation as sentient behaviour that can be interpreted as self-evidencing; namely, self-assembly, autopoiesis or active inference.
△ Less
Submitted 30 May, 2023; v1 submitted 17 January, 2022;
originally announced January 2022.
-
On the thermodynamics of prediction under dissipative adaptation
Authors:
Kai Ueltzhöffer
Abstract:
On the one hand, the dissipated heat of a thermodynamic work extraction process upper bounds the non-predictive information, which the associated system encodes about its environment. Thus, emergent information processing capabilities can be understood from the perspective of a pressure towards high thermodynamic efficiency. On the other hand, the second law of thermodynamics plays a crucial role…
▽ More
On the one hand, the dissipated heat of a thermodynamic work extraction process upper bounds the non-predictive information, which the associated system encodes about its environment. Thus, emergent information processing capabilities can be understood from the perspective of a pressure towards high thermodynamic efficiency. On the other hand, the second law of thermodynamics plays a crucial role in the emergence of complex, self-organising dissipative structures. Such structures are thermodynamically favoured, because they can dissipate free energy reservoirs, which would not be accessible otherwise. Thereby, they allow a closed system to move from one meta-stable state to another meta-stable state of higher entropy. This paper will argue, that these two views are not contradictory, but that their combination allows to understand the transition from simple self-organising dissipative structures to complex information processing systems. If the efficiency required by a dissipative structure to harvest enough work from the channeled flow of free energy to maintain its own structure is high, there is a drive for this system to be predictive. Still, the existence of this dissipative system is thermodynamically favoured, compared to a situation without any dissipative structure. Due to the emergence of a hierarchy of dissipative systems, which by themselves are non-equilibrium structures that can be dissipated, such a drive develops naturally, as one ascends in this hierarchy further and further away from the initial driving disequilibrium.
△ Less
Submitted 8 September, 2020;
originally announced September 2020.
-
Deep Active Inference
Authors:
Kai Ueltzhöffer
Abstract:
This work combines the free energy principle from cognitive neuroscience and the ensuing active inference dynamics with recent advances in variational inference in deep generative models, and evolution strategies to introduce the "deep active inference" agent. This agent minimises a variational free energy bound on the average surprise of its sensations, which is motivated by a homeostatic argumen…
▽ More
This work combines the free energy principle from cognitive neuroscience and the ensuing active inference dynamics with recent advances in variational inference in deep generative models, and evolution strategies to introduce the "deep active inference" agent. This agent minimises a variational free energy bound on the average surprise of its sensations, which is motivated by a homeostatic argument. It does so by optimising the parameters of a generative latent variable model of its sensory inputs, together with a variational density approximating the posterior distribution over the latent variables, given its observations, and by acting on its environment to actively sample input that is likely under this generative model. The internal dynamics of the agent are implemented using deep and recurrent neural networks, as used in machine learning, making the deep active inference agent a scalable and very flexible class of active inference agent. Using the mountain car problem, we show how goal directed behaviour can be implemented by defining appropriate priors on the latent states in the agent's model. Furthermore, we show that the deep active inference agent can learn a generative model of the environment, which can be sampled from to understand the agent's beliefs about the environment and its interaction therewith.
△ Less
Submitted 11 October, 2018; v1 submitted 7 September, 2017;
originally announced September 2017.
