-
Noise equals endogenous control
Authors:
Eric De Giuli
Abstract:
Stochastic systems have a control-theoretic interpretation in which noise plays the role of endogenous control. In the weak-noise limit, relevant at low temperatures or in large populations, control is optimal and an exact mathematical mapping from noise to control is described, where the maximizing the probability of a state becomes the control objective. In Langevin dynamics noise is identified…
▽ More
Stochastic systems have a control-theoretic interpretation in which noise plays the role of endogenous control. In the weak-noise limit, relevant at low temperatures or in large populations, control is optimal and an exact mathematical mapping from noise to control is described, where the maximizing the probability of a state becomes the control objective. In Langevin dynamics noise is identified directly with control, while in general Markov jump processes, which include chemical reaction networks and electronic circuits, we use the Doi-Zel'dovich-Grassberger-Goldenfeld-Peliti path integral to identify the `response' or `tilt' field $π$ as control, which is proportional to the noise in the semiclassical limit. This solves the longstanding problem of interpreting $π$. We illustrate the mapping on multistable chemical reaction networks and systems with unstable fixed points. The noise-control mapping builds intuition for otherwise puzzling phenomena of stochastic systems: why the probability is generically a non-smooth function of state out of thermal equilibrium; why biological mechanisms can work better in the presence of noise; and how agentic behavior emerges naturally without recourse to mysticism.
△ Less
Submitted 24 March, 2025; v1 submitted 19 March, 2025;
originally announced March 2025.
-
Is stochastic thermodynamics the key to understanding the energy costs of computation?
Authors:
David Wolpert,
Jan Korbel,
Christopher Lynn,
Farita Tasnim,
Joshua Grochow,
Gülce Kardeş,
James Aimone,
Vijay Balasubramanian,
Eric de Giuli,
David Doty,
Nahuel Freitas,
Matteo Marsili,
Thomas E. Ouldridge,
Andrea Richa,
Paul Riechers,
Édgar Roldán,
Brenda Rubenstein,
Zoltan Toroczkai,
Joseph Paradiso
Abstract:
The relationship between the thermodynamic and computational characteristics of dynamical physical systems has been a major theoretical interest since at least the 19th century, and has been of increasing practical importance as the energetic cost of digital devices has exploded over the last half century. One of the most important thermodynamic features of real-world computers is that they operat…
▽ More
The relationship between the thermodynamic and computational characteristics of dynamical physical systems has been a major theoretical interest since at least the 19th century, and has been of increasing practical importance as the energetic cost of digital devices has exploded over the last half century. One of the most important thermodynamic features of real-world computers is that they operate very far from thermal equilibrium, in finite time, with many quickly (co-)evolving degrees of freedom. Such computers also must almost always obey multiple physical constraints on how they work. For example, all modern digital computers are periodic processes, governed by a global clock. Another example is that many computers are modular, hierarchical systems, with strong restrictions on the connectivity of their subsystems. This properties hold both for naturally occurring computers, like brains or Eukaryotic cells, as well as digital systems. These features of real-world computers are absent in 20th century analyses of the thermodynamics of computational processes, which focused on quasi-statically slow processes. However, the field of stochastic thermodynamics has been developed in the last few decades - and it provides the formal tools for analyzing systems that have exactly these features of real-world computers. We argue here that these tools, together with other tools currently being developed in stochastic thermodynamics, may help us understand at a far deeper level just how the fundamental physical properties of dynamic systems are related to the computation that they perform.
△ Less
Submitted 29 August, 2024; v1 submitted 28 November, 2023;
originally announced November 2023.
-
Robustness of the Random Language Model
Authors:
Fatemeh Lalegani,
Eric De Giuli
Abstract:
The Random Language Model (De Giuli 2019) is an ensemble of stochastic context-free grammars, quantifying the syntax of human and computer languages. The model suggests a simple picture of first language learning as a type of annealing in the vast space of potential languages. In its simplest formulation, it implies a single continuous transition to grammatical syntax, at which the symmetry among…
▽ More
The Random Language Model (De Giuli 2019) is an ensemble of stochastic context-free grammars, quantifying the syntax of human and computer languages. The model suggests a simple picture of first language learning as a type of annealing in the vast space of potential languages. In its simplest formulation, it implies a single continuous transition to grammatical syntax, at which the symmetry among potential words and categories is spontaneously broken. Here this picture is scrutinized by considering its robustness against extensions of the original model, and trajectories through parameter space different from those originally considered. It is shown here that (i) the scenario is robust to explicit symmetry breaking, an inevitable component of learning in the real world; and (ii) the transition to grammatical syntax can be encountered by fixing the deep (hidden) structure while varying the surface (observable) properties. It is also argued that the transition becomes a sharp thermodynamic transition in an idealized limit. Moreover, comparison with human data on the clustering coefficient of syntax networks suggests that the observed transition is equivalent to that normally experienced by children at age 24 months. The results are discussed in light of theory of first-language acquisition in linguistics, and recent successes in machine learning.
△ Less
Submitted 22 March, 2024; v1 submitted 26 September, 2023;
originally announced September 2023.
-
Fermionic theory of nonequilibrium steady states
Authors:
Eric De Giuli,
Masanari Shimada
Abstract:
As the quantification of metabolism, nonequilibrium steady states play a central role in living matter, but are beyond the purview of equilibrium statistical mechanics. Here we develop a fermionic theory of nonequilibrium steady states in continuous-time Markovian systems, generalizing Boltzmann-Gibbs statistical mechanics to this case. The response to an arbitrary perturbation is computed, and si…
▽ More
As the quantification of metabolism, nonequilibrium steady states play a central role in living matter, but are beyond the purview of equilibrium statistical mechanics. Here we develop a fermionic theory of nonequilibrium steady states in continuous-time Markovian systems, generalizing Boltzmann-Gibbs statistical mechanics to this case. The response to an arbitrary perturbation is computed, and simplified in canonical cases. Beyond response, we consider ensembles of nonequilibrium steady states and show that a general class of ensembles is described by a 2D statistical field theory with infinitesimally broken supersymmetry, which may form the basis of nontrivial solvable models of nonequilibrium steady states.
△ Less
Submitted 23 April, 2024; v1 submitted 21 August, 2023;
originally announced August 2023.
-
Universal Slow Dynamics of Chemical Reaction Networks
Authors:
Masanari Shimada,
Pegah Behrad,
Eric De Giuli
Abstract:
Understanding the emergent behavior of chemical reaction networks (CRNs) is a fundamental aspect of biology and its origin from inanimate matter. A closed CRN monotonically tends to thermal equilibrium, but when it is opened to external reservoirs, a range of behaviors is possible, including transition to a new equilibrium state, a non-equilibrium state, or indefinite growth. This study shows that…
▽ More
Understanding the emergent behavior of chemical reaction networks (CRNs) is a fundamental aspect of biology and its origin from inanimate matter. A closed CRN monotonically tends to thermal equilibrium, but when it is opened to external reservoirs, a range of behaviors is possible, including transition to a new equilibrium state, a non-equilibrium state, or indefinite growth. This study shows that slowly driven CRNs are governed by the conserved quantities of the closed system, which are generally far fewer in number than the species. Considering both deterministic and stochastic dynamics, a universal slow dynamics equation is derived with singular perturbation methods, and is shown to be thermodynamically consistent. The slow dynamics is highly robust against microscopic details of the network, which may be unknown in practical situations. In particular, non-equilibrium states of realistic large CRNs can be sought without knowledge of bulk reaction rates. The framework is successfully tested against a suite of networks of increasing complexity and argued to be relevant in the treatment of open CRNs as chemical machines.
△ Less
Submitted 13 March, 2024; v1 submitted 19 April, 2023;
originally announced April 2023.
-
Dynamical mean-field theory: from ecosystems to reaction networks
Authors:
Eric De Giuli,
Camille Scalliet
Abstract:
Both natural ecosystems and biochemical reaction networks involve populations of heterogeneous agents whose cooperative and competitive interactions lead to a rich dynamics of species' abundances, albeit at vastly different scales. The maintenance of diversity in large ecosystems is a longstanding puzzle, towards which recent progress has been made by the derivation of dynamical mean-field theorie…
▽ More
Both natural ecosystems and biochemical reaction networks involve populations of heterogeneous agents whose cooperative and competitive interactions lead to a rich dynamics of species' abundances, albeit at vastly different scales. The maintenance of diversity in large ecosystems is a longstanding puzzle, towards which recent progress has been made by the derivation of dynamical mean-field theories of random models. In particular, it has recently been shown that these random models have a chaotic phase in which abundances display wild fluctuations. When modest spatial structure is included, these fluctuations are stabilized and diversity is maintained. If and how these phenomena have parallels in biochemical reaction networks is currently unknown. Making this connection is of interest since life requires cooperation among a large number of molecular species. In this work, we find a reaction network whose large-scale behavior recovers the random Lotka-Volterra model recently considered in theoretical ecology. We clarify the assumptions necessary to derive its large-scale description, and reveal the underlying assumptions made on the noise to recover previous dynamical mean-field theories. Then, we show how local detailed balance and the positivity of reaction rates, which are key physical requirements of chemical reaction networks, provide obstructions towards the construction of an associated dynamical mean-field theory of biochemical reaction networks. Finally, we outline prospects and challenges for the future.
△ Less
Submitted 10 November, 2022; v1 submitted 4 May, 2022;
originally announced May 2022.
-
Breakdown of random matrix universality in Markov models
Authors:
Faheem Mosam,
Diego Vidaurre,
Eric De Giuli
Abstract:
Biological systems need to react to stimuli over a broad spectrum of timescales. If and how this ability can emerge without external fine-tuning is a puzzle. We consider here this problem in discrete Markovian systems, where we can leverage results from random matrix theory. Indeed, generic large transition matrices are governed by universal results, which predict the absence of long timescales un…
▽ More
Biological systems need to react to stimuli over a broad spectrum of timescales. If and how this ability can emerge without external fine-tuning is a puzzle. We consider here this problem in discrete Markovian systems, where we can leverage results from random matrix theory. Indeed, generic large transition matrices are governed by universal results, which predict the absence of long timescales unless fine-tuned. We consider an ensemble of transition matrices and motivate a temperature-like variable that controls the dynamic range of matrix elements, which we show plays a crucial role in the applicability of the large matrix limit: as the dynamic range increases, a phase transition occurs whereby the random matrix theory result is avoided, and long relaxation times ensue, in the entire `ordered' phase. We furthermore show that this phase transition is accompanied by a drop in the entropy rate and a peak in complexity, as measured by predictive information (Bialek, Nemenman, Tishby Neural Computation 13(21) 2001). Extending the Markov model to a Hidden Markov model (HMM), we show that observable sequences inherit properties of the hidden sequences, allowing HMMs to be understood in terms of more accessible Markov models. We then apply our findings to fMRI data from 820 human subjects scanned at wakeful rest. We show that the data can be quantitatively understood in terms of the random model, and that brain activity lies close to the phase transition when engaged in unconstrained, task-free cognition -- supporting the brain criticality hypothesis in this context.
△ Less
Submitted 26 July, 2021; v1 submitted 10 May, 2021;
originally announced May 2021.
-
Random quench predicts universal properties of amorphous solids
Authors:
Masanari Shimada,
Eric De Giuli
Abstract:
Amorphous solids display numerous universal features in their mechanics, structure, and response. Current models assume heterogeneity in mesoscale elastic properties, but require fine-tuning in order to quantitatively explain vibrational properties. A complete model should derive the magnitude and character of elastic heterogeneity from an initially structureless medium, through a model of the que…
▽ More
Amorphous solids display numerous universal features in their mechanics, structure, and response. Current models assume heterogeneity in mesoscale elastic properties, but require fine-tuning in order to quantitatively explain vibrational properties. A complete model should derive the magnitude and character of elastic heterogeneity from an initially structureless medium, through a model of the quenching process during which the temperature is rapidly lowered and the solid is formed. Here we propose a field-theoretic model of a quench, and compute structural, mechanical, and vibrational observables in arbitrary dimension $d$. This allows us to relate the properties of the amorphous solid to those of the initial medium, and to those of the quench. We show that previous mean-field results are subsumed by our analysis and unify spatial fluctuations of elastic moduli, long-range correlations of inherent state stress, universal vibrational anomalies, and localized modes into one picture.
△ Less
Submitted 1 December, 2021; v1 submitted 26 August, 2020;
originally announced August 2020.
-
Glassy gravity
Authors:
Eric De Giuli,
A. Zee
Abstract:
Euclidean quantum gravity is reconsidered, in the conformal mode approximation. Applying techniques from glass theory, we argue that the Euclidean partition function hides metastable states, which can be counted. This may reconcile conflicting results on the uniqueness of the de Sitter vacuum, and may be relevant to the cosmological constant problem.
Euclidean quantum gravity is reconsidered, in the conformal mode approximation. Applying techniques from glass theory, we argue that the Euclidean partition function hides metastable states, which can be counted. This may reconcile conflicting results on the uniqueness of the de Sitter vacuum, and may be relevant to the cosmological constant problem.
△ Less
Submitted 3 January, 2021; v1 submitted 3 August, 2020;
originally announced August 2020.
-
Renormalization of elastic quadrupoles in amorphous solids
Authors:
Eric De Giuli
Abstract:
Plasticity in amorphous solids is mediated by localized quadrupolar instabilities, but the mechanism by which an amorphous solid eventually fails or melts is debated. In this work we argue that these phenomena can be investigated in the model problem of an elastic continuum with quadrupolar defects, at finite temperature. This problem is posed and the collective behavior of the defects is analytic…
▽ More
Plasticity in amorphous solids is mediated by localized quadrupolar instabilities, but the mechanism by which an amorphous solid eventually fails or melts is debated. In this work we argue that these phenomena can be investigated in the model problem of an elastic continuum with quadrupolar defects, at finite temperature. This problem is posed and the collective behavior of the defects is analytically investigated. Using both renormalization group and field-theoretic techniques, it is found that the model has a yielding/melting transition of spinodal type.
△ Less
Submitted 26 March, 2020; v1 submitted 12 December, 2019;
originally announced December 2019.
-
Emergence of order in random languages
Authors:
Eric De Giuli
Abstract:
We consider languages generated by weighted context-free grammars. It is shown that the behaviour of large texts is controlled by saddle-point equations for an appropriate generating function. We then consider ensembles of grammars, in particular the Random Language Model of E. DeGiuli, Phys. Rev. Lett., 122, 128301, 2019. This model is solved in the replica-symmetric ansatz, which is valid in the…
▽ More
We consider languages generated by weighted context-free grammars. It is shown that the behaviour of large texts is controlled by saddle-point equations for an appropriate generating function. We then consider ensembles of grammars, in particular the Random Language Model of E. DeGiuli, Phys. Rev. Lett., 122, 128301, 2019. This model is solved in the replica-symmetric ansatz, which is valid in the high-temperature, disordered phase. It is shown that in the phase in which languages carry information, the replica symmetry must be broken.
△ Less
Submitted 30 September, 2022; v1 submitted 20 February, 2019;
originally announced February 2019.
