-
On the emergence of memory in equilibrium versus non-equilibrium systems
Authors:
Xizhu Zhao,
David Hartich,
Aljaž Godec
Abstract:
Experiments often probe observables that correspond to low-dimensional projections of highdimensional dynamics. In such situations distinct microscopic configurations become lumped into the same observable state. It is well known that correlations between the observable and the hidden degrees of freedom give rise to memory effects. However, how and under which conditions these correlations emerge…
▽ More
Experiments often probe observables that correspond to low-dimensional projections of highdimensional dynamics. In such situations distinct microscopic configurations become lumped into the same observable state. It is well known that correlations between the observable and the hidden degrees of freedom give rise to memory effects. However, how and under which conditions these correlations emerge remains poorly understood. Here we shed light on two fundamentally different scenarios of the emergence of memory in minimal stationary systems, where observed and hidden degrees of freedom evolve either cooperatively or are coupled by a hidden non-equilibrium current. In the reversible setting strongest memory manifests when the time-scales of hidden and observed dynamics overlap, whereas, strikingly, in the driven setting maximal memory emerges under a clear time-scale separation. Our results hint at the possibility of fundamental differences in the way memory emerges in equilibrium versus driven systems that may be utilized as a "diagnostic" of the underlying hidden transport mechanism.
△ Less
Submitted 29 January, 2024; v1 submitted 21 November, 2023;
originally announced November 2023.
-
Comment on "Inferring broken detailed balance in the absence of observable currents"
Authors:
David Hartich,
Aljaž Godec
Abstract:
We present a simple biophysical example that invalidates the main conclusion of "Nat. Commun. 10, 3542 (2019)". Moreover, we explain that systems with one or more hidden states between at least one pair of observed states that give rise to non-instantaneous transition paths between these states also invalidate the main conclusion of the aforementioned work. This provides a flexible roadmap for con…
▽ More
We present a simple biophysical example that invalidates the main conclusion of "Nat. Commun. 10, 3542 (2019)". Moreover, we explain that systems with one or more hidden states between at least one pair of observed states that give rise to non-instantaneous transition paths between these states also invalidate the main conclusion of the aforementioned work. This provides a flexible roadmap for constructing counterexamples. We hope for this comment to raise awareness of possibly hidden transition paths and of the importance of considering the microscopic origin of emerging non-Markovian (or Markovian) dynamics for thermodynamics.
△ Less
Submitted 1 August, 2022; v1 submitted 16 December, 2021;
originally announced December 2021.
-
Violation of Local Detailed Balance Despite a Clear Time-Scale Separation
Authors:
David Hartich,
Aljaž Godec
Abstract:
Integrating out fast degrees of freedom is known to yield, to a good approximation, memory-less, i.e. Markovian, dynamics. In the presence of such a time-scale separation local detailed balance is believed to emerge and to guarantee thermodynamic consistency arbitrarily far from equilibrium. Here we present a transparent example of a Markov model of a molecular motor where local detailed balance c…
▽ More
Integrating out fast degrees of freedom is known to yield, to a good approximation, memory-less, i.e. Markovian, dynamics. In the presence of such a time-scale separation local detailed balance is believed to emerge and to guarantee thermodynamic consistency arbitrarily far from equilibrium. Here we present a transparent example of a Markov model of a molecular motor where local detailed balance can be violated despite a clear time-scale separation and hence Markovian dynamics. Driving the system far from equilibrium can lead to a violation of local detailed balance against the driving force. We further show that local detailed balance can be restored, even in the presence of memory, if the coarse-graining is carried out as Milestoning. Our work establishes Milestoning not only as a kinetically but for the first time also as a thermodynamically consistent coarse-graining method. Our results are relevant as soon as individual transition paths are appreciable or can be resolved.
△ Less
Submitted 28 April, 2022; v1 submitted 29 November, 2021;
originally announced November 2021.
-
Thermodynamic Uncertainty Relation Bounds the Extent of Anomalous Diffusion
Authors:
David Hartich,
Aljaz Godec
Abstract:
In a finite system driven out of equilibrium by a constant external force the thermodynamic uncertainty relation (TUR) bounds the variance of the conjugate current variable by the thermodynamic cost of maintaining the non-equilibrium stationary state. Here we highlight a new facet of the TUR by showing that it also bounds the time-scale on which a finite system can exhibit anomalous kinetics. In p…
▽ More
In a finite system driven out of equilibrium by a constant external force the thermodynamic uncertainty relation (TUR) bounds the variance of the conjugate current variable by the thermodynamic cost of maintaining the non-equilibrium stationary state. Here we highlight a new facet of the TUR by showing that it also bounds the time-scale on which a finite system can exhibit anomalous kinetics. In particular, we demonstrate that the TUR bounds subdiffusion in a single file confined to a ring as well as a dragged Gaussian polymer chain even when detailed balance is satisfied. Conversely, the TUR bounds the onset of superdiffusion in the active comb model. Remarkably, the fluctuations in a comb model evolving from a steady state behave anomalously as soon as detailed balance is broken. Our work establishes a link between stochastic thermodynamics and the field of anomalous dynamics that will fertilize further investigations of thermodynamic consistency of anomalous diffusion models.
△ Less
Submitted 16 August, 2021; v1 submitted 12 February, 2021;
originally announced February 2021.
-
Emergent memory and kinetic hysteresis in strongly driven networks
Authors:
David Hartich,
Aljaž Godec
Abstract:
Stochastic network-dynamics are typically assumed to be memory-less. Involving prolonged dwells interrupted by instantaneous transitions between nodes such Markov networks stand as a coarse-graining paradigm for chemical reactions, gene expression, molecular machines, spreading of diseases, protein dynamics, diffusion in energy landscapes, epigenetics and many others. However, as soon as transitio…
▽ More
Stochastic network-dynamics are typically assumed to be memory-less. Involving prolonged dwells interrupted by instantaneous transitions between nodes such Markov networks stand as a coarse-graining paradigm for chemical reactions, gene expression, molecular machines, spreading of diseases, protein dynamics, diffusion in energy landscapes, epigenetics and many others. However, as soon as transitions cease to be negligibly short, as often observed in experiments, the dynamics develops a memory. That is, state-changes depend not only on the present state but also on the past. Here, we establish the first thermodynamically consistent -- dissipation-preserving -- mapping of continuous dynamics onto a network, which reveals ingrained dynamical symmetries and an unforeseen kinetic hysteresis. These symmetries impose three independent sources of fluctuations in state-to state kinetics that determine the `flavor of memory'. The hysteresis between the forward/backward in time coarse-graining of continuous trajectories implies a new paradigm for the thermodynamics of active molecular processes in the presence of memory, that is, beyond the assumption of local detailed balance. Our results provide a new understanding of fluctuations in the operation of molecular machines as well as catch-bonds involved in cellular adhesion.
△ Less
Submitted 11 October, 2021; v1 submitted 9 November, 2020;
originally announced November 2020.
-
Spectral theory of fluctuations in time-average statistical mechanics of reversible and driven systems
Authors:
Alessio Lapolla,
David Hartich,
Aljaž Godec
Abstract:
We present a spectral-theoretic approach to time-average statistical mechanics for general, non-equilibrium initial conditions. We consider the statistics of bounded, local additive functionals of reversible as well as irreversible ergodic stochastic dynamics with continuous or discrete state-space. We derive exact results for the mean, fluctuations and correlations of time average observables fro…
▽ More
We present a spectral-theoretic approach to time-average statistical mechanics for general, non-equilibrium initial conditions. We consider the statistics of bounded, local additive functionals of reversible as well as irreversible ergodic stochastic dynamics with continuous or discrete state-space. We derive exact results for the mean, fluctuations and correlations of time average observables from the eigenspectrum of the underlying generator of Fokker-Planck or master equation dynamics, and discuss the results from a physical perspective. Feynman-Kac formulas are re-derived using Itô calculus and combined with non-Hermitian perturbation theory. The emergence of the universal central limit law in a spectral representation is shown explicitly on large deviation time-scales. For reversible dynamics with equilibrated initial conditions we derive a general upper bound to fluctuations of occupation measures in terms of an integral of the return probability. Simple, exactly solvable examples are analyzed to demonstrate how to apply the theory. As a biophysical example we revisit the Berg-Purcell problem on the precision of concentration measurements by a single receptor. Our results are directly applicable to a diverse range of phenomena underpinned by time-average observables and additive functionals in physical, chemical, biological, and economical systems.
△ Less
Submitted 27 July, 2020; v1 submitted 20 April, 2020;
originally announced April 2020.
-
Extreme value statistics of ergodic Markov processes from first passage times in the large deviation limit
Authors:
David Hartich,
Aljaz Godec
Abstract:
Extreme value functionals of stochastic processes are inverse functionals of the first passage time -- a connection that renders their probability distribution functions equivalent. Here, we deepen this link and establish a framework for analyzing extreme value statistics of ergodic reversible Markov processes in confining potentials on the hand of the underlying relaxation eigenspectra. We derive…
▽ More
Extreme value functionals of stochastic processes are inverse functionals of the first passage time -- a connection that renders their probability distribution functions equivalent. Here, we deepen this link and establish a framework for analyzing extreme value statistics of ergodic reversible Markov processes in confining potentials on the hand of the underlying relaxation eigenspectra. We derive a chain of inequalities, which bounds the long-time asymptotics of first passage densities, and thereby extrema, from above and from below. The bounds involve a time integral of the transition probability density describing the relaxation towards equilibrium. We apply our general results to the analysis of extreme value statistics at long times in the case of Ornstein-Uhlenbeck process and a 3-dimensional Brownian motion confined to a sphere, also known as Bessel process. We find that even on time-scales that are shorter than the equilibration time, the large deviation limit characterizing long-time asymptotics can approximate the statistics of extreme values remarkably well. Our findings provide a novel perspective on the study of extrema beyond the established limit theorems for sequences of independent random variables and for asymmetric diffusion processes beyond a constant drift.
△ Less
Submitted 29 May, 2019; v1 submitted 1 February, 2019;
originally announced February 2019.
-
Reaction kinetics in the few-encounter limit
Authors:
David Hartich,
Aljaz Godec
Abstract:
The classical theory of chemical reactions can be understood in terms of diffusive barrier crossing, where the rate of a reaction is determined by the inverse of the mean first passage time (FPT) to cross a free energy barrier. Whenever a few reaction events suffice to trigger a response or the energy barriers are not high, the mean first passage time alone does not suffice to characterize the kin…
▽ More
The classical theory of chemical reactions can be understood in terms of diffusive barrier crossing, where the rate of a reaction is determined by the inverse of the mean first passage time (FPT) to cross a free energy barrier. Whenever a few reaction events suffice to trigger a response or the energy barriers are not high, the mean first passage time alone does not suffice to characterize the kinetics, i.e., the kinetics do not occur on a single time-scale. Instead, the full statistics of the FPT are required. We present a spectral representation of the FPT statistics that allows us to understand and accurately determine FPT distributions over several orders of magnitudes in time. A canonical narrowing of the first passage density is shown to emerge whenever several molecules are searching for the same target, which was termed the 'few-encounter limit'. The few-encounter limit is essential in all situations, in which already the first encounter triggers a response, such as misfolding-triggered aggregation of proteins or protein transcription regulation.
△ Less
Submitted 21 November, 2019; v1 submitted 28 January, 2019;
originally announced January 2019.
-
Interlacing Relaxation and First-Passage Phenomena in Reversible Discrete and Continuous Space Markovian Dynamics
Authors:
David Hartich,
Aljaz Godec
Abstract:
We uncover a duality between relaxation and first passage processes in ergodic reversible Markovian dynamics in both discrete and continuous state-space. The duality exists in the form of a spectral interlacing -- the respective time scales of relaxation and first passage are shown to interlace. Our canonical theory allows for the first time to determine the full first passage time distribution an…
▽ More
We uncover a duality between relaxation and first passage processes in ergodic reversible Markovian dynamics in both discrete and continuous state-space. The duality exists in the form of a spectral interlacing -- the respective time scales of relaxation and first passage are shown to interlace. Our canonical theory allows for the first time to determine the full first passage time distribution analytically from the simpler relaxation eigenspectrum. The duality is derived and proven rigorously for both discrete state Markov processes in arbitrary dimension and effectively one-dimensional diffusion processes, whereas we also discuss extensions to more complex scenarios. We apply our theory to a simple discrete-state protein folding model and to the Ornstein-Uhlenbeck process, for which we obtain the exact first passage time distribution analytically in terms of a Newton series of determinants of almost triangular matrices.
△ Less
Submitted 4 March, 2019; v1 submitted 27 February, 2018;
originally announced February 2018.
-
Duality Between Relaxation and First Passage in Reversible Markov Dynamics: Rugged Energy Landscapes Disentangled
Authors:
David Hartich,
Aljaz Godec
Abstract:
Relaxation and first passage processes are the pillars of kinetics in condensed matter, polymeric and single-molecule systems. Yet, an explicit connection between relaxation and first passage time-scales so far remained elusive. Here we prove a duality between them in the form of an interlacing of spectra. In the basic form the duality holds for reversible Markov processes to effectively one-dimen…
▽ More
Relaxation and first passage processes are the pillars of kinetics in condensed matter, polymeric and single-molecule systems. Yet, an explicit connection between relaxation and first passage time-scales so far remained elusive. Here we prove a duality between them in the form of an interlacing of spectra. In the basic form the duality holds for reversible Markov processes to effectively one-dimensional targets. The exploration of a triple-well potential is analyzed to demonstrate how the duality allows for an intuitive understanding of first passage trajectories in terms of relaxational eigenmodes. More generally, we provide a comprehensive explanation of the full statistics of reactive trajectories in rugged potentials, incl. the so-called `few-encounter limit'. Our results are required for explaining quantitatively the occurrence of diseases triggered by protein misfolding.
△ Less
Submitted 26 November, 2018; v1 submitted 27 February, 2018;
originally announced February 2018.
-
Thermodynamic bounds on the ultra- and infra-affinity of Hsp70 for its substrates
Authors:
Basile Nguyen,
David Hartich,
Udo Seifert,
Paolo De Los Rios
Abstract:
The 70 kDa Heat Shock Proteins Hsp70 have several essential functions in living systems, such as protecting cells against protein aggregation, assisting protein folding, remodeling protein complexes and driving the translocation into organelles. These functions require high affinity for non-specific amino-acid sequences that are ubiquitous in proteins. It has been recently shown that this high aff…
▽ More
The 70 kDa Heat Shock Proteins Hsp70 have several essential functions in living systems, such as protecting cells against protein aggregation, assisting protein folding, remodeling protein complexes and driving the translocation into organelles. These functions require high affinity for non-specific amino-acid sequences that are ubiquitous in proteins. It has been recently shown that this high affinity, called ultra-affinity, depends on a process driven out of equilibrium by ATP hydrolysis. Here we establish the thermodynamic bounds for ultra-affinity, and further show that the same reaction scheme can in principle be used both to strengthen and to weaken affinities (leading in this case to infra-affinity). We show that cofactors are essential to achieve affinity beyond the equilibrium range. Finally, biological implications are discussed.
△ Less
Submitted 9 June, 2017; v1 submitted 6 February, 2017;
originally announced February 2017.
-
Optimal inference strategies and their implications for the linear noise approximation
Authors:
David Hartich,
Udo Seifert
Abstract:
We study the information loss of a class of inference strategies that is solely based on time averaging. For an array of independent binary sensors (e.g., receptors, single electron transistors) measuring a weak random signal (e.g., ligand concentration, gate voltage) this information loss is up to 0.5 bit per measurement irrespective of the number of sensors. We derive a condition related to the…
▽ More
We study the information loss of a class of inference strategies that is solely based on time averaging. For an array of independent binary sensors (e.g., receptors, single electron transistors) measuring a weak random signal (e.g., ligand concentration, gate voltage) this information loss is up to 0.5 bit per measurement irrespective of the number of sensors. We derive a condition related to the local detailed balance relation that determines whether or not such a loss of information occurs. Specifically, if the free energy difference arising from the signal is symmetrically distributed among the forward and backward rates, time integration mechanisms will capture the full information about the signal. As an implication, for the linear noise approximation, we can identify the same loss of information, arising from its inherent simplification of the dynamics.
△ Less
Submitted 19 October, 2016; v1 submitted 12 May, 2016;
originally announced May 2016.
-
Sensory capacity: an information theoretical measure of the performance of a sensor
Authors:
David Hartich,
Andre C. Barato,
Udo Seifert
Abstract:
For a general sensory system following an external stochastic signal, we introduce the sensory capacity. This quantity characterizes the performance of a sensor: sensory capacity is maximal if the instantaneous state of the sensor has as much information about a signal as the whole time-series of the sensor. We show that adding a memory to the sensor increases the sensory capacity. This increase q…
▽ More
For a general sensory system following an external stochastic signal, we introduce the sensory capacity. This quantity characterizes the performance of a sensor: sensory capacity is maximal if the instantaneous state of the sensor has as much information about a signal as the whole time-series of the sensor. We show that adding a memory to the sensor increases the sensory capacity. This increase quantifies the improvement of the sensor with the addition of the memory. Our results are obtained with the framework of stochastic thermodynamics of bipartite systems, which allows for the definition of an efficiency that relates the rate with which the sensor learns about the signal with the energy dissipated by the sensor, which is given by the thermodynamic entropy production. We demonstrate a general tradeoff between sensory capacity and efficiency: if the sensory capacity is equal to its maximum 1, then the efficiency must be less than 1/2. As a physical realization of a sensor we consider a two component cellular network estimating a fluctuating external ligand concentration as signal. This model leads to coupled linear Langevin equations that allow us to obtain explicit analytical results.
△ Less
Submitted 10 February, 2016; v1 submitted 7 September, 2015;
originally announced September 2015.
-
Nonequilibrium sensing and its analogy to kinetic proofreading
Authors:
David Hartich,
Andre C. Barato,
Udo Seifert
Abstract:
For a paradigmatic model of chemotaxis, we analyze the effect how a nonzero affinity driving receptors out of equilibrium affects sensitivity. This affinity arises whenever changes in receptor activity involve ATP hydrolysis. The sensitivity integrated over a ligand concentration range is shown to be enhanced by the affinity, providing a measure of how much energy consumption improves sensing. Wit…
▽ More
For a paradigmatic model of chemotaxis, we analyze the effect how a nonzero affinity driving receptors out of equilibrium affects sensitivity. This affinity arises whenever changes in receptor activity involve ATP hydrolysis. The sensitivity integrated over a ligand concentration range is shown to be enhanced by the affinity, providing a measure of how much energy consumption improves sensing. With this integrated sensitivity we can establish an intriguing analogy between sensing with nonequilibrium receptors and kinetic proofreading: the increase in integrated sensitivity is equivalent to the decrease of the error in kinetic proofreading. The influence of the occupancy of the receptor on the phosphorylation and dephosphorylation reaction rates is shown to be crucial for the relation between integrated sensitivity and affinity. This influence can even lead to a regime where a nonzero affinity decreases the integrated sensitivity, which corresponds to anti-proofreading.
△ Less
Submitted 28 May, 2015; v1 submitted 9 February, 2015;
originally announced February 2015.
-
Efficiency of cellular information processing
Authors:
Andre C. Barato,
David Hartich,
Udo Seifert
Abstract:
We show that a rate of conditional Shannon entropy reduction, characterizing the learning of an internal process about an external process, is bounded by the thermodynamic entropy production. This approach allows for the definition of an informational efficiency that can be used to study cellular information processing. We analyze three models of increasing complexity inspired by the E. coli senso…
▽ More
We show that a rate of conditional Shannon entropy reduction, characterizing the learning of an internal process about an external process, is bounded by the thermodynamic entropy production. This approach allows for the definition of an informational efficiency that can be used to study cellular information processing. We analyze three models of increasing complexity inspired by the E. coli sensory network, where the external process is an external ligand concentration jumping between two values. We start with a simple model for which ATP must be consumed so that a protein inside the cell can learn about the external concentration. With a second model for a single receptor we show that the rate at which the receptor learns about the external environment can be nonzero even without any dissipation inside the cell since chemical work done by the external process compensates for this learning rate. The third model is more complete, also containing adaptation. For this model we show inter alia that a bacterium in an environment that changes at a very slow time-scale is quite inefficient, dissipating much more than it learns. Using the concept of a coarse-grained learning rate, we show for the model with adaptation that while the activity learns about the external signal the option of changing the methylation level increases the concentration range for which the learning rate is substantial.
△ Less
Submitted 6 November, 2014; v1 submitted 28 May, 2014;
originally announced May 2014.
-
Stochastic thermodynamics of bipartite systems: transfer entropy inequalities and a Maxwell's demon interpretation
Authors:
David Hartich,
Andre C. Barato,
Udo Seifert
Abstract:
We consider the stationary state of a Markov process on a bipartite system from the perspective of stochastic thermodynamics. One subsystem is used to extract work from a heat bath while being affected by the second subsystem. We show that the latter allows for a transparent and thermodynamically consistent interpretation of a Maxwell's demon. Moreover, we obtain an integral fluctuation theorem in…
▽ More
We consider the stationary state of a Markov process on a bipartite system from the perspective of stochastic thermodynamics. One subsystem is used to extract work from a heat bath while being affected by the second subsystem. We show that the latter allows for a transparent and thermodynamically consistent interpretation of a Maxwell's demon. Moreover, we obtain an integral fluctuation theorem involving the transfer entropy from one subsystem to the other. Comparing three different inequalities, we show that the entropy decrease of the first subsystem provides a tighter bound on the rate of extracted work than both the rate of transfer entropy from this subsystem to the demon and the heat dissipated through the dynamics of the demon. The latter two rates cannot be ordered by an inequality as shown with the illustrative example of a four state system.
△ Less
Submitted 3 February, 2014;
originally announced February 2014.
-
Rate of mutual information between coarse-grained non-Markovian variables
Authors:
Andre Cardoso Barato,
David Hartich,
Udo Seifert
Abstract:
The problem of calculating the rate of mutual information between two coarse-grained variables that together specify a continuous time Markov process is addressed.
As a main obstacle, the coarse-grained variables are in general non-Markovian, therefore, an expression for their Shannon entropy rates in terms of the stationary probability distribution is not known. A numerical method to estimate t…
▽ More
The problem of calculating the rate of mutual information between two coarse-grained variables that together specify a continuous time Markov process is addressed.
As a main obstacle, the coarse-grained variables are in general non-Markovian, therefore, an expression for their Shannon entropy rates in terms of the stationary probability distribution is not known. A numerical method to estimate the Shannon entropy rate of continuous time hidden-Markov processes from a single time series is developed.
With this method the rate of mutual information can be determined numerically. Moreover, an analytical upper bound on the rate of mutual information is calculated for a class of Markov processes for which the transition rates have a bipartite character. Our general results are illustrated with explicit calculations for four-state networks.
△ Less
Submitted 30 September, 2013; v1 submitted 7 June, 2013;
originally announced June 2013.
-
Information-theoretic vs. thermodynamic entropy production in autonomous sensory networks
Authors:
A. C. Barato,
D Hartich,
U. Seifert
Abstract:
For sensory networks, we determine the rate with which they acquire information about the changing external conditions. Comparing this rate with the thermodynamic entropy production that quantifies the cost of maintaining the network, we find that there is no universal bound restricting the rate of obtaining information to be less than this thermodynamic cost. These results are obtained within a g…
▽ More
For sensory networks, we determine the rate with which they acquire information about the changing external conditions. Comparing this rate with the thermodynamic entropy production that quantifies the cost of maintaining the network, we find that there is no universal bound restricting the rate of obtaining information to be less than this thermodynamic cost. These results are obtained within a general bipartite model consisting of a stochastically changing environment that affects the instantaneous transition rates within the system. Moreover, they are illustrated with a simple four-states model motivated by cellular sensing. On the technical level, we obtain an upper bound on the rate of mutual information analytically and calculate this rate with a numerical method that estimates the entropy of a time-series generated with a simulation.
△ Less
Submitted 5 April, 2013; v1 submitted 13 December, 2012;
originally announced December 2012.
