Showing 51–67 of 67 results for author: Sivak, A

Stochastic control in microscopic nonequilibrium systems

Authors: Steven J. Large, Raphaël Chetrite, David A. Sivak

Abstract: Quantifying energy flows at nanometer scales promises to guide future research in a variety of disciplines, from microscopic control and manipulation, to autonomously operating molecular machines. A general understanding of the thermodynamic costs of nonequilibrium processes would illuminate the design principles for efficient microscopic machines. Considerable effort has gone into finding and cla… ▽ More Quantifying energy flows at nanometer scales promises to guide future research in a variety of disciplines, from microscopic control and manipulation, to autonomously operating molecular machines. A general understanding of the thermodynamic costs of nonequilibrium processes would illuminate the design principles for efficient microscopic machines. Considerable effort has gone into finding and classifying the deterministic control protocols that drive a system rapidly between states at minimum energetic cost. But for autonomous microscopic systems, driving processes are themselves stochastic. Here we generalize a linear-response framework to incorporate such protocol variability, deriving a lower bound on the work that is realized at finite protocol duration, far from the quasistatic limit. Our findings are confirmed in model systems. This theory provides a thermodynamic rationale for rapid operation, independent of functional incentives. △ Less

Submitted 22 November, 2018; v1 submitted 7 February, 2018; originally announced February 2018.

Comments: 11 pages, 4 figures

Journal ref: EPL, 124, (2018), 20001

Allocating and splitting free energy to maximize molecular machine flux

Authors: Aidan I Brown, David A Sivak

Abstract: Biomolecular machines transduce between different forms of energy. These machines make directed progress and increase their speed by consuming free energy, typically in the form of nonequilibrium chemical concentrations. Machine dynamics are often modeled by transitions between a set of discrete metastable conformational states. In general, the free energy change associated with each transition ca… ▽ More Biomolecular machines transduce between different forms of energy. These machines make directed progress and increase their speed by consuming free energy, typically in the form of nonequilibrium chemical concentrations. Machine dynamics are often modeled by transitions between a set of discrete metastable conformational states. In general, the free energy change associated with each transition can increase the forward rate constant, decrease the reverse rate constant, or both. In contrast to previous optimizations, we find that in general flux is neither maximized by devoting all free energy changes to increasing forward rate constants nor by solely decreasing reverse rate constants. Instead the optimal free energy splitting depends on the detailed dynamics. Extending our analysis to machines with vulnerable states (from which they can break down), in the strong driving corresponding to in vivo cellular conditions, processivity is maximized by reducing the occupation of the vulnerable state. △ Less

Submitted 27 October, 2017; originally announced October 2017.

Comments: 22 pages, 7 figures

Journal ref: J Phys Chem B 122(4), 1387-1393, 2018

Allocating dissipation across a molecular machine cycle to maximize flux

Authors: Aidan I Brown, David A Sivak

Abstract: Biomolecular machines consume free energy to break symmetry and make directed progress. Nonequilibrium ATP concentrations are the typical free energy source, with one cycle of a molecular machine consuming a certain number of ATP, providing a fixed free energy budget. Since evolution is expected to favor rapid-turnover machines that operate efficiently, we investigate how this free energy budget c… ▽ More Biomolecular machines consume free energy to break symmetry and make directed progress. Nonequilibrium ATP concentrations are the typical free energy source, with one cycle of a molecular machine consuming a certain number of ATP, providing a fixed free energy budget. Since evolution is expected to favor rapid-turnover machines that operate efficiently, we investigate how this free energy budget can be allocated to maximize flux. Unconstrained optimization eliminates intermediate metastable states, indicating that flux is enhanced in molecular machines with fewer states. When maintaining a set number of states, we show that---in contrast to previous findings---the flux-maximizing allocation of dissipation is not even. This result is consistent with the coexistence of both `irreversible' and reversible transitions in molecular machine models that successfully describe experimental data, which suggests that in evolved machines different transitions differ significantly in their dissipation. △ Less

Submitted 19 October, 2017; v1 submitted 15 March, 2017; originally announced March 2017.

Comments: 12 pages, 7 figures

Journal ref: Proc. Natl. Acad. Sci. USA. 2017, 114, 11057-11062

Toward the design principles of molecular machines

Authors: Aidan I Brown, David A Sivak

Abstract: Living things avoid equilibrium using molecular machines. Such microscopic soft-matter objects encounter relatively large friction and fluctuations. We discuss design principles for effective molecular machine operation in this unfamiliar context. Living things avoid equilibrium using molecular machines. Such microscopic soft-matter objects encounter relatively large friction and fluctuations. We discuss design principles for effective molecular machine operation in this unfamiliar context. △ Less

Submitted 18 May, 2017; v1 submitted 17 January, 2017; originally announced January 2017.

Comments: To be published in "Physics in Canada", vol. 73, issue 2 (2017)

Journal ref: Physics in Canada, vol. 73, issue 2 (2017)

Thermodynamic geometry of minimum-dissipation driven barrier crossing

Authors: David A. Sivak, Gavin E. Crooks

Abstract: We explore the thermodynamic geometry of a simple system that models the bistable dynamics of nucleic acid hairpins in single molecule force-extension experiments. Near equilibrium, optimal (minimum-dissipation) driving protocols are governed by a generalized linear response friction coefficient. Our analysis and simulations demonstrate that the friction coefficient of the driving protocols is sha… ▽ More We explore the thermodynamic geometry of a simple system that models the bistable dynamics of nucleic acid hairpins in single molecule force-extension experiments. Near equilibrium, optimal (minimum-dissipation) driving protocols are governed by a generalized linear response friction coefficient. Our analysis and simulations demonstrate that the friction coefficient of the driving protocols is sharply peaked at the interface between metastable regions, which leads to minimum-dissipation protocols that drive rapidly within a metastable basin, but then linger longest at the interface, giving thermal fluctuations maximal time to kick the system over the barrier. Intuitively, the same principle applies generically in free energy estimation (both in steered molecular dynamics simulations and in single-molecule experiments), provides a design principle for the construction of thermodynamically efficient coupling between stochastic objects, and makes a prediction regarding the construction of evolved biomolecular motors. △ Less

Submitted 3 November, 2016; v1 submitted 15 August, 2016; originally announced August 2016.

Comments: 8 pages, 8 figures

Journal ref: Physical Review E 94, 052106 (2016)

Effective dissipation: breaking time-reversal symmetry in driven microscopic energy transmission

Authors: Aidan I. Brown, David A. Sivak

Abstract: At molecular scales, fluctuations play a significant role and prevent biomolecular processes from always proceeding in a preferred direction, raising the question of how limited amounts of free energy can be dissipated to obtain directed progress. We examine the system and process characteristics that efficiently break time-reversal symmetry at fixed energy loss; in particular for a simple model o… ▽ More At molecular scales, fluctuations play a significant role and prevent biomolecular processes from always proceeding in a preferred direction, raising the question of how limited amounts of free energy can be dissipated to obtain directed progress. We examine the system and process characteristics that efficiently break time-reversal symmetry at fixed energy loss; in particular for a simple model of a molecular machine, an intermediate energy barrier produces unusually high asymmetry for a given dissipation. We relate the symmetry-breaking factors found in this model to recent observations of biomolecular machines. △ Less

Submitted 3 October, 2016; v1 submitted 20 July, 2016; originally announced July 2016.

Comments: 9 pages, 3 figures

Journal ref: Phys. Rev. E 94, 032137 (2016)

Ensemble Robustness and Generalization of Stochastic Deep Learning Algorithms

Authors: Tom Zahavy, Bingyi Kang, Alex Sivak, Jiashi Feng, Huan Xu, Shie Mannor

Abstract: The question why deep learning algorithms generalize so well has attracted increasing research interest. However, most of the well-established approaches, such as hypothesis capacity, stability or sparseness, have not provided complete explanations (Zhang et al., 2016; Kawaguchi et al., 2017). In this work, we focus on the robustness approach (Xu & Mannor, 2012), i.e., if the error of a hypothesis… ▽ More The question why deep learning algorithms generalize so well has attracted increasing research interest. However, most of the well-established approaches, such as hypothesis capacity, stability or sparseness, have not provided complete explanations (Zhang et al., 2016; Kawaguchi et al., 2017). In this work, we focus on the robustness approach (Xu & Mannor, 2012), i.e., if the error of a hypothesis will not change much due to perturbations of its training examples, then it will also generalize well. As most deep learning algorithms are stochastic (e.g., Stochastic Gradient Descent, Dropout, and Bayes-by-backprop), we revisit the robustness arguments of Xu & Mannor, and introduce a new approach, ensemble robustness, that concerns the robustness of a population of hypotheses. Through the lens of ensemble robustness, we reveal that a stochastic learning algorithm can generalize well as long as its sensitiveness to adversarial perturbations is bounded in average over training examples. Moreover, an algorithm may be sensitive to some adversarial examples (Goodfellow et al., 2015) but still generalize well. To support our claims, we provide extensive simulations for different deep learning algorithms and different network architectures exhibiting a strong correlation between ensemble robustness and the ability to generalize. △ Less

Submitted 5 November, 2017; v1 submitted 7 February, 2016; originally announced February 2016.

Comments: 16 pages, 2 figures

Environmental statistics and optimal regulation

Authors: David A. Sivak, Matt Thomson

Abstract: Any organism is embedded in an environment that changes over time. The timescale for and statistics of environmental change, the precision with which the organism can detect its environment, and the costs and benefits of particular protein expression levels all will affect the suitability of different strategies-such as constitutive expression or graded response-for regulating protein levels in re… ▽ More Any organism is embedded in an environment that changes over time. The timescale for and statistics of environmental change, the precision with which the organism can detect its environment, and the costs and benefits of particular protein expression levels all will affect the suitability of different strategies-such as constitutive expression or graded response-for regulating protein levels in response to environmental inputs. We propose a general framework-here specifically applied to the enzymatic regulation of metabolism in response to changing concentrations of a basic nutrient-to predict the optimal regulatory strategy given the statistics of fluctuations in the environment and measurement apparatus, respectively, and the costs associated with enzyme production. We use this framework to address three fundamental questions: (i) when a cell should prefer thresholding to a graded response; (ii) when there is a fitness advantage to implementing a Bayesian decision rule; and (iii) when retaining memory of the past provides a selective advantage. We specifically find that: (i) relative convexity of enzyme expression cost and benefit influences the fitness of thresholding or graded responses; (ii) intermediate levels of measurement uncertainty call for a sophisticated Bayesian decision rule; and (iii) in dynamic contexts, intermediate levels of uncertainty call for retaining memory of the past. Statistical properties of the environment, such as variability and correlation times, set optimal biochemical parameters, such as thresholds and decay rates in signaling pathways. Our framework provides a theoretical basis for interpreting molecular signal processing algorithms and a classification scheme that organizes known regulatory strategies and may help conceptualize heretofore unknown ones. △ Less

Submitted 6 August, 2014; v1 submitted 9 May, 2014; originally announced May 2014.

Comments: 21 pages, 7 figures

Journal ref: PLoS Comp Bio 10(9), e1003826, 2014

Optimal control of transitions between nonequilibrium steady states

Authors: Patrick R. Zulkowski, David A. Sivak, Michael R. DeWeese

Abstract: Biological systems fundamentally exist out of equilibrium in order to preserve organized structures and processes. Many changing cellular conditions can be represented as transitions between nonequilibrium steady states, and organisms have an interest in optimizing such transitions. Using the Hatano-Sasa Y-value, we extend a recently developed geometrical framework for determining optimal protocol… ▽ More Biological systems fundamentally exist out of equilibrium in order to preserve organized structures and processes. Many changing cellular conditions can be represented as transitions between nonequilibrium steady states, and organisms have an interest in optimizing such transitions. Using the Hatano-Sasa Y-value, we extend a recently developed geometrical framework for determining optimal protocols so that it can be applied to systems driven from nonequilibrium steady states. We calculate and numerically verify optimal protocols for a colloidal particle dragged through solution by a translating optical trap with two controllable parameters. We offer experimental predictions, specifically that optimal protocols are significantly less costly than naive ones. Optimal protocols similar to these may ultimately point to design principles for biological energy transduction systems and guide the design of artificial molecular machines. △ Less

Submitted 29 October, 2013; v1 submitted 26 March, 2013; originally announced March 2013.

Comments: Accepted for publication at PLoS ONE

Journal ref: PLoS ONE, 8(12), e82754, 2013

Time step rescaling recovers continuous-time dynamical properties for discrete-time Langevin integration of nonequilibrium systems

Authors: David A. Sivak, John D. Chodera, Gavin E. Crooks

Abstract: When simulating molecular systems using deterministic equations of motion (e.g., Newtonian dynamics), such equations are generally numerically integrated according to a well-developed set of algorithms that share commonly agreed-upon desirable properties. However, for stochastic equations of motion (e.g., Langevin dynamics), there is still broad disagreement over which integration algorithms are m… ▽ More When simulating molecular systems using deterministic equations of motion (e.g., Newtonian dynamics), such equations are generally numerically integrated according to a well-developed set of algorithms that share commonly agreed-upon desirable properties. However, for stochastic equations of motion (e.g., Langevin dynamics), there is still broad disagreement over which integration algorithms are most appropriate. While multiple desiderata have been proposed throughout the literature, consensus on which criteria are important is absent, and no published integration scheme satisfies all desiderata simultaneously. Additional nontrivial complications stem from simulating systems driven out of equilibrium using existing stochastic integration schemes in conjunction with recently-developed nonequilibrium fluctuation theorems. Here, we examine a family of discrete time integration schemes for Langevin dynamics, assessing how each member satisfies a variety of desiderata that have been enumerated in prior efforts to construct suitable Langevin integrators. We show that the incorporation of a novel time step rescaling in the deterministic updates of position and velocity can correct a number of dynamical defects in these integrators. Finally, we identify a particular splitting that has essentially universally appropriate properties for the simulation of Langevin dynamics for molecular systems in equilibrium, nonequilibrium, and path sampling contexts. △ Less

Submitted 9 April, 2014; v1 submitted 16 January, 2013; originally announced January 2013.

Comments: 15 pages, 2 figures, and 2 tables

Journal ref: J. Phys. Chem. B, 118, 6466-6474, 2014

The geometry of thermodynamic control

Authors: Patrick R. Zulkowski, David A. Sivak, Gavin E. Crooks, Michael R. DeWeese

Abstract: A deeper understanding of nonequilibrium phenomena is needed to reveal the principles governing natural and synthetic molecular machines. Recent work has shown that when a thermodynamic system is driven from equilibrium then, in the linear response regime, the space of controllable parameters has a Riemannian geometry induced by a generalized friction tensor. We exploit this geometric insight to c… ▽ More A deeper understanding of nonequilibrium phenomena is needed to reveal the principles governing natural and synthetic molecular machines. Recent work has shown that when a thermodynamic system is driven from equilibrium then, in the linear response regime, the space of controllable parameters has a Riemannian geometry induced by a generalized friction tensor. We exploit this geometric insight to construct closed-form expressions for minimal-dissipation protocols for a particle diffusing in a one dimensional harmonic potential, where the spring constant, inverse temperature, and trap location are adjusted simultaneously. These optimal protocols are geodesics on the Riemannian manifold, and reveal that this simple model has a surprisingly rich geometry. We test these optimal protocols via a numerical implementation of the Fokker-Planck equation and demonstrate that the friction tensor arises naturally from a first order expansion in temporal derivatives of the control parameters, without appealing directly to linear response theory. △ Less

Submitted 9 October, 2012; v1 submitted 22 August, 2012; originally announced August 2012.

Journal ref: Phys. Rev. E. 86, 0141148, 2012

The thermodynamics of prediction

Authors: Susanne Still, David A. Sivak, Anthony J. Bell, Gavin E. Crooks

Abstract: A system responding to a stochastic driving signal can be interpreted as computing, by means of its dynamics, an implicit model of the environmental variables. The system's state retains information about past environmental fluctuations, and a fraction of this information is predictive of future ones. The remaining nonpredictive information reflects model complexity that does not improve predictiv… ▽ More A system responding to a stochastic driving signal can be interpreted as computing, by means of its dynamics, an implicit model of the environmental variables. The system's state retains information about past environmental fluctuations, and a fraction of this information is predictive of future ones. The remaining nonpredictive information reflects model complexity that does not improve predictive power, and thus represents the ineffectiveness of the model. We expose the fundamental equivalence between this model inefficiency and thermodynamic inefficiency, measured by dissipation. Our results hold arbitrarily far from thermodynamic equilibrium and are applicable to a wide range of systems, including biomolecular machines. They highlight a profound connection between the effective use of information and efficient thermodynamic operation: any system constructed to keep memory about its environment and to operate with maximal energetic efficiency has to be predictive. △ Less

Submitted 5 October, 2012; v1 submitted 15 March, 2012; originally announced March 2012.

Comments: 5 pages, 1 figure

Journal ref: Phys. Rev. Lett. 109, 120604 (2012)

Thermodynamic metrics and optimal paths

Authors: David A. Sivak, Gavin E. Crooks

Abstract: A fundamental problem in modern thermodynamics is how a molecular-scale machine performs useful work, while operating away from thermal equilibrium without excessive dissipation. To this end, we derive a friction tensor that induces a Riemannian manifold on the space of thermodynamic states. Within the linear-response regime, this metric structure controls the dissipation of finite-time transforma… ▽ More A fundamental problem in modern thermodynamics is how a molecular-scale machine performs useful work, while operating away from thermal equilibrium without excessive dissipation. To this end, we derive a friction tensor that induces a Riemannian manifold on the space of thermodynamic states. Within the linear-response regime, this metric structure controls the dissipation of finite-time transformations, and bestows optimal protocols with many useful properties. We discuss the connection to the existing thermodynamic length formalism, and demonstrate the utility of this metric by solving for optimal control parameter protocols in a simple nonequilibrium model. △ Less

Submitted 8 May, 2012; v1 submitted 19 January, 2012; originally announced January 2012.

Comments: 5 pages

Journal ref: Phys. Rev. Lett., 108, 190602, 2012

Consequences of local inter-strand dehybridization for large-amplitude bending fluctuations of double-stranded DNA

Authors: David A. Sivak, Phillip L. Geissler

Abstract: The wormlike chain (WLC) model of DNA bending accurately reproduces single-molecule force-extension profiles of long (kilobase) chains. These bending statistics over large scales do not, however, establish a unique microscopic model for elasticity at the 1-10 bp scale, which holds particular interest in biological contexts. Here we examine a class of microscopic models which allow for disruption o… ▽ More The wormlike chain (WLC) model of DNA bending accurately reproduces single-molecule force-extension profiles of long (kilobase) chains. These bending statistics over large scales do not, however, establish a unique microscopic model for elasticity at the 1-10 bp scale, which holds particular interest in biological contexts. Here we examine a class of microscopic models which allow for disruption of base pairing (i.e., a `melt' or `kink', generically an `excitation') and consequently enhanced local flexibility. We first analyze the effect on the excitation free energy of integrating out the spatial degrees of freedom in a wormlike chain. Based on this analysis, we present a formulation of these models that ensures consistency with the well-established thermodynamics of melting in long chains. Using a new method to calculate cyclization statistics of short chains from enhanced-sampling Monte Carlo simulations, we compute J-factors of a meltable wormlike chain (MWLC) over a broad range of chain lengths, including very short molecules (30 bp) that have not yet been explored experimentally. For chains longer than about 120 bp, including most molecules studied to date in the laboratory, we find that melting excitations have little impact on cyclization kinetics. Strong signatures of melting, which might be resolved within typical experimental scatter, emerge only for shorter chains. △ Less

Submitted 31 October, 2011; v1 submitted 30 September, 2011; originally announced September 2011.

Comments: 13 pages, 5 figures

Journal ref: J. Chem. Phys. 136, 045102 (2012)

Using nonequilibrium fluctuation theorems to understand and correct errors in equilibrium and nonequilibrium discrete Langevin dynamics simulations

Authors: David A. Sivak, John D. Chodera, Gavin E. Crooks

Abstract: Common algorithms for computationally simulating Langevin dynamics must discretize the stochastic differential equations of motion. These resulting finite time step integrators necessarily have several practical issues in common: Microscopic reversibility is violated, the sampled stationary distribution differs from the desired equilibrium distribution, and the work accumulated in nonequilibrium s… ▽ More Common algorithms for computationally simulating Langevin dynamics must discretize the stochastic differential equations of motion. These resulting finite time step integrators necessarily have several practical issues in common: Microscopic reversibility is violated, the sampled stationary distribution differs from the desired equilibrium distribution, and the work accumulated in nonequilibrium simulations is not directly usable in estimators based on nonequilibrium work theorems. Here, we show that even with a time-independent Hamiltonian, finite time step Langevin integrators can be thought of as a driven, nonequilibrium physical process. Once an appropriate work-like quantity is defined -- here called the shadow work -- recently developed nonequilibrium fluctuation theorems can be used to measure or correct for the errors introduced by the use of finite time steps. In particular, we demonstrate that amending estimators based on nonequilibrium work theorems to include this shadow work removes the time step dependent error from estimates of free energies. We also quantify, for the first time, the magnitude of deviations between the sampled stationary distribution and the desired equilibrium distribution for equilibrium Langevin simulations of solvated systems of varying size. While these deviations can be large, they can be eliminated altogether by Metropolization or greatly diminished by small reductions in the time step. Through this connection with driven processes, further developments in nonequilibrium fluctuation theorems can provide additional analytical tools for dealing with errors in finite time step integrators. △ Less

Submitted 29 January, 2013; v1 submitted 14 July, 2011; originally announced July 2011.

Comments: 11 pages, 4 figures

Journal ref: Phys. Rev. X, 3, 011007, 2013

Near-equilibrium measurements of nonequilibrium free energy

Authors: David A. Sivak, Gavin E. Crooks

Abstract: A central endeavor of thermodynamics is the measurement of free energy changes. Regrettably, although we can measure the free energy of a system in thermodynamic equilibrium, typically all we can say about the free energy of a non-equilibrium ensemble is that it is larger than that of the same system at equilibrium. Herein, we derive a formally exact expression for the probability distribution of… ▽ More A central endeavor of thermodynamics is the measurement of free energy changes. Regrettably, although we can measure the free energy of a system in thermodynamic equilibrium, typically all we can say about the free energy of a non-equilibrium ensemble is that it is larger than that of the same system at equilibrium. Herein, we derive a formally exact expression for the probability distribution of a driven system, which involves path ensemble averages of the work over trajectories of the time-reversed system. From this we find a simple near-equilibrium approximation for the free energy in terms of an excess mean time-reversed work, which can be experimentally measured on real systems. With analysis and computer simulation, we demonstrate the accuracy of our approximations for several simple models. △ Less

Submitted 9 April, 2012; v1 submitted 14 December, 2009; originally announced December 2009.

Comments: 5 pages, 3 figures

Journal ref: Physical Review Letters, 108, 150601, 2012

Asymptotic analysis of a boundary-value problem with the nonlinear boundary multiphase interactions in a perforated domain

Authors: Taras A. Mel'nyk, Olena A. Sivak

Abstract: We consider a boundary-value problem for the second order elliptic differential operator with rapidly oscillating coefficients in a domain $Ω_ε$ that is $ε-$periodically perforated by small holes. The holes are divided into two $ε-$periodical sets depending on the boundary interaction at their surfaces. Therefore, two different nonlinear Robin boundary conditions… ▽ More We consider a boundary-value problem for the second order elliptic differential operator with rapidly oscillating coefficients in a domain $Ω_ε$ that is $ε-$periodically perforated by small holes. The holes are divided into two $ε-$periodical sets depending on the boundary interaction at their surfaces. Therefore, two different nonlinear Robin boundary conditions $σ_ε(u_ε) + εκ_{m} (u_ε) = εg^{(m)}_ε, m=1, 2,$ are given on the corresponding boundaries of the small holes. The asymptotic analysis of this problem is made as $ε\to0,$ namely the convergence theorem both for the solution and for the energy integral is proved without using extension operators, the asymptotic approximations both for the solution and for the energy integral are constructed and the corresponding error estimates are obtained. △ Less

Submitted 13 June, 2008; originally announced June 2008.