Showing 1–26 of 26 results for author: Vanden-Eijnden, E

FEAT: Free energy Estimators with Adaptive Transport

Authors: Jiajun He, Yuanqi Du, Francisco Vargas, Yuanqing Wang, Carla P. Gomes, José Miguel Hernández-Lobato, Eric Vanden-Eijnden

Abstract: We present Free energy Estimators with Adaptive Transport (FEAT), a novel framework for free energy estimation -- a critical challenge across scientific domains. FEAT leverages learned transports implemented via stochastic interpolants and provides consistent, minimum-variance estimators based on escorted Jarzynski equality and controlled Crooks theorem, alongside variational upper and lower bound… ▽ More We present Free energy Estimators with Adaptive Transport (FEAT), a novel framework for free energy estimation -- a critical challenge across scientific domains. FEAT leverages learned transports implemented via stochastic interpolants and provides consistent, minimum-variance estimators based on escorted Jarzynski equality and controlled Crooks theorem, alongside variational upper and lower bounds on free energy differences. Unifying equilibrium and non-equilibrium methods under a single theoretical framework, FEAT establishes a principled foundation for neural free energy calculations. Experimental validation on toy examples, molecular simulations, and quantum field theory demonstrates improvements over existing learning-based methods. △ Less

Submitted 15 April, 2025; originally announced April 2025.

Comments: 29 pages, 2 tables, 3 figures

Computing equilibrium free energies through a nonequilibrium quench

Authors: Kangxin Liu, Grant M. Rotskoff, Eric Vanden-Eijnden, Glen M. Hocky

Abstract: Many methods to accelerate sampling of molecular configurations are based on the idea that temperature can be used to accelerate rare transitions. These methods typically compute equilibrium properties at a target temperature using reweighting or through Monte Carlo exchanges between replicas at higher temperatures. A recent paper demonstrated that accurate equilibrium densities of states can also… ▽ More Many methods to accelerate sampling of molecular configurations are based on the idea that temperature can be used to accelerate rare transitions. These methods typically compute equilibrium properties at a target temperature using reweighting or through Monte Carlo exchanges between replicas at higher temperatures. A recent paper demonstrated that accurate equilibrium densities of states can also be computed through a nonequilibrium "quench" process, where sampling is performed at a higher temperature to encourage rapid mixing and then quenched to lower energy states with dissipative dynamics. Here we provide an implementation of the quench dynamics in LAMMPS and evaluate a new formulation of nonequilibrium estimators for the computation of partition functions or free energy surfaces (FESs) of molecular systems. We show that the method is exact for a minimal model of $N$-independent harmonic springs, and use these analytical results to develop heuristics for the amount of quenching required to obtain accurate sampling.= We then test the quench approach on alanine dipeptide, where we show that it gives an FES that is accurate near the most stable configurations using the quench approach, but disagrees with a reference umbrella sampling calculation in high FE regions. We then show that combining quenching with umbrella sampling allows the efficient calculation of the free energy in all regions. Moreover, by using this combined scheme, we obtain the FES across a range of temperatures at no additional cost, making it much more efficient than standard umbrella sampling if this information is required. Finally, we discuss how this approach can be extended to solute tempering and demonstrate that it is highly accurate for the case of solvated alanine dipeptide without any additional modifications. △ Less

Submitted 28 November, 2023; v1 submitted 10 September, 2023; originally announced September 2023.

Comments: 20 pages, with 8 figures, 1 table, and 12 supplemental figures

Anomalous Statistics and Large Deviations of Turbulent Water Waves past a Step

Authors: Di Qi, Eric Vanden-Eijnden

Abstract: A computational strategy based on large deviation theory (LDT) is used to study the anomalous statistical features of turbulent surface waves propagating past an abrupt depth change created via a step in the bottom topography. The dynamics of the outgoing waves past the step are modeled using the truncated Korteweg-de Vries (TKdV) equation with random initial conditions at the step drawn from the… ▽ More A computational strategy based on large deviation theory (LDT) is used to study the anomalous statistical features of turbulent surface waves propagating past an abrupt depth change created via a step in the bottom topography. The dynamics of the outgoing waves past the step are modeled using the truncated Korteweg-de Vries (TKdV) equation with random initial conditions at the step drawn from the system's Gibbs invariant measure of the incoming waves. Within the LDT framework, the probability distributions of the wave height can be obtained via the solution of a deterministic optimization problem. Detailed numerical tests show that this approach accurately captures the non-Gaussian features of the wave height distributions, in particular their asymmetric tails leading to high skewness. These calculations also give the spatio-temporal pattern of the anomalous waves most responsible for these non-Gaussian features. The strategy shows potential for a general class of nonlinear Hamiltonian systems with highly non-Gaussian statistics. △ Less

Submitted 16 December, 2021; originally announced December 2021.

Estimating earthquake-induced tsunami height probabilities without sampling

Authors: Shanyin Tong, Eric Vanden-Eijnden, Georg Stadler

Abstract: Given a distribution of earthquake-induced seafloor elevations, we present a method to compute the probability of the resulting tsunamis reaching a certain size on shore. Instead of sampling, the proposed method relies on optimization to compute the most likely fault slips that result in a seafloor deformation inducing a large tsunami wave. We model tsunamis induced by bathymetry change using the… ▽ More Given a distribution of earthquake-induced seafloor elevations, we present a method to compute the probability of the resulting tsunamis reaching a certain size on shore. Instead of sampling, the proposed method relies on optimization to compute the most likely fault slips that result in a seafloor deformation inducing a large tsunami wave. We model tsunamis induced by bathymetry change using the shallow water equations on an idealized slice through the sea. The earthquake slip model is based on a sum of multivariate log-normal distributions, and follows the Gutenberg-Richter law for moment magnitudes 7--9. For a model problem inspired by the Tohoku-Oki 2011 earthquake and tsunami, we quantify annual probabilities of differently sized tsunami waves. Our method also identifies the most effective tsunami mechanisms. These mechanisms have smoothly varying fault slip patches that lead to an expansive but moderately large bathymetry change. The resulting tsunami waves are compressed as they approach shore and reach close-to-vertical leading wave edge close to shore. △ Less

Submitted 7 April, 2023; v1 submitted 28 November, 2021; originally announced November 2021.

Efficient Bayesian Sampling Using Normalizing Flows to Assist Markov Chain Monte Carlo Methods

Authors: Marylou Gabrié, Grant M. Rotskoff, Eric Vanden-Eijnden

Abstract: Normalizing flows can generate complex target distributions and thus show promise in many applications in Bayesian statistics as an alternative or complement to MCMC for sampling posteriors. Since no data set from the target posterior distribution is available beforehand, the flow is typically trained using the reverse Kullback-Leibler (KL) divergence that only requires samples from a base distrib… ▽ More Normalizing flows can generate complex target distributions and thus show promise in many applications in Bayesian statistics as an alternative or complement to MCMC for sampling posteriors. Since no data set from the target posterior distribution is available beforehand, the flow is typically trained using the reverse Kullback-Leibler (KL) divergence that only requires samples from a base distribution. This strategy may perform poorly when the posterior is complicated and hard to sample with an untrained normalizing flow. Here we explore a distinct training strategy, using the direct KL divergence as loss, in which samples from the posterior are generated by (i) assisting a local MCMC algorithm on the posterior with a normalizing flow to accelerate its mixing rate and (ii) using the data generated this way to train the flow. The method only requires a limited amount of \textit{a~priori} input about the posterior, and can be used to estimate the evidence required for model validation, as we illustrate on examples. △ Less

Submitted 16 July, 2021; originally announced July 2021.

Adaptive Monte Carlo augmented with normalizing flows

Authors: Marylou Gabrié, Grant M. Rotskoff, Eric Vanden-Eijnden

Abstract: Many problems in the physical sciences, machine learning, and statistical inference necessitate sampling from a high-dimensional, multi-modal probability distribution. Markov Chain Monte Carlo (MCMC) algorithms, the ubiquitous tool for this task, typically rely on random local updates to propagate configurations of a given system in a way that ensures that generated configurations will be distribu… ▽ More Many problems in the physical sciences, machine learning, and statistical inference necessitate sampling from a high-dimensional, multi-modal probability distribution. Markov Chain Monte Carlo (MCMC) algorithms, the ubiquitous tool for this task, typically rely on random local updates to propagate configurations of a given system in a way that ensures that generated configurations will be distributed according to a target probability distribution asymptotically. In high-dimensional settings with multiple relevant metastable basins, local approaches require either immense computational effort or intricately designed importance sampling strategies to capture information about, for example, the relative populations of such basins. Here we analyze an adaptive MCMC which augments MCMC sampling with nonlocal transition kernels parameterized with generative models known as normalizing flows. We focus on a setting where there is no preexisting data, as is commonly the case for problems in which MCMC is used. Our method uses: (i) a MCMC strategy that blends local moves obtained from any standard transition kernel with those from a generative model to accelerate the sampling and (ii) the data generated this way to adapt the generative model and improve its efficacy in the MCMC algorithm. We provide a theoretical analysis of the convergence properties of this algorithm, and investigate numerically its efficiency, in particular in terms of its propensity to equilibrate fast between metastable modes whose rough location is known \textit{a~priori} but respective probability weight is not. We show that our algorithm can sample effectively across large free energy barriers, providing dramatic accelerations relative to traditional MCMC algorithms. △ Less

Submitted 7 February, 2022; v1 submitted 26 May, 2021; originally announced May 2021.

Sharp Asymptotic Estimates for Expectations, Probabilities, and Mean First Passage Times in Stochastic Systems with Small Noise

Authors: Tobias Grafke, Tobias Schäfer, Eric Vanden-Eijnden

Abstract: Freidlin-Wentzell theory of large deviations can be used to compute the likelihood of extreme or rare events in stochastic dynamical systems via the solution of an optimization problem. The approach gives exponential estimates that often need to be refined via calculation of a prefactor. Here it is shown how to perform these computations in practice. Specifically, sharp asymptotic estimates are de… ▽ More Freidlin-Wentzell theory of large deviations can be used to compute the likelihood of extreme or rare events in stochastic dynamical systems via the solution of an optimization problem. The approach gives exponential estimates that often need to be refined via calculation of a prefactor. Here it is shown how to perform these computations in practice. Specifically, sharp asymptotic estimates are derived for expectations, probabilities, and mean first passage times in a form that is geared towards numerical purposes: they require solving well-posed matrix Riccati equations involving the minimizer of the Freidlin-Wentzell action as input, either forward or backward in time with appropriate initial or final conditions tailored to the estimate at hand. The usefulness of our approach is illustrated on several examples. In particular, invariant measure probabilities and mean first passage times are calculated in models involving stochastic partial differential equations of reaction-advection-diffusion type. △ Less

Submitted 15 September, 2021; v1 submitted 8 March, 2021; originally announced March 2021.

Active Importance Sampling for Variational Objectives Dominated by Rare Events: Consequences for Optimization and Generalization

Authors: Grant M. Rotskoff, Andrew R. Mitchell, Eric Vanden-Eijnden

Abstract: Deep neural networks, when optimized with sufficient data, provide accurate representations of high-dimensional functions; in contrast, function approximation techniques that have predominated in scientific computing do not scale well with dimensionality. As a result, many high-dimensional sampling and approximation problems once thought intractable are being revisited through the lens of machine… ▽ More Deep neural networks, when optimized with sufficient data, provide accurate representations of high-dimensional functions; in contrast, function approximation techniques that have predominated in scientific computing do not scale well with dimensionality. As a result, many high-dimensional sampling and approximation problems once thought intractable are being revisited through the lens of machine learning. While the promise of unparalleled accuracy may suggest a renaissance for applications that require parameterizing representations of complex systems, in many applications gathering sufficient data to develop such a representation remains a significant challenge. Here we introduce an approach that combines rare events sampling techniques with neural network optimization to optimize objective functions that are dominated by rare events. We show that importance sampling reduces the asymptotic variance of the solution to a learning problem, suggesting benefits for generalization. We study our algorithm in the context of learning dynamical transition pathways between two states of a system, a problem with applications in statistical physics and implications in machine learning theory. Our numerical experiments demonstrate that we can successfully learn even with the compounding difficulties of high-dimension and rare data. △ Less

Submitted 11 March, 2021; v1 submitted 11 August, 2020; originally announced August 2020.

Infinite Switch Simulated Tempering in Force (FISST)

Authors: Michael J. Hartmann, Yuvraj Singh, Eric Vanden-Eijnden, Glen M. Hocky

Abstract: Many proteins in cells are capable of sensing and responding to piconewton scale forces, a regime in which conformational changes are small but significant for biological processes. In order to efficiently and effectively sample the response of these proteins to small forces, enhanced sampling techniques will be required. In this work, we derive, implement, and evaluate an efficient method to simu… ▽ More Many proteins in cells are capable of sensing and responding to piconewton scale forces, a regime in which conformational changes are small but significant for biological processes. In order to efficiently and effectively sample the response of these proteins to small forces, enhanced sampling techniques will be required. In this work, we derive, implement, and evaluate an efficient method to simultaneously sample the result of applying any constant pulling force within a specified range to a molecular system of interest. We start from Simulated Tempering in Force, whereby force is applied as a linear bias on a collective variable to the system's Hamiltonian, and the coefficient is taken as a continuous auxiliary degree of freedom. We derive a formula for an average collective-variable-dependent force, which depends on a set of weights, learned on-the-fly throughout a simulation, that reflect the limit where force varies infinitely quickly. These weights can then be used to retroactively compute averages of any observable at any force within the specified range. This technique is based on recent work deriving similar equations for Infinite Switch Simulated Tempering in Temperature, that showed the infinite switch limit is the most efficient for sampling. Here, we demonstrate that our method accurately and simultaneously samples molecular systems at all forces within a user defined force range, and show how it can serve as an enhanced sampling tool for cases where the pulling direction destabilizes states of low free-energy at zero-force. This method is implemented in, and will be freely-distributed with, the PLUMED open-source sampling library, and hence can be readily applied to problems using a wide range of molecular dynamics software packages. △ Less

Submitted 30 October, 2019; originally announced October 2019.

Comments: 15 pages w/ 4 figures + Appendix of 7 pages w/ 6 figures

Journal ref: J. Chem. Phys. 152, 244120 (2020)

Experimental Evidence of Hydrodynamic Instantons: The Universal Route to Rogue Waves

Authors: Giovanni Dematteis, Tobias Grafke, Miguel Onorato, Eric Vanden-Eijnden

Abstract: A statistical theory of rogue waves is proposed and tested against experimental data collected in a long water tank where random waves with different degrees of nonlinearity are mechanically generated and free to propagate along the flume. Strong evidence is given that the rogue waves observed in the tank are hydrodynamic instantons, that is, saddle point configurations of the action associated wi… ▽ More A statistical theory of rogue waves is proposed and tested against experimental data collected in a long water tank where random waves with different degrees of nonlinearity are mechanically generated and free to propagate along the flume. Strong evidence is given that the rogue waves observed in the tank are hydrodynamic instantons, that is, saddle point configurations of the action associated with the stochastic model of the wave system. As shown here, these hydrodynamic instantons are complex spatio-temporal wave field configurations, which can be defined using the mathematical framework of Large Deviation Theory and calculated via tailored numerical methods. These results indicate that the instantons describe equally well rogue waves that originate from a simple linear superposition mechanism (in weakly nonlinear conditions) or from a nonlinear focusing one (in strongly nonlinear conditions), paving the way for the development of a unified explanation to rogue wave formation. △ Less

Submitted 8 November, 2019; v1 submitted 2 July, 2019; originally announced July 2019.

Journal ref: Phys. Rev. X 9, 041057 (2019)

Simulated Tempering Method in the Infinite Switch Limit with Adaptive Weight Learning

Authors: Anton Martinsson, Jianfeng Lu, Benedict Leimkuhler, Eric Vanden-Eijnden

Abstract: We investigate the theoretical foundations of the simulated tempering method and use our findings to design efficient algorithms. Employing a large deviation argument first used for replica exchange molecular dynamics [Plattner et al., J. Chem. Phys. 135:134111 (2011)], we demonstrate that the most efficient approach to simulated tempering is to vary the temperature infinitely rapidly. In this lim… ▽ More We investigate the theoretical foundations of the simulated tempering method and use our findings to design efficient algorithms. Employing a large deviation argument first used for replica exchange molecular dynamics [Plattner et al., J. Chem. Phys. 135:134111 (2011)], we demonstrate that the most efficient approach to simulated tempering is to vary the temperature infinitely rapidly. In this limit, we can replace the equations of motion for the temperature and physical variables by averaged equations for the latter alone, with the forces rescaled according to a position-dependent function defined in terms of temperature weights. The averaged equations are similar to those used in Gao's integrated-over-temperature method, except that we show that it is better to use a continuous rather than a discrete set of temperatures. We give a theoretical argument for the choice of the temperature weights as the reciprocal partition function, thereby relating simulated tempering to Wang-Landau sampling. Finally, we describe a self-consistent algorithm for simultaneously sampling the canonical ensemble and learning the weights during simulation. This algorithm is tested on a system of harmonic oscillators as well as a continuous variant of the Curie-Weiss model, where it is shown to perform well and to accurately capture the second-order phase transition observed in this model. △ Less

Submitted 7 February, 2019; v1 submitted 13 September, 2018; originally announced September 2018.

Methodological and computational aspects of parallel tempering methods in the infinite swapping limit

Authors: Jianfeng Lu, Eric Vanden-Eijnden

Abstract: A variant of the parallel tempering method is proposed in terms of a stochastic switching process for the coupled dynamics of replica configuration and temperature permutation. This formulation is shown to facilitate the analysis of the convergence properties of parallel tempering by large deviation theory, which indicates that the method should be operated in the infinite swapping limit to maximi… ▽ More A variant of the parallel tempering method is proposed in terms of a stochastic switching process for the coupled dynamics of replica configuration and temperature permutation. This formulation is shown to facilitate the analysis of the convergence properties of parallel tempering by large deviation theory, which indicates that the method should be operated in the infinite swapping limit to maximize sampling efficiency. The effective equation for the replica alone that arises in this infinite swapping limit simply involves replacing the original potential by a mixture potential. The analysis of the geometric properties of this potential offers a new perspective on the issues of how to choose of temperature ladder, and why many temperatures should typically be introduced to boost the sampling efficiency. It is also shown how to simulate the effective equation in this many temperature regime using multiscale integrators. Finally, similar ideas are also used to discuss extensions of the infinite swapping limits to the technique of simulated tempering. △ Less

Submitted 19 December, 2017; originally announced December 2017.

Rogue Waves and Large Deviations in Deep Sea

Authors: Giovanni Dematteis, Tobias Grafke, Eric Vanden-Eijnden

Abstract: The appearance of rogue waves in deep sea is investigated using the modified nonlinear Schrödinger (MNLS) equation in one spatial-dimension with random initial conditions that are assumed to be normally distributed, with a spectrum approximating realistic conditions of a uni-directional sea state. It is shown that one can use the incomplete information contained in this spectrum as prior and suppl… ▽ More The appearance of rogue waves in deep sea is investigated using the modified nonlinear Schrödinger (MNLS) equation in one spatial-dimension with random initial conditions that are assumed to be normally distributed, with a spectrum approximating realistic conditions of a uni-directional sea state. It is shown that one can use the incomplete information contained in this spectrum as prior and supplement this information with the MNLS dynamics to reliably estimate the probability distribution of the sea surface elevation far in the tail at later times. Our results indicate that rogue waves occur when the system hits unlikely pockets of wave configurations that trigger large disturbances of the surface height. The rogue wave precursors in these pockets are wave patterns of regular height but with a very specific shape that is identified explicitly, thereby allowing for early detection. The method proposed here combines Monte Carlo sampling with tools from large deviations theory that reduce the calculation of the most likely rogue wave precursors to an optimization problem that can be solved efficiently. This approach is transferable to other problems in which the system's governing equations contain random initial conditions and/or parameters. △ Less

Submitted 23 January, 2018; v1 submitted 5 April, 2017; originally announced April 2017.

A Mathematical Theory of Optimal Milestoning (with a Detour via Exact Milestoning)

Authors: Ling Lin, Jianfeng Lu, Eric Vanden-Eijnden

Abstract: Milestoning is a computational procedure that reduces the dynamics of complex systems to memoryless jumps between intermediates, or milestones, and only retains some information about the probability of these jumps and the time lags between them. Here we analyze a variant of this procedure, termed optimal milestoning, which relies on a specific choice of milestones to capture exactly some kinetic… ▽ More Milestoning is a computational procedure that reduces the dynamics of complex systems to memoryless jumps between intermediates, or milestones, and only retains some information about the probability of these jumps and the time lags between them. Here we analyze a variant of this procedure, termed optimal milestoning, which relies on a specific choice of milestones to capture exactly some kinetic features of the original dynamical system. In particular, we prove that optimal milestoning permits the exact calculation of the mean first passage times (MFPT) between any two milestones. In so doing, we also analyze another variant of the method, called exact milestoning, which also permits the exact calculation of certain MFPTs, but at the price of retaining more information about the original system's dynamics. Finally, we discuss importance sampling strategies based on optimal and exact milestoning that can be used to bypass the simulation of the original system when estimating the statistical quantities used in these methods. △ Less

Submitted 12 March, 2017; v1 submitted 8 September, 2016; originally announced September 2016.

Comments: 23 pages

Optimized Markov State Models for Metastable Systems

Authors: Enrico Guarnera, Eric Vanden-Eijnden

Abstract: A method is proposed to identify target states that optimize a metastability index amongst a set of trial states and use these target states as milestones (or core sets) to build Markov State Models (MSMs). If the optimized metastability index is small, this automatically guarantees the accuracy of the MSM, in the sense that the transitions between the target milestones is indeed approximately Mar… ▽ More A method is proposed to identify target states that optimize a metastability index amongst a set of trial states and use these target states as milestones (or core sets) to build Markov State Models (MSMs). If the optimized metastability index is small, this automatically guarantees the accuracy of the MSM, in the sense that the transitions between the target milestones is indeed approximately Markovian. The method is simple to implement and use, it does not require that the dynamics on the trial milestones be Markovian, and it also offers the possibility to partition the system's state-space by assigning every trial milestone to the target milestones it is most likely to visit next and to identify transition state regions. Here the method is tested on the Gly-Ala-Gly peptide, where it shown to correctly identify the expected metastable states in the dihedral angle space of the molecule without \textit{a~priori} information about these states. It is also applied to analyze the folding landscape of the Beta3s mini-protein, where it is shown to identify the folded basin as a connecting hub between an helix-rich region, which is entropically stabilized, and a beta-rich region, which is energetically stabilized and acts as a kinetic trap. △ Less

Submitted 20 June, 2016; v1 submitted 4 May, 2016; originally announced May 2016.

Comments: 15 pages, 12 figures, accepted for publication in J. Chem. Phys

Relevance of instantons in Burgers turbulence

Authors: Tobias Grafke, Rainer Grauer, Tobias Schäfer, Eric Vanden-Eijnden

Abstract: Instanton calculations are performed in the context of stationary Burgers turbulence to estimate the tails of the probability density function (PDF) of velocity gradients. These results are then compared to those obtained from massive direct numerical simulations (DNS) of the randomly forced Burgers equation. The instanton predictions are shown to agree with the DNS in a wide range of regimes, inc… ▽ More Instanton calculations are performed in the context of stationary Burgers turbulence to estimate the tails of the probability density function (PDF) of velocity gradients. These results are then compared to those obtained from massive direct numerical simulations (DNS) of the randomly forced Burgers equation. The instanton predictions are shown to agree with the DNS in a wide range of regimes, including those that are far from the limiting cases previously considered in the literature. These results settle the controversy of the relevance of the instanton approach for the prediction of the velocity gradient PDF tail exponents. They also demonstrate the usefulness of the instanton formalism in Burgers turbulence, and suggest that this approach may be applicable in other contexts, such as 2D and 3D turbulence in compressible and incompressible flows. △ Less

Submitted 30 November, 2014; originally announced December 2014.

Arclength parametrized Hamilton's equations for the calculation of instantons

Authors: Tobias Grafke, Rainer Grauer, Tobias Schäfer, Eric Vanden-Eijnden

Abstract: A method is presented to compute minimizers (instantons) of action functionals using arclength parametrization of Hamilton's equations. This method can be interpreted as a local variant of the geometric minimum action method (gMAM) introduced to compute minimizers of the Freidlin-Wentzell action functional that arises in the context of large deviation theory for stochastic differential equations.… ▽ More A method is presented to compute minimizers (instantons) of action functionals using arclength parametrization of Hamilton's equations. This method can be interpreted as a local variant of the geometric minimum action method (gMAM) introduced to compute minimizers of the Freidlin-Wentzell action functional that arises in the context of large deviation theory for stochastic differential equations. The method is particularly well-suited to calculate expectations dominated by noise-induced excursions from deterministically stable fixpoints. Its simplicity and computational efficiency are illustrated here using several examples: a finite-dimensional stochastic dynamical system (an Ornstein-Uhlenbeck model) and two models based on stochastic partial differential equations: the $φ^4$-model and the stochastically driven Burgers equation. △ Less

Submitted 20 September, 2013; originally announced September 2013.

Comments: 15 pages, 6 figures

Temporal Integrators for Fluctuating Hydrodynamics

Authors: S. Delong, B. E. Griffith, E. Vanden-Eijnden, A. Donev

Abstract: Including the effect of thermal fluctuations in traditional computational fluid dynamics requires developing numerical techniques for solving the stochastic partial differential equations of fluctuating hydrodynamics. These Langevin equations possess a special fluctuation-dissipation structure that needs to be preserved by spatio-temporal discretizations in order for the computed solution to repro… ▽ More Including the effect of thermal fluctuations in traditional computational fluid dynamics requires developing numerical techniques for solving the stochastic partial differential equations of fluctuating hydrodynamics. These Langevin equations possess a special fluctuation-dissipation structure that needs to be preserved by spatio-temporal discretizations in order for the computed solution to reproduce the correct long-time behavior. In particular, numerical solutions should approximate the Gibbs-Boltzmann equilibrium distribution, and ideally this will hold even for large time step sizes. We describe finite-volume spatial discretizations for the fluctuating Burgers and fluctuating incompressible Navier-Stokes equations that obey a discrete fluctuation-dissipation balance principle just like the continuum equations. We develop implicit-explicit predictor-corrector temporal integrators for the resulting stochastic method-of-lines discretization. These stochastic Runge-Kutta schemes treat diffusion implicitly and advection explicitly, are weakly second-order accurate for additive noise for small time steps, and give a good approximation to the equilibrium distribution even for very strong fluctuations. Numerical results demonstrate that a midpoint predictor-corrector scheme is very robust over a broad range of time step sizes. △ Less

Submitted 21 February, 2013; v1 submitted 5 December, 2012; originally announced December 2012.

Comments: Submitted to Phys. Rev. E

Thermal Stability of the Magnetization in Perpendicularly Magnetized Thin Film Nanomagnets

Authors: Gabriel D. Chaves-OFlynn, Eric Vanden-Eijnden, D. L. Stein, A. D. Kent

Abstract: Understanding the stability of thin film nanomagnets with perpendicular magnetic anisotropy (PMA) against thermally induced magnetization reversal is important when designing perpendicularly magnetized patterned media and magnetic random access memories. The leading-order dependence of magnetization reversal rates are governed by the energy barrier the system needs to surmount in order for reversa… ▽ More Understanding the stability of thin film nanomagnets with perpendicular magnetic anisotropy (PMA) against thermally induced magnetization reversal is important when designing perpendicularly magnetized patterned media and magnetic random access memories. The leading-order dependence of magnetization reversal rates are governed by the energy barrier the system needs to surmount in order for reversal to proceed. In this paper we study the reversal dynamics of these systems and compute the relevant barriers using the string method of E, Vanden-Eijnden, and Ren. We find the reversal to be often spatially incoherent; that is, rather than the magnetization flipping as a rigid unit, reversal proceeds instead through a soliton-like domain wall sweeping through the system. We show that for square nanomagnetic elements the energy barrier increases with element size up to a critical length scale, beyond which the energy barrier is constant. For circular elements the energy barrier continues to increase indefinitely, albeit more slowly beyond a critical size. In both cases the energy barriers are smaller than those expected for coherent magnetization reversal. △ Less

Submitted 26 August, 2012; originally announced August 2012.

Comments: 5 pages, 4 Figures

Journal ref: Journal of Applied Physics 113, 023912 (2013)

Force-clamp analysis techniques reveal stretched exponential unfolding kinetics in ubiquitin

Authors: Herbert Lannon, Eric Vanden-Eijnden, Jasna Brujic

Abstract: Force-clamp spectroscopy reveals the unfolding and disulfide bond rupture times of single protein molecules as a function of the stretching force, point mutations and solvent conditions. The statistics of these times reveal whether the protein domains are independent of one another, the mechanical hierarchy in the polyprotein chain, and the functional form of the probability distribution from whic… ▽ More Force-clamp spectroscopy reveals the unfolding and disulfide bond rupture times of single protein molecules as a function of the stretching force, point mutations and solvent conditions. The statistics of these times reveal whether the protein domains are independent of one another, the mechanical hierarchy in the polyprotein chain, and the functional form of the probability distribution from which they originate. It is therefore important to use robust statistical tests to decipher the correct theoretical model underlying the process. Here we develop multiple techniques to compare the well-established experimental data set on ubiquitin with existing theoretical models as a case study. We show that robustness against filtering, agreement with a maximum likelihood function that takes into account experimental artifacts, the Kuiper statistic test and alignment with synthetic data all identify the Weibull or stretched exponential distribution as the best fitting model. Our results are inconsistent with recently proposed models of Gaussian disorder in the energy landscape or noise in the applied force as explanations for the observed non-exponential kinetics. Since the physical model in the fit affects the characteristic unfolding time, these results have important implications on our understanding of the biological function of proteins. △ Less

Submitted 18 August, 2012; originally announced August 2012.

Journal ref: Biophys.J. 103 (2012) 2215-2222

Force-clamp experiments reveal the free energy profile and diffusion coefficient of the collapse of proteins

Authors: Herbert Lannon, Eric Vanden-Eijnden, Jasna Brujic

Abstract: We present force-clamp data on the collapse of ubiquitin polyproteins in response to a quench in the force. These nonequilibrium trajectories are analyzed using a general method based on a diffusive assumption of the end-to-end length to reconstruct a downhill free energy profile at 5pN and an energy plateau at 10pN with a slow diffusion coefficient on the order of~100nm^2/s. The shape of the free… ▽ More We present force-clamp data on the collapse of ubiquitin polyproteins in response to a quench in the force. These nonequilibrium trajectories are analyzed using a general method based on a diffusive assumption of the end-to-end length to reconstruct a downhill free energy profile at 5pN and an energy plateau at 10pN with a slow diffusion coefficient on the order of~100nm^2/s. The shape of the free energy and its linear scaling with the protein length give validity to a physical model for the collapse. However, the length independent diffusion coefficient suggests that internal rather than viscous friction dominates and thermal noise is needed to capture the variability in the measured times to collapse. △ Less

Submitted 7 August, 2012; v1 submitted 29 July, 2012; originally announced July 2012.

Comments: 12 pages, 4 figures

Journal ref: Phys.Rev.Lett. 110 (2013) 128301-128305

Data assimilation in the low noise regime with application to the Kuroshio

Authors: Eric Vanden-Eijnden, Jonathan Weare

Abstract: On-line data assimilation techniques such as ensemble Kalman filters and particle filters lose accuracy dramatically when presented with an unlikely observation. Such an observation may be caused by an unusually large measurement error or reflect a rare fluctuation in the dynamics of the system. Over a long enough span of time it becomes likely that one or several of these events will occur. Often… ▽ More On-line data assimilation techniques such as ensemble Kalman filters and particle filters lose accuracy dramatically when presented with an unlikely observation. Such an observation may be caused by an unusually large measurement error or reflect a rare fluctuation in the dynamics of the system. Over a long enough span of time it becomes likely that one or several of these events will occur. Often they are signatures of the most interesting features of the underlying system and their prediction becomes the primary focus of the data assimilation procedure. The Kuroshio or Black Current that runs along the eastern coast of Japan is an example of such a system. It undergoes infrequent but dramatic changes of state between a small meander during which the current remains close to the coast of Japan, and a large meander during which it bulges away from the coast. Because of the important role that the Kuroshio plays in distributing heat and salinity in the surrounding region, prediction of these transitions is of acute interest. Here we focus on a regime in which both the stochastic forcing on the system and the observational noise are small. In this setting large deviation theory can be used to understand why standard filtering methods fail and guide the design of the more effective data assimilation techniques. Motivated by our analysis we propose several data assimilation strategies capable of efficiently handling rare events such as the transitions of the Kuroshio. These techniques are tested on a model of the Kuroshio and shown to perform much better than standard filtering methods. △ Less

Submitted 14 March, 2014; v1 submitted 22 February, 2012; originally announced February 2012.

Comments: 43 pages, 12 figures

Journal ref: Monthly Weather Review (2013), 141, 1822-1841

A granocentric model captures the statistical properties of monodisperse random packings

Authors: Katherine A. Newhall, Ivane Jorjadze, Eric Vanden-Eijnden, Jasna Brujic

Abstract: We present a generalization of the granocentric model proposed in [Clusel et al., Nature, 2009, 460, 611615] that is capable of describing the local fluctuations inside not only polydisperse but also monodisperse packings of spheres. This minimal model does not take into account the relative particle positions, yet it captures positional disorder through local stochastic processes sampled by effic… ▽ More We present a generalization of the granocentric model proposed in [Clusel et al., Nature, 2009, 460, 611615] that is capable of describing the local fluctuations inside not only polydisperse but also monodisperse packings of spheres. This minimal model does not take into account the relative particle positions, yet it captures positional disorder through local stochastic processes sampled by efficient Monte Carlo methods. The disorder is characterized by the distributions of local parameters, such as the number of neighbors and contacts, filled solid angle around a central particle and the cell volumes. The model predictions are in good agreement with our experimental data on monodisperse random close packings of PMMA particles. Moreover, the model can be used to predict the distributions of local fluctuations in any packing, as long as the average number of neighbors, contacts and the packing fraction are known. These distributions give a microscopic foundation to the statistical mechanics framework for jammed matter and allow us to calculate thermodynamic quantities such as the compactivity in the phase space of possible jammed configurations. △ Less

Submitted 3 February, 2012; originally announced February 2012.

Journal ref: Soft Matter, 2011

On the Accuracy of Finite-Volume Schemes for Fluctuating Hydrodynamics

Authors: A. Donev, E. Vanden-Eijnden, A. L. Garcia, J. B. Bell

Abstract: This paper describes the development and analysis of finite-volume methods for the Landau-Lifshitz Navier-Stokes (LLNS) equations and related stochastic partial differential equations in fluid dynamics. The LLNS equations incorporate thermal fluctuations into macroscopic hydrodynamics by the addition of white-noise fluxes whose magnitudes are set by a fluctuation-dissipation relation. Originally… ▽ More This paper describes the development and analysis of finite-volume methods for the Landau-Lifshitz Navier-Stokes (LLNS) equations and related stochastic partial differential equations in fluid dynamics. The LLNS equations incorporate thermal fluctuations into macroscopic hydrodynamics by the addition of white-noise fluxes whose magnitudes are set by a fluctuation-dissipation relation. Originally derived for equilibrium fluctuations, the LLNS equations have also been shown to be accurate for non-equilibrium systems. Previous studies of numerical methods for the LLNS equations focused primarily on measuring variances and correlations computed at equilibrium and for selected non-equilibrium flows. In this paper, we introduce a more systematic approach based on studying discrete equilibrium structure factors for a broad class of explicit linear finite-volume schemes. This new approach provides a better characterization of the accuracy of a spatio-temporal discretization as a function of wavenumber and frequency, allowing us to distinguish between behavior at long wavelengths, where accuracy is a prime concern, and short wavelengths, where stability concerns are of greater importance. We use this analysis to develop a specialized third-order Runge Kutta scheme that minimizes the temporal integration error in the discrete structure factor at long wavelengths for the one-dimensional linearized LLNS equations. Together with a novel method for discretizing the stochastic stress tensor in dimension larger than one, our improved temporal integrator yields a scheme for the three-dimensional equations that satisfies a discrete fluctuation-dissipation balance for small time steps and is also sufficiently accurate even for time steps close to the stability limit. △ Less

Submitted 18 December, 2009; v1 submitted 12 June, 2009; originally announced June 2009.

Comments: Significant revisions from v1 including a new 3D method. Now 50 pages, submitted to CAMCOS

Exact rate calculations by trajectory parallelization and twisting

Authors: Eric Vanden-Eijnden, Maddalena Venturoli

Abstract: A sampling procedure to compute exactly the rate of activated processes arising in systems at equilibrium or nonequilibrium steady state is presented. The procedure is a generalization of the method in [A. Warmflash, P. Bhimalapuram, and A. R. Dinner, J. Chem. Phys., 127, 154112 (2007); A. Dickson, A. Warmflash, and A. R. Dinner, J. Chem. Phys., 130, 074104 (2009)] in which one performs simulati… ▽ More A sampling procedure to compute exactly the rate of activated processes arising in systems at equilibrium or nonequilibrium steady state is presented. The procedure is a generalization of the method in [A. Warmflash, P. Bhimalapuram, and A. R. Dinner, J. Chem. Phys., 127, 154112 (2007); A. Dickson, A. Warmflash, and A. R. Dinner, J. Chem. Phys., 130, 074104 (2009)] in which one performs simulations restricted into cells by using a reinjection rule at the boundaries of the cells which is consistent with the exact probability fluxes through these boundaries. Our generalization uses results from transition path theory which indicate how to twist the dynamics to calculate reaction rates. △ Less

Submitted 23 April, 2009; originally announced April 2009.

Comments: 7 pages, 5 figures

Single-Sweep Methods for Free Energy Calculations

Authors: Luca Maragliano, Eric Vanden-Eijnden

Abstract: A simple, efficient, and accurate method is proposed to map multi-dimensional free energy landscapes. The method combines the temperature-accelerated molecular dynamics (TAMD) proposed in [Maragliano & Vanden-Eijnden, Chem. Phys. Lett. 426, 168 (2006)] with a variational reconstruction method using radial-basis functions for the representation of the free energy. TAMD is used to rapidly sweep th… ▽ More A simple, efficient, and accurate method is proposed to map multi-dimensional free energy landscapes. The method combines the temperature-accelerated molecular dynamics (TAMD) proposed in [Maragliano & Vanden-Eijnden, Chem. Phys. Lett. 426, 168 (2006)] with a variational reconstruction method using radial-basis functions for the representation of the free energy. TAMD is used to rapidly sweep through the important regions of the free energy landscape and compute the gradient of the free energy locally at points in these regions. The variational method is then used to reconstruct the free energy globally from the mean force at these points. The algorithmic aspects of the single-sweep method are explained in detail, and the method is tested on simple examples, compared to metadynamics, and finally used to compute the free energy of the solvated alanine dipeptide in two and four dihedral angles. △ Less

Submitted 15 December, 2007; originally announced December 2007.