Showing 1–16 of 16 results for author: Stevenson, J D

Perspective: Energy Landscapes for Machine Learning

Authors: Andrew J. Ballard, Ritankar Das, Stefano Martiniani, Dhagash Mehta, Levent Sagun, Jacob D. Stevenson, David J. Wales

Abstract: Machine learning techniques are being increasingly used as flexible non-linear fitting and prediction tools in the physical sciences. Fitting functions that exhibit multiple solutions as local minima can be analysed in terms of the corresponding machine learning landscape. Methods to explore and visualise molecular potential energy landscapes can be applied to these machine learning landscapes to… ▽ More Machine learning techniques are being increasingly used as flexible non-linear fitting and prediction tools in the physical sciences. Fitting functions that exhibit multiple solutions as local minima can be analysed in terms of the corresponding machine learning landscape. Methods to explore and visualise molecular potential energy landscapes can be applied to these machine learning landscapes to gain new insight into the solution space involved in training and the nature of the corresponding predictions. In particular, we can define quantities analogous to molecular structure, thermodynamics, and kinetics, and relate these emergent properties to the structure of the underlying landscape. This Perspective aims to describe these analogies with examples from recent applications, and suggest avenues for new interdisciplinary research. △ Less

Submitted 22 March, 2017; originally announced March 2017.

Comments: 41 pages, 25 figures. Accepted for publication in Physical Chemistry Chemical Physics, 2017

Structural analysis of high-dimensional basins of attraction

Authors: Stefano Martiniani, K. Julian Schrenk, Jacob D. Stevenson, David J. Wales, Daan Frenkel

Abstract: We propose an efficient Monte Carlo method for the computation of the volumes of high-dimensional bodies with arbitrary shape. We start with a region of known volume within the interior of the manifold and then use the multistate Bennett acceptance-ratio method to compute the dimensionless free-energy difference between a series of equilibrium simulations performed within this object. The method p… ▽ More We propose an efficient Monte Carlo method for the computation of the volumes of high-dimensional bodies with arbitrary shape. We start with a region of known volume within the interior of the manifold and then use the multistate Bennett acceptance-ratio method to compute the dimensionless free-energy difference between a series of equilibrium simulations performed within this object. The method produces results that are in excellent agreement with thermodynamic integration, as well as a direct estimate of the associated statistical uncertainties. The histogram method also allows us to directly obtain an estimate of the interior radial probability density profile, thus yielding useful insight into the structural properties of such a high-dimensional body. We illustrate the method by analyzing the effect of structural disorder on the basins of attraction of mechanically stable packings of soft repulsive spheres. △ Less

Submitted 17 September, 2016; v1 submitted 31 March, 2016; originally announced March 2016.

Comments: 5 pages, 2 figures, supplemental material

Journal ref: Phys. Rev. E 94, 031301 (2016)

Turning intractable counting into sampling: computing the configurational entropy of three-dimensional jammed packings

Authors: Stefano Martiniani, K. Julian Schrenk, Jacob D. Stevenson, David J. Wales, Daan Frenkel

Abstract: We report a numerical calculation of the total number of disordered jammed configurations $Ω$ of $N$ repulsive, three-dimensional spheres in a fixed volume $V$. To make these calculations tractable, we increase the computational efficiency of the approach of Xu et al. (Phys. Rev. Lett. 106, 245502 (2011)) and Asenjo et al. (Phys. Rev. Lett. 112, 098002 (2014)) and we extend the method to allow com… ▽ More We report a numerical calculation of the total number of disordered jammed configurations $Ω$ of $N$ repulsive, three-dimensional spheres in a fixed volume $V$. To make these calculations tractable, we increase the computational efficiency of the approach of Xu et al. (Phys. Rev. Lett. 106, 245502 (2011)) and Asenjo et al. (Phys. Rev. Lett. 112, 098002 (2014)) and we extend the method to allow computation of the configurational entropy as a function of pressure. The approach that we use computes the configurational entropy by sampling the absolute volume of basins of attraction of the stable packings in the potential energy landscape. We find a surprisingly strong correlation between the pressure of a configuration and the volume of its basin of attraction in the potential energy landscape. This relation is well described by a power law. Our methodology to compute the number of minima in the potential energy landscape should be applicable to a wide range of other enumeration problems in statistical physics, string theory, cosmology and machine learning, that aim to find the distribution of the extrema of a scalar cost function that depends on many degrees of freedom. △ Less

Submitted 27 January, 2016; v1 submitted 14 September, 2015; originally announced September 2015.

Comments: 18 pages, 7 figures

Journal ref: Phys. Rev. E 93, 012906 (2016)

Numerical evaluation of the Gauss hypergeometric function: Implementation and application to Schramm-Loewner evolution

Authors: K. J. Schrenk, J. D. Stevenson

Abstract: Numerical studies of fractal curves in the plane often focus on subtle geometrical properties such as their left passage probability. Schramm-Loewner evolution (SLE) is a mathematical framework which makes explicit predictions for such features of curve ensembles. The SLE prediction for the left passage probability contains the Gauss hypergeometric function ${}_2F_1$. To perform computational SLE… ▽ More Numerical studies of fractal curves in the plane often focus on subtle geometrical properties such as their left passage probability. Schramm-Loewner evolution (SLE) is a mathematical framework which makes explicit predictions for such features of curve ensembles. The SLE prediction for the left passage probability contains the Gauss hypergeometric function ${}_2F_1$. To perform computational SLE studies it is therefore necessary to have a method for numerical evaluation of ${}_2F_1$ in the relevant parameter regime. In some instances, commercial software provides suitable tools, but freely available implementations are rare and are usually unable to handle the parameter ranges needed for the left passage probability. We discuss different approaches to overcome this problem and also provide a ready-to-use implementation of one conceptually transparent method. △ Less

Submitted 11 May, 2015; v1 submitted 19 February, 2015; originally announced February 2015.

Analysing kinetic transition networks for rare events

Authors: Jacob D. Stevenson, David J. Wales

Abstract: The graph transformation approach is a recently proposed method for computing mean first passage times, rates, and committor probabilities for kinetic transition networks. Here we compare the performance to existing linear algebra methods, focusing on large, sparse networks. We show that graph transformation provides a much more robust framework, succeeding when numerical precision issues cause th… ▽ More The graph transformation approach is a recently proposed method for computing mean first passage times, rates, and committor probabilities for kinetic transition networks. Here we compare the performance to existing linear algebra methods, focusing on large, sparse networks. We show that graph transformation provides a much more robust framework, succeeding when numerical precision issues cause the other methods to fail completely. These are precisely the situations that correspond to rare event dynamics for which the graph transformation was introduced. △ Less

Submitted 16 July, 2014; v1 submitted 19 May, 2014; originally announced May 2014.

Superposition Enhanced Nested Sampling

Authors: Stefano Martiniani, Jacob D. Stevenson, David J. Wales, Daan Frenkel

Abstract: The theoretical analysis of many problems in physics, astronomy and applied mathematics requires an efficient numerical exploration of multimodal parameter spaces that exhibit broken ergodicity. Monte Carlo methods are widely used to deal with these classes of problems, but such simulations suffer from a ubiquitous sampling problem: the probability of sampling a particular state is proportional to… ▽ More The theoretical analysis of many problems in physics, astronomy and applied mathematics requires an efficient numerical exploration of multimodal parameter spaces that exhibit broken ergodicity. Monte Carlo methods are widely used to deal with these classes of problems, but such simulations suffer from a ubiquitous sampling problem: the probability of sampling a particular state is proportional to its entropic weight. Devising an algorithm capable of sampling efficiently the full phase space is a long-standing problem. Here we report a new hybrid method for the exploration of multimodal parameter spaces exhibiting broken ergodicity. Superposition enhanced nested sampling (SENS) combines the strengths of global optimization with the unbiased/athermal sampling of nested sampling, greatly enhancing its efficiency with no additional parameters. We report extensive tests of this new approach for atomic clusters that are known to have energy landscapes for which conventional sampling schemes suffer from broken ergodicity. We also introduce a novel parallelization algorithm for nested sampling. △ Less

Submitted 2 June, 2014; v1 submitted 25 February, 2014; originally announced February 2014.

Journal ref: Phys. Rev. X 4, 031034 (2014)

Visualizing Basins of Attraction for Different Minimization Algorithms

Authors: Daniel Asenjo, Jacob D. Stevenson, David J. Wales, Daan Frenkel

Abstract: We report a study of the basins of attraction for potential energy minima defined by different minimisation algorithms for an atomic system. We find that whereas some minimisation algorithms produce compact basins, others produce basins with complex boundaries or basins consisting of disconnected parts. Such basins deviate from the "correct" basin of attraction defined by steepest-descent pathways… ▽ More We report a study of the basins of attraction for potential energy minima defined by different minimisation algorithms for an atomic system. We find that whereas some minimisation algorithms produce compact basins, others produce basins with complex boundaries or basins consisting of disconnected parts. Such basins deviate from the "correct" basin of attraction defined by steepest-descent pathways, and the differences can be controlled to some extent by adjustment of the maximum step size. The choice of the most convenient minimisation algorithm depends on the problem in hand. We show that while L-BFGS is the fastest minimiser, the FIRE algorithm is also quite fast, and can lead to less fragmented basins of attraction. △ Less

Submitted 30 September, 2013; originally announced September 2013.

Percolation and Schramm-Loewner evolution in the 2D random-field Ising model

Authors: Jacob D. Stevenson, Martin Weigel

Abstract: The presence of random fields is well known to destroy ferromagnetic order in Ising systems in two dimensions. When the system is placed in a sufficiently strong external field, however, the size of clusters of like spins diverges. There is evidence that this percolation transition is in the universality class of standard site percolation. It has been claimed that, for small disorder, a similar pe… ▽ More The presence of random fields is well known to destroy ferromagnetic order in Ising systems in two dimensions. When the system is placed in a sufficiently strong external field, however, the size of clusters of like spins diverges. There is evidence that this percolation transition is in the universality class of standard site percolation. It has been claimed that, for small disorder, a similar percolation phenomenon also occurs in zero external field. Using exact algorithms, we study ground states of large samples and find little evidence for a transition at zero external field. Nevertheless, for sufficiently small random field strengths, there is an extended region of the phase diagram, where finite samples are indistinguishable from a critical percolating system. In this regime we examine ground-state domain walls, finding strong evidence that they are conformally invariant and satisfy Schramm-Loewner evolution ($SLE_κ$) with parameter $κ= 6$. These results add support to the hope that at least some aspects of systems with quenched disorder might be ultimately studied with the techniques of SLE and conformal field theory. △ Less

Submitted 29 July, 2011; originally announced July 2011.

Journal ref: Computer Physics Communications Volume 182, Issue 9, 2011, Pages 1879-1882

Domain walls and Schramm-Loewner evolution in the random-field Ising model

Authors: Jacob D. Stevenson, Martin Weigel

Abstract: The concept of Schramm-Loewner evolution provides a unified description of domain boundaries of many lattice spin systems in two dimensions, possibly even including systems with quenched disorder. Here, we study domain walls in the random-field Ising model. Although, in two dimensions, this system does not show an ordering transition to a ferromagnetic state, in the presence of a uniform external… ▽ More The concept of Schramm-Loewner evolution provides a unified description of domain boundaries of many lattice spin systems in two dimensions, possibly even including systems with quenched disorder. Here, we study domain walls in the random-field Ising model. Although, in two dimensions, this system does not show an ordering transition to a ferromagnetic state, in the presence of a uniform external field spin domains percolate beyond a critical field strength. Using exact ground state calculations for very large systems, we examine ground state domain walls near this percolation transition finding strong evidence that they are conformally invariant and satisfy the domain Markov property, implying compatibility with Schramm-Loewner evolution (SLE$_κ$) with parameter $κ= 6$. These results might pave the way for new field-theoretic treatments of systems with quenched disorder. △ Less

Submitted 29 July, 2011; v1 submitted 28 October, 2010; originally announced October 2010.

Journal ref: EPL 95 40001 (2011)

The Ultimate Fate of Supercooled Liquids

Authors: Jacob D. Stevenson, Peter G. Wolynes

Abstract: In recent years it has become widely accepted that a dynamical length scale ξ_α plays an important role in supercooled liquids near the glass transition. We examine the implications of the interplay between the growing ξ_α and the size of the crystal nucleus, ξ_M, which shrinks on cooling. We argue that at low temperatures where ξ_α > ξ_M a new crystallization mechanism emerges enabling rapid deve… ▽ More In recent years it has become widely accepted that a dynamical length scale ξ_α plays an important role in supercooled liquids near the glass transition. We examine the implications of the interplay between the growing ξ_α and the size of the crystal nucleus, ξ_M, which shrinks on cooling. We argue that at low temperatures where ξ_α > ξ_M a new crystallization mechanism emerges enabling rapid development of a large scale web of sparsely connected crystallinity. Though we predict this web percolates the system at too low a temperature to be easily seen in the laboratory, there are noticeable residual effects near the glass transition that can account for several previously observed unexplained phenomena of deeply supercooled liquids including Fischer clusters, and anomalous crystal growth near T_g. △ Less

Submitted 30 June, 2010; originally announced June 2010.

A universal origin for secondary relaxations in supercooled liquids and structural glasses

Authors: Jacob D. Stevenson, Peter G. Wolynes

Abstract: Nearly all glass forming liquids display secondary relaxations, dynamical modes seemingly distinct from the primary alpha relaxations. We show that accounting for driving force fluctuations and the diversity of reconfiguring shapes in the random first order transition theory yields a low free energy tail on the activation barrier distribution which shares many of the features ascribed to seconda… ▽ More Nearly all glass forming liquids display secondary relaxations, dynamical modes seemingly distinct from the primary alpha relaxations. We show that accounting for driving force fluctuations and the diversity of reconfiguring shapes in the random first order transition theory yields a low free energy tail on the activation barrier distribution which shares many of the features ascribed to secondary relaxations. While primary relaxation takes place through activated events involving compact regions, secondary relaxation corresponding to the tail is governed by more ramified, string-like, or percolation-like clusters of particles. These secondary relaxations merge with the primary relaxation peak becoming dominant near the dynamical crossover temperature $T_c$, where they smooth the transition between continuous dynamics described by mode-coupling theory and activated events. △ Less

Submitted 13 May, 2009; originally announced May 2009.

On the surface of glasses

Authors: Jacob D. Stevenson, Peter G. Wolynes

Abstract: Dynamics near the surface of glasses is generally much faster than in the bulk. Neglecting static perturbations of structure at the surface, we use random first order transition theory to show the free energy barrier for activated motion near a free surface should be half that of the bulk at the same temperature. The increased mobility allows the surface layers to descend much further on the ene… ▽ More Dynamics near the surface of glasses is generally much faster than in the bulk. Neglecting static perturbations of structure at the surface, we use random first order transition theory to show the free energy barrier for activated motion near a free surface should be half that of the bulk at the same temperature. The increased mobility allows the surface layers to descend much further on the energy landscape than the bulk ordinarily does. The simplified RFOT calculation however predicts a limiting value for the configurational entropy a vapor deposited glass may reach as a function of deposition rate. We sketch how mode coupling effects extend the excess free surface mobility into the bulk so that the glass transition temperature is measurably perturbed at depths greater than the naive length scale of dynamic cooperativity. △ Less

Submitted 25 August, 2008; originally announced August 2008.

Comments: 5 pages 2 figures

Constructing explicit magnetic analogies for the dynamics of glass forming liquids

Authors: Jacob D. Stevenson, Aleksandra M. Walczak, Randall W. Hall, Peter G. Wolynes

Abstract: By defining a spatially varying replica overlap parameter for a supercooled liquid referenced to an ensemble of fiducial liquid state configurations we explicitly construct a constrained replica free energy functional that maps directly onto an Ising Hamiltonian with both random fields and random interactions whose statistics depend on liquid structure. Renormalization group results for random m… ▽ More By defining a spatially varying replica overlap parameter for a supercooled liquid referenced to an ensemble of fiducial liquid state configurations we explicitly construct a constrained replica free energy functional that maps directly onto an Ising Hamiltonian with both random fields and random interactions whose statistics depend on liquid structure. Renormalization group results for random magnets when combined with these statistics for the Lennard-Jones glass suggest that discontinuous replica symmetry breaking would occur if a liquid with short range interactions could be equilibrated at a sufficiently low temperature where its mean field configurational entropy would vanish, even though the system strictly retains a finite configurational entropy. △ Less

Submitted 4 October, 2008; v1 submitted 27 June, 2008; originally announced June 2008.

Comparison of some recent Excitation Chain Arguments with the Random First Order Transition Theory of Supercooled Liquids and Experiment

Authors: Jacob D. Stevenson, Peter G. Wolynes

Abstract: We compare a recent excitation chain argument for the glass transition with the earlier random first order transition theory. The key equation determining the activation barriers and size of cooperatively rearranging regions has the same scaling form in both approaches. The random first order transition theory unambiguously predicts the coefficients in the equation giving results that agree with… ▽ More We compare a recent excitation chain argument for the glass transition with the earlier random first order transition theory. The key equation determining the activation barriers and size of cooperatively rearranging regions has the same scaling form in both approaches. The random first order transition theory unambiguously predicts the coefficients in the equation giving results that agree with experiment vis a vis the correlation of activation barriers with thermodynamics and that also agree with experimental determination of correlation lengths following the prescription of Berthier et al. The excitation chain approach, while containing more adjustable parameters accommodates those experimental findings only by using unphysical values for those adjustable parameters. △ Less

Submitted 26 September, 2006; originally announced September 2006.

Comments: 3 pages, 1 figure

The Shapes of Cooperatively Rearranging Regions in Glass Forming Liquids

Authors: Jacob D. Stevenson, Joerg Schmalian, Peter G. Wolynes

Abstract: The shapes of cooperatively rearranging regions in glassy liquids change from being compact at low temperatures to fractal or ``stringy'' as the dynamical crossover temperature from activated to collisional transport is approached from below. We present a quantitative microscopic treatment of this change of morphology within the framework of the random first order transition theory of glasses. W… ▽ More The shapes of cooperatively rearranging regions in glassy liquids change from being compact at low temperatures to fractal or ``stringy'' as the dynamical crossover temperature from activated to collisional transport is approached from below. We present a quantitative microscopic treatment of this change of morphology within the framework of the random first order transition theory of glasses. We predict a correlation of the ratio of the dynamical crossover temperature to the laboratory glass transition temperature, and the heat capacity discontinuity at the glass transition, Delta C_p. The predicted correlation agrees with experimental results for the 21 materials compiled by Novikov and Sokolov. △ Less

Submitted 29 August, 2005; v1 submitted 22 July, 2005; originally announced July 2005.

Comments: 9 pages, 6 figures

Thermodynamic- Kinetic Correlations in Supercooled Liquids- A Critical Survey of Experimental Data and Predictions of the Random First Order Transition Theory of Glasses

Authors: Jacob D. Stevenson, Peter G. Wolynes

Abstract: Thermodynamics and kinetics are thought to be linked in glass transitions. The quantitative predictions of -relaxation activation barriers provided by the theory of glasses based on random first order transitions are compared with experiment for 44 substances. The agreement found between the predicted activation energies near Tg and experiment is excellent. These predictions depend on th… ▽ More Thermodynamics and kinetics are thought to be linked in glass transitions. The quantitative predictions of -relaxation activation barriers provided by the theory of glasses based on random first order transitions are compared with experiment for 44 substances. The agreement found between the predicted activation energies near Tg and experiment is excellent. These predictions depend on the configurational heat capacity change on vitrification and the entropy of melting the crystal which are experimental inputs. △ Less

Submitted 6 July, 2005; v1 submitted 3 May, 2005; originally announced May 2005.

Comments: 15 pages, 1 figure, 1 table. submitted to J. Phys. Chem