-
Efficient ensemble uncertainty estimation in Gaussian Processes Regression
Authors:
Mads-Peter Verner Christiansen,
Nikolaj Rønne,
Bjørk Hammer
Abstract:
Reliable uncertainty measures are required when using data based machine learning interatomic potentials (MLIPs) for atomistic simulations. In this work, we propose for sparse Gaussian Process Regression type MLIP a stochastic uncertainty measure akin to the query-by-committee approach often used in conjunction with neural network based MLIPs. The uncertainty measure is coined \textit{"label noise…
▽ More
Reliable uncertainty measures are required when using data based machine learning interatomic potentials (MLIPs) for atomistic simulations. In this work, we propose for sparse Gaussian Process Regression type MLIP a stochastic uncertainty measure akin to the query-by-committee approach often used in conjunction with neural network based MLIPs. The uncertainty measure is coined \textit{"label noise"} ensemble uncertainty as it emerges from adding noise to the energy labels in the training data. We find that this method of calculating an ensemble uncertainty is as well calibrated as the one obtained from the closed-form expression for the posterior variance when the sparse GPR is treated as a projected process. Comparing the two methods, our proposed ensemble uncertainty is, however, faster to evaluate than the closed-form expression. Finally, we demonstrate that the proposed uncertainty measure acts better to support a Bayesian search for optimal structure of Au$_{20}$ clusters.
△ Less
Submitted 17 July, 2024;
originally announced July 2024.
-
Generative diffusion model for surface structure discovery
Authors:
Nikolaj Rønne,
Alán Aspuru-Guzik,
Bjørk Hammer
Abstract:
We present a generative diffusion model specifically tailored to the discovery of surface structures. The generative model takes into account substrate registry and periodicity by including masked atoms and $z$-directional confinement. Using a rotational equivariant neural network architecture, we design a method that trains a denoiser-network for diffusion alongside a force-field for guided sampl…
▽ More
We present a generative diffusion model specifically tailored to the discovery of surface structures. The generative model takes into account substrate registry and periodicity by including masked atoms and $z$-directional confinement. Using a rotational equivariant neural network architecture, we design a method that trains a denoiser-network for diffusion alongside a force-field for guided sampling of low-energy surface phases. An effective data-augmentation scheme for training the denoiser-network is proposed to scale generation far beyond structure sizes represented in the training data. We showcase the generative model by investigating multiple surface systems and propose an atomistic structure model for a previously unknown silver-oxide domain-boundary of unprecedented size.
△ Less
Submitted 2 July, 2024; v1 submitted 27 February, 2024;
originally announced February 2024.
-
Atomistic structure search using local surrogate mode
Authors:
Nikolaj Rønne,
Mads-Peter V. Christiansen,
Andreas Møller Slavensky,
Zeyuan Tang,
Florian Brix,
Mikkel Elkjær Pedersen,
Malthe Kjær Bisbo,
Bjørk Hammer
Abstract:
We describe a local surrogate model for use in conjunction with global structure search methods. The model follows the Gaussian approximation potential (GAP) formalism and is based on a the smooth overlap of atomic positions descriptor with sparsification in terms of a reduced number of local environments using mini-batch $k$-means. The model is implemented in the Atomistic Global Optimization X f…
▽ More
We describe a local surrogate model for use in conjunction with global structure search methods. The model follows the Gaussian approximation potential (GAP) formalism and is based on a the smooth overlap of atomic positions descriptor with sparsification in terms of a reduced number of local environments using mini-batch $k$-means. The model is implemented in the Atomistic Global Optimization X framework and used as a partial replacement of the local relaxations in basin hopping structure search. The approach is shown to be robust for a wide range of atomistic system including molecules, nano-particles, surface supported clusters and surface thin films. The benefits in a structure search context of a local surrogate model are demonstrated. This includes the ability to transfer learning from smaller systems as well as the possibility to perform concurrent multi-stoichiometry searches.
△ Less
Submitted 19 August, 2022;
originally announced August 2022.
-
Atomistic Global Optimization X: A Python package for optimization of atomistic structures
Authors:
Mads-Peter Verner Christiansen,
Nikolaj Rønne,
Bjørk Hammer
Abstract:
Modelling and understanding properties of materials from first principles require knowledge of the underlying atomistic structure. This entails knowing the individual identity and position of all involved atoms. Obtaining such information for macro-molecules, nano-particles, clusters, and for the surface, interface, and bulk phases of amorphous and solid materials represents a difficult high dimen…
▽ More
Modelling and understanding properties of materials from first principles require knowledge of the underlying atomistic structure. This entails knowing the individual identity and position of all involved atoms. Obtaining such information for macro-molecules, nano-particles, clusters, and for the surface, interface, and bulk phases of amorphous and solid materials represents a difficult high dimensional global optimization problem. The rise of machine learning techniques in materials science has, however, led to many compelling developments that may speed up such structure searches. The complexity of the new methods have established the necessity for an efficient way of experimenting with and assembling them into global optimization algorithms. In this paper we introduce the Atomistic Global Optimization X (AGOX) framework and code, as a customizable approach to building efficient global optimization algorithms. A modular way of expressing global optimization algorithms is described and modern programming practices are used to enable that modularity in the freely available AGOX python package. Two examples of global optimization problems are analyzed: One that is computationally inexpensive which is used to showcase that AGOX enables the expression of multiple global optimization algorithms. As the other example, AGOX is used for solving a complex atomistic optimization problem for a metal-nitride nano-cluster embedded in a graphene sheet as described at the density functional theory (DFT) level.
△ Less
Submitted 19 August, 2022; v1 submitted 4 April, 2022;
originally announced April 2022.
