-
How to use quantum computers for biomolecular free energies
Authors:
Jakob Günther,
Thomas Weymuth,
Moritz Bensberg,
Freek Witteveen,
Matthew S. Teynor,
F. Emil Thomasen,
Valentina Sora,
William Bro-Jørgensen,
Raphael T. Husistein,
Mihael Erakovic,
Marek Miller,
Leah Weisburn,
Minsik Cho,
Marco Eckhoff,
Aram W. Harrow,
Anders Krogh,
Troy Van Voorhis,
Kresten Lindorff-Larsen,
Gemma Solomon,
Markus Reiher,
Matthias Christandl
Abstract:
Free energy calculations are at the heart of physics-based analyses of biochemical processes. They allow us to quantify molecular recognition mechanisms, which determine a wide range of biological phenomena from how cells send and receive signals to how pharmaceutical compounds can be used to treat diseases. Quantitative and predictive free energy calculations require computational models that acc…
▽ More
Free energy calculations are at the heart of physics-based analyses of biochemical processes. They allow us to quantify molecular recognition mechanisms, which determine a wide range of biological phenomena from how cells send and receive signals to how pharmaceutical compounds can be used to treat diseases. Quantitative and predictive free energy calculations require computational models that accurately capture both the varied and intricate electronic interactions between molecules as well as the entropic contributions from motions of these molecules and their aqueous environment. However, accurate quantum-mechanical energies and forces can only be obtained for small atomistic models, not for large biomacromolecules. Here, we demonstrate how to consistently link accurate quantum-mechanical data obtained for substructures to the overall potential energy of biomolecular complexes by machine learning in an integrated algorithm. We do so using a two-fold quantum embedding strategy where the innermost quantum cores are treated at a very high level of accuracy. We demonstrate the viability of this approach for the molecular recognition of a ruthenium-based anticancer drug by its protein target, applying traditional quantum chemical methods. As such methods scale unfavorable with system size, we analyze requirements for quantum computers to provide highly accurate energies that impact the resulting free energies. Once the requirements are met, our computational pipeline FreeQuantum is able to make efficient use of the quantum computed energies, thereby enabling quantum computing enhanced modeling of biochemical processes. This approach combines the exponential speedups of quantum computers for simulating interacting electrons with modern classical simulation techniques that incorporate machine learning to model large molecules.
△ Less
Submitted 25 June, 2025;
originally announced June 2025.
-
Machine Learning Enhanced Calculation of Quantum-Classical Binding Free Energies
Authors:
Moritz Bensberg,
Marco Eckhoff,
F. Emil Thomasen,
William Bro-Jørgensen,
Matthew S. Teynor,
Valentina Sora,
Thomas Weymuth,
Raphael T. Husistein,
Frederik E. Knudsen,
Anders Krogh,
Kresten Lindorff-Larsen,
Markus Reiher,
Gemma C. Solomon
Abstract:
Binding free energies are a key element in understanding and predicting the strength of protein--drug interactions. While classical free energy simulations yield good results for many purely organic ligands, drugs including transition metal atoms often require quantum chemical methods for an accurate description. We propose a general and automated workflow that samples the potential energy surface…
▽ More
Binding free energies are a key element in understanding and predicting the strength of protein--drug interactions. While classical free energy simulations yield good results for many purely organic ligands, drugs including transition metal atoms often require quantum chemical methods for an accurate description. We propose a general and automated workflow that samples the potential energy surface with hybrid quantum mechanics/molecular mechanics (QM/MM) calculations and trains a machine learning (ML) potential on the QM energies and forces to enable efficient alchemical free energy simulations. To represent systems including many different chemical elements efficiently and to account for the different description of QM and MM atoms, we propose an extension of element-embracing atom-centered symmetry functions for QM/MM data as an ML descriptor. The ML potential approach takes electrostatic embedding and long-range electrostatics into account. We demonstrate the applicability of the workflow on the well-studied protein--ligand complex of myeloid cell leukemia 1 and the inhibitor 19G and on the anti-cancer drug NKP1339 acting on the glucose-regulated protein 78.
△ Less
Submitted 5 March, 2025;
originally announced March 2025.
-
Hierarchical quantum embedding by machine learning for large molecular assemblies
Authors:
Moritz Bensberg,
Marco Eckhoff,
Raphael T. Husistein,
Matthew S. Teynor,
Valentina Sora,
William Bro-Jørgensen,
F. Emil Thomasen,
Anders Krogh,
Kresten Lindorff-Larsen,
Gemma C. Solomon,
Thomas Weymuth,
Markus Reiher
Abstract:
We present a quantum-in-quantum embedding strategy coupled to machine learning potentials to improve on the accuracy of quantum-classical hybrid models for the description of large molecules. In such hybrid models, relevant structural regions (such as those around reaction centers or pockets for binding of host molecules) can be described by a quantum model that is then embedded into a classical m…
▽ More
We present a quantum-in-quantum embedding strategy coupled to machine learning potentials to improve on the accuracy of quantum-classical hybrid models for the description of large molecules. In such hybrid models, relevant structural regions (such as those around reaction centers or pockets for binding of host molecules) can be described by a quantum model that is then embedded into a classical molecular-mechanics environment. However, this quantum region may become so large that only approximate electronic structure models are applicable. To then restore accuracy in the quantum description, we here introduce the concept of quantum cores within the quantum region that are amenable to accurate electronic structure models due to their limited size. Huzinaga-type projection-based embedding, for example, can deliver accurate electronic energies obtained with advanced electronic structure methods. The resulting total electronic energies are then fed into a transfer learning approach that efficiently exploits the higher-accuracy data to improve on a machine learning potential obtained for the original quantum-classical hybrid approach. We explore the potential of this approach in the context of a well-studied protein-ligand complex for which we calculate the free energy of binding using alchemical free energy and non-equilibrium switching simulations.
△ Less
Submitted 5 March, 2025;
originally announced March 2025.
-
NEAR: A Training-Free Pre-Estimator of Machine Learning Model Performance
Authors:
Raphael T. Husistein,
Markus Reiher,
Marco Eckhoff
Abstract:
Artificial neural networks have been shown to be state-of-the-art machine learning models in a wide variety of applications, including natural language processing and image recognition. However, building a performant neural network is a laborious task and requires substantial computing power. Neural Architecture Search (NAS) addresses this issue by an automatic selection of the optimal network fro…
▽ More
Artificial neural networks have been shown to be state-of-the-art machine learning models in a wide variety of applications, including natural language processing and image recognition. However, building a performant neural network is a laborious task and requires substantial computing power. Neural Architecture Search (NAS) addresses this issue by an automatic selection of the optimal network from a set of potential candidates. While many NAS methods still require training of (some) neural networks, zero-cost proxies promise to identify the optimal network without training. In this work, we propose the zero-cost proxy \textit{Network Expressivity by Activation Rank} (NEAR). It is based on the effective rank of the pre- and post-activation matrix, i.e., the values of a neural network layer before and after applying its activation function. We demonstrate the cutting-edge correlation between this network score and the model accuracy on NAS-Bench-101 and NATS-Bench-SSS/TSS. In addition, we present a simple approach to estimate the optimal layer sizes in multi-layer perceptrons. Furthermore, we show that this score can be utilized to select hyperparameters such as the activation function and the neural network weight initialization scheme.
△ Less
Submitted 19 February, 2025; v1 submitted 16 August, 2024;
originally announced August 2024.
-
Lifelong Machine Learning Potentials
Authors:
Marco Eckhoff,
Markus Reiher
Abstract:
Machine learning potentials (MLPs) trained on accurate quantum chemical data can retain the high accuracy, while inflicting little computational demands. On the downside, they need to be trained for each individual system. In recent years, a vast number of MLPs has been trained from scratch because learning additional data typically requires to train again on all data to not forget previously acqu…
▽ More
Machine learning potentials (MLPs) trained on accurate quantum chemical data can retain the high accuracy, while inflicting little computational demands. On the downside, they need to be trained for each individual system. In recent years, a vast number of MLPs has been trained from scratch because learning additional data typically requires to train again on all data to not forget previously acquired knowledge. Additionally, most common structural descriptors of MLPs cannot represent efficiently a large number of different chemical elements. In this work, we tackle these problems by introducing element-embracing atom-centered symmetry functions (eeACSFs) which combine structural properties and element information from the periodic table. These eeACSFs are a key for our development of a lifelong machine learning potential (lMLP). Uncertainty quantification can be exploited to transgress a fixed, pre-trained MLP to arrive at a continuously adapting lMLP, because a predefined level of accuracy can be ensured. To extend the applicability of an lMLP to new systems, we apply continual learning strategies to enable autonomous and on-the-fly training on a continuous stream of new data. For the training of deep neural networks, we propose the continual resilient (CoRe) optimizer and incremental learning strategies relying on rehearsal of data, regularization of parameters, and the architecture of the model.
△ Less
Submitted 4 June, 2023; v1 submitted 10 March, 2023;
originally announced March 2023.
-
Insights into lithium manganese oxide-water interfaces using machine learning potentials
Authors:
Marco Eckhoff,
Jörg Behler
Abstract:
Unraveling the atomistic and the electronic structure of solid-liquid interfaces is the key to the design of new materials for many important applications, from heterogeneous catalysis to battery technology. Density functional theory (DFT) calculations can in principle provide a reliable description of such interfaces, but the high computational costs severely restrict the accessible time and leng…
▽ More
Unraveling the atomistic and the electronic structure of solid-liquid interfaces is the key to the design of new materials for many important applications, from heterogeneous catalysis to battery technology. Density functional theory (DFT) calculations can in principle provide a reliable description of such interfaces, but the high computational costs severely restrict the accessible time and length scales. Here, we report machine learning-driven simulations of various interfaces between water and lithium manganese oxide (Li$_x$Mn$_2$O$_4$), an important electrode material in lithium ion batteries and a catalyst for the oxygen evolution reaction. We employ a high-dimensional neural network potential (HDNNP) to compute the energies and forces several orders of magnitude faster than DFT without loss in accuracy. In addition, a high-dimensional neural network for spin prediction (HDNNS) is utilized to analyze the electronic structure of the manganese ions. Combining these methods, a series of interfaces is investigated by large-scale molecular dynamics. The simulations allow us to gain insights into a variety of properties like the dissociation of water molecules, proton transfer processes, and hydrogen bonds, as well as the geometric and electronic structure of the solid surfaces including the manganese oxidation state distribution, Jahn-Teller distortions, and electron hopping.
△ Less
Submitted 21 January, 2022; v1 submitted 28 September, 2021;
originally announced September 2021.
-
A criticial view on e$_g$ occupancy as a descriptor for oxygen evolution catalytic activity in LiMn$_2$O$_4$ nanoparticles
Authors:
Florian Schönewald,
Marco Eckhoff,
Max Baumung,
Marcel Risch,
Peter E. Blöchl,
Jörg Behler,
Cynthia A. Volkert
Abstract:
We investigate the effect of the surface electronic structure and composition of LiMn$_2$O$_4$ nanoparticles on the electrocatalytic oxygen evolution reaction (OER). Scanning transmission electron microscopy (STEM) electron energy loss spectroscopy (EELS) studies combined with density functional theory (DFT) based simulations of the EEL spectra reveal in pristine nanoparticles a 4 nm thick surface…
▽ More
We investigate the effect of the surface electronic structure and composition of LiMn$_2$O$_4$ nanoparticles on the electrocatalytic oxygen evolution reaction (OER). Scanning transmission electron microscopy (STEM) electron energy loss spectroscopy (EELS) studies combined with density functional theory (DFT) based simulations of the EEL spectra reveal in pristine nanoparticles a 4 nm thick surface layer with reduced average Mn oxidation state and increased Mn concentration. This is attributed to Mn$^{2+}$ partially replacing Li$^+$ at the tetrahedral sites of the spinel lattice accompanied by Mn 3d-state filling of octahedrally coordinated Mn. During electrocatalytic OER cycling, this near-surface tetrahedral Mn is leached out, thereby increasing the oxidation state of octahedrally coordinated Mn. Using rotating ring-disc electrode (RRDE) based detection of O and Mn during the OER, we show that the oxygen evolution remains constant while the Mn$^{2+}$ is removed, revealing that near-surface tetrahedrally coordinated Mn has no effect on the OER activity of LiMn$_2$O$_4$. This is surprising since the e$_g$ occupancy of Mn in octahedral sites, which is widely used as a descriptor of OER activity, changes significantly in the surface layer during cycling. The fact that e$_g$ emptying fails to correlate with OER activity here indicates that octahedral cation valence is not a fundamental measure of activity, either because the active surface state is not affected by tetrahedral Mn or because other details of the band structure or metal-oxygen bonding character, more strongly regulate the rate-limiting steps for OER.
△ Less
Submitted 8 July, 2020;
originally announced July 2020.
-
Predicting Oxidation and Spin States by High-Dimensional Neural Networks: Applications to Lithium Manganese Oxide Spinels
Authors:
Marco Eckhoff,
Knut Nikolas Lausch,
Peter E. Blöchl,
Jörg Behler
Abstract:
Lithium ion batteries often contain transition metal oxides like Li$_{x}$Mn$_2$O$_4$ ($0\leq x\leq2$). Depending on the Li content different ratios of Mn$^\text{III}$ to Mn$^\text{IV}$ ions are present. In combination with electron hopping the Jahn-Teller distortions of the Mn$^\text{III}$O$_6$ octahedra can give rise to complex phenomena like structural transitions and conductance. While for smal…
▽ More
Lithium ion batteries often contain transition metal oxides like Li$_{x}$Mn$_2$O$_4$ ($0\leq x\leq2$). Depending on the Li content different ratios of Mn$^\text{III}$ to Mn$^\text{IV}$ ions are present. In combination with electron hopping the Jahn-Teller distortions of the Mn$^\text{III}$O$_6$ octahedra can give rise to complex phenomena like structural transitions and conductance. While for small model systems oxidation and spin states can be determined using density functional theory (DFT), the investigation of dynamical phenomena by DFT is too demanding. Previously, we have shown that a high-dimensional neural network potential can extend molecular dynamics (MD) simulations of Li$_{x}$Mn$_2$O$_4$ to nanosecond time scales, but these simulations did not provide information about the electronic structure. Here we extend the use of neural networks to the prediction of atomic oxidation and spin states. The resulting high-dimensional neural network is able to predict the spins of the Mn ions with an error of only 0.03 $\hbar$. We find that the Mn e$_\text{g}$ electrons are correctly conserved and that the number of Jahn-Teller distorted Mn$^\text{III}$O$_6$ octahedra is predicted precisely for different Li loadings. A charge ordering transition is observed between 280 and 300 K, which matches resistivity measurements. Moreover, the activation energy of the electron hopping conduction above the phase transition is predicted to be 0.18 eV deviating only 0.02 eV from experiment. This work demonstrates that machine learning is able to provide an accurate representation of both, the geometric and the electronic structure dynamics of Li$_x$Mn$_2$O$_4$, on time and length scales that are not accessible by ab initio MD.
△ Less
Submitted 2 October, 2020; v1 submitted 1 July, 2020;
originally announced July 2020.
-
Closing the gap between theory and experiment for lithium manganese oxide spinels using a high-dimensional neural network potential
Authors:
Marco Eckhoff,
Florian Schönewald,
Marcel Risch,
Cynthia A. Volkert,
Peter E. Blöchl,
Jörg Behler
Abstract:
Many positive electrode materials in lithium ion batteries include transition metals which are difficult to describe by electronic structure methods like density functional theory (DFT) due to the presence of multiple oxidation states. A prominent example is the lithium manganese oxide spinel Li$_x$Mn$_2$O$_4$ with $0\leq x\leq2$. While DFT, employing the local hybrid functional PBE0r, provides a…
▽ More
Many positive electrode materials in lithium ion batteries include transition metals which are difficult to describe by electronic structure methods like density functional theory (DFT) due to the presence of multiple oxidation states. A prominent example is the lithium manganese oxide spinel Li$_x$Mn$_2$O$_4$ with $0\leq x\leq2$. While DFT, employing the local hybrid functional PBE0r, provides a reliable description, the need for extended computer simulations of large structural models remains a significant challenge. Here, we close this gap by constructing a DFT-based high-dimensional neural network potential (HDNNP) providing accurate energies and forces at a fraction of the computational costs. As different oxidation states and the resulting Jahn-Teller distortions represent a new level of complexity for HDNNPs, the potential is carefully validated by performing X-ray diffraction experiments. We demonstrate that the HDNNP provides atomic level details and is able to predict a series of properties like the lattice parameters and expansion with increasing Li content or temperature, the orthorhombic to cubic transition, the lithium diffusion barrier, and the phonon frequencies. We show that for understanding these properties access to large time and length scales as enabled by the HDNNP is essential to close the gap between theory and experiment.
△ Less
Submitted 2 October, 2020; v1 submitted 1 July, 2020;
originally announced July 2020.
-
A Hybrid Density Functional Theory Benchmark Study on Lithium Manganese Oxides
Authors:
Marco Eckhoff,
Peter E. Blöchl,
Jörg Behler
Abstract:
The lithium manganese oxide spinel Li$_x$Mn$_2$O$_4$, with $0\leq x\leq 2$, is an important example for cathode materials in lithium ion batteries. However, an accurate description of Li$_x$Mn$_2$O$_4$ by first-principles methods like density functional theory is far from trivial due to its complex electronic structure, with a variety of energetically close electronic and magnetic states. It was f…
▽ More
The lithium manganese oxide spinel Li$_x$Mn$_2$O$_4$, with $0\leq x\leq 2$, is an important example for cathode materials in lithium ion batteries. However, an accurate description of Li$_x$Mn$_2$O$_4$ by first-principles methods like density functional theory is far from trivial due to its complex electronic structure, with a variety of energetically close electronic and magnetic states. It was found that the local density approximation as well as the generalized gradient approximation (GGA) are unable to describe Li$_x$Mn$_2$O$_4$ correctly. Here, we report an extensive benchmark for different Li$_x$Mn$_y$O$_z$ systems using the hybrid functionals PBE0 and HSE06, as well as the recently introduced local hybrid functional PBE0r. We find that all of these functionals yield energetic, structural, electronic, and magnetic properties in good agreement with experimental data. The notable benefit of the PBE0r functional, which relies on on-site Hartree-Fock exchange only, is a much reduced computational effort that is comparable to GGA functionals. Furthermore, the Hartree-Fock mixing factors in PBE0r are smaller than in PBE0, which improves the results for (lithium) manganese oxides. The investigation of Li$_x$Mn$_2$O$_4$ shows that two Mn oxidation states, +III and +IV, coexist. The Mn$^\text{III}$ ions are in the high-spin state and the corresponding MnO$_6$ octahedra are Jahn-Teller distorted. The ratio between Mn$^\text{III}$ and Mn$^\text{IV}$ and thus the electronic structure changes with the Li content while no major structural changes occur in the range from $x=0$ to $1$. This work demonstrates that the PBE0r functional provides an equally accurate and efficient description of the investigated Li$_x$Mn$_y$O$_z$ systems.
△ Less
Submitted 15 April, 2020; v1 submitted 29 January, 2020;
originally announced January 2020.
-
Metastability and low lying spectra in reversible Markov chains
Authors:
A. Bovier,
M. Eckhoff,
V. Gayrard,
M. Klein
Abstract:
We study a large class of reversible Markov chains with discrete state space and transition matrix $P_N$. We define the notion of a set of {\it metastable points} as a subset of the state space $\G_N$ such that (i) this set is reached from any point $x\in \G_N$ without return to x with probability at least $b_N$, while (ii) for any two point x,y in the metastable set, the probability…
▽ More
We study a large class of reversible Markov chains with discrete state space and transition matrix $P_N$. We define the notion of a set of {\it metastable points} as a subset of the state space $\G_N$ such that (i) this set is reached from any point $x\in \G_N$ without return to x with probability at least $b_N$, while (ii) for any two point x,y in the metastable set, the probability $T^{-1}_{x,y}$ to reach y from x without return to x is smaller than $a_N^{-1}\ll b_N$. Under some additional non-degeneracy assumption, we show that in such a situation: \item{(i)} To each metastable point corresponds a metastable state, whose mean exit time can be computed precisely. \item{(ii)} To each metastable point corresponds one simple eigenvalue of $1-P_N$ which is essentially equal to the inverse mean exit time from this state. The corresponding eigenfunctions are close to the indicator function of the support of the metastable state. Moreover, these results imply very sharp uniform control of the deviation of the probability distribution of metastable exit times from the exponential distribution.
△ Less
Submitted 26 July, 2000;
originally announced July 2000.
-
Metastability and small eigenvalues in Markov chains
Authors:
A. Bovier,
M. Eckhoff,
V. Gayrard,
M. Klein
Abstract:
In this letter we announce rigorous results that elucidate the relation between metastable states and low-lying eigenvalues in Markov chains in a much more general setting and with considerable greater precision as was so far available. This includes a sharp uncertainty principle relating all low-lying eigenvalues to mean times of metastable transitions, a relation between the support of eigenfu…
▽ More
In this letter we announce rigorous results that elucidate the relation between metastable states and low-lying eigenvalues in Markov chains in a much more general setting and with considerable greater precision as was so far available. This includes a sharp uncertainty principle relating all low-lying eigenvalues to mean times of metastable transitions, a relation between the support of eigenfunctions and the attractor of a metastable state, and sharp estimates on the convergence of probability distribution of the metastable transition times to the exponential distribution.
△ Less
Submitted 21 July, 2000;
originally announced July 2000.
-
Metastability in stochastic dynamics of disordered mean-field models
Authors:
A. Bovier,
M. Eckhoff,
V. Gayrard,
M. Klein
Abstract:
We study a class of Markov chains that describe reversible stochastic dynamics of a large class of disordered mean field models at low temperatures. Our main purpose is to give a precise relation between the metastable time scales in the problem to the properties of the rate functions of the corresponding Gibbs measures. We derive the analog of the Wentzell-Freidlin theory in this case, showing…
▽ More
We study a class of Markov chains that describe reversible stochastic dynamics of a large class of disordered mean field models at low temperatures. Our main purpose is to give a precise relation between the metastable time scales in the problem to the properties of the rate functions of the corresponding Gibbs measures. We derive the analog of the Wentzell-Freidlin theory in this case, showing that any transition can be decomposed, with probability exponentially close to one, into a deterministic sequence of ``admissible transitions''. For these admissible transitions we give upper and lower bounds on the expected transition times that differ only by a constant.
The distribution rescaled transition times are shown to converge to the exponential distribution. We exemplify our results in the context of the random field Curie-Weiss model.
△ Less
Submitted 20 May, 1999; v1 submitted 24 November, 1998;
originally announced November 1998.
