-
Generalized Maximum Entropy Methods as Limits of the Average Spectrum Method
Authors:
Khaldoon Ghanem,
Erik Koch
Abstract:
We show that in the continuum limit, the average spectrum method (ASM) is equivalent to maximizing Rényi entropies of order $η$, of which Shannon entropy is the special case $η=1$. The order of Rényi entropy is determined by the way the spectra are sampled. Our derivation also suggests a modification of Rényi entropy, giving it a non-trivial $η\to0$ limit. We show that the sharper peaks generally…
▽ More
We show that in the continuum limit, the average spectrum method (ASM) is equivalent to maximizing Rényi entropies of order $η$, of which Shannon entropy is the special case $η=1$. The order of Rényi entropy is determined by the way the spectra are sampled. Our derivation also suggests a modification of Rényi entropy, giving it a non-trivial $η\to0$ limit. We show that the sharper peaks generally obtained in ASM are associated with entropies of order $η<1$. Our work provides a generalization of the maximum entropy method that enables extracting more structure than the traditional method.
△ Less
Submitted 21 July, 2023;
originally announced July 2023.
-
Connecting Tikhonov regularization to the maximum entropy method for the analytic continuation of quantum Monte Carlo data
Authors:
Khaldoon Ghanem,
Erik Koch
Abstract:
Analytic continuation is an essential step in extracting information about the dynamical properties of physical systems from quantum Monte Carlo (QMC) simulations. Different methods for analytic continuation have been proposed and are still being developed. This paper explores a regularization method based on the repeated application of Tikhonov regularization under the discrepancy principle. The…
▽ More
Analytic continuation is an essential step in extracting information about the dynamical properties of physical systems from quantum Monte Carlo (QMC) simulations. Different methods for analytic continuation have been proposed and are still being developed. This paper explores a regularization method based on the repeated application of Tikhonov regularization under the discrepancy principle. The method can be readily implemented in any linear algebra package and gives results surprisingly close to the maximum entropy method (MaxEnt). We analyze the method in detail and demonstrate its connection to MaxEnt. In addition, we provide a straightforward method for estimating the noise level of QMC data, which is helpful for practical applications of the discrepancy principle when the noise level is not known reliably.
△ Less
Submitted 11 December, 2022;
originally announced December 2022.
-
Population Control Bias and Importance Sampling in Full Configuration Interaction Quantum Monte Carlo
Authors:
Khaldoon Ghanem,
Niklas Liebermann,
Ali Alavi
Abstract:
Population control is an essential component of any projector Monte Carlo algorithm. This control mechanism usually introduces a bias in the sampled quantities that is inversely proportional to the population size. In this paper, we investigate the population control bias in the full configuration interaction quantum Monte Carlo method. We identify the precise origin of this bias and quantify it i…
▽ More
Population control is an essential component of any projector Monte Carlo algorithm. This control mechanism usually introduces a bias in the sampled quantities that is inversely proportional to the population size. In this paper, we investigate the population control bias in the full configuration interaction quantum Monte Carlo method. We identify the precise origin of this bias and quantify it in general. We show that it has different effects on different estimators and that the shift estimator is particularly susceptible. We derive a re-weighting technique, similar to the one used in diffusion Monte Carlo, for correcting this bias and apply it to the shift estimator. We also show that by using importance sampling, the bias can be reduced substantially. We demonstrate the necessity and the effectiveness of applying these techniques for sign-problem-free systems where this bias is especially notable. Specifically, we show results for large one-dimensional Hubbard models and the two-dimensional Heisenberg model, where corrected FCIQMC results are comparable to the other high-accuracy results.
△ Less
Submitted 30 March, 2021; v1 submitted 22 February, 2021;
originally announced February 2021.
-
The Adaptive Shift Method in Full Configuration Interaction Quantum Monte Carlo: Development and Applications
Authors:
Khaldoon Ghanem,
Kai Guther,
Ali Alavi
Abstract:
In a recent paper, we proposed the adaptive shift method for correcting the undersampling bias of the initiator-FCIQMC. The method allows faster convergence with the number of walkers to the FCI limit than the normal initiator method, particularly for large systems. In its application to strongly correlated molecules, however, the method is prone to overshooting the FCI energy at intermediate walk…
▽ More
In a recent paper, we proposed the adaptive shift method for correcting the undersampling bias of the initiator-FCIQMC. The method allows faster convergence with the number of walkers to the FCI limit than the normal initiator method, particularly for large systems. In its application to strongly correlated molecules, however, the method is prone to overshooting the FCI energy at intermediate walker numbers, with convergence to the FCI limit from below. In this paper, we present a solution to the overshooting problem in strongly correlated molecules, as well as further accelerating convergence to the FCI energy. This is achieved by offsetting the reference energy to a value typically below the Hartree-Fock energy but above the exact energy. This offsetting procedure does not change the exactness property of the algorithm, namely convergence to the exact FCI solution in the large-walker limit, but at its optimal value greatly accelerates convergence. There is no overhead cost associated with this offsetting procedure, and is therefore a pure and substantial computational gain. We illustrate the behavior of this offset adaptive shift method by applying it to the N$_2$ molecule, the ozone molecule at three different geometries (equilibrium open minimum, a hypothetical ring minimum, and a transition state) in three basis sets (cc-pV$X$Z, $X$=D,T,Q), and the chromium dimer in cc-pVDZ basis set, correlating 28 electrons in 76 orbitals. We show that in most cases the offset adaptive shift method converges much faster than both the normal initiator method and the original adaptive shift method.
△ Less
Submitted 12 October, 2020;
originally announced October 2020.
-
The Ground State Electronic Energy of Benzene
Authors:
Janus J. Eriksen,
Tyler A. Anderson,
J. Emiliano Deustua,
Khaldoon Ghanem,
Diptarka Hait,
Mark R. Hoffmann,
Seunghoon Lee,
Daniel S. Levine,
Ilias Magoulas,
Jun Shen,
Norman M. Tubman,
K. Birgitta Whaley,
Enhua Xu,
Yuan Yao,
Ning Zhang,
Ali Alavi,
Garnet Kin-Lic Chan,
Martin Head-Gordon,
Wenjian Liu,
Piotr Piecuch,
Sandeep Sharma,
Seiichiro L. Ten-no,
C. J. Umrigar,
Jürgen Gauss
Abstract:
We report on the findings of a blind challenge devoted to determining the frozen-core, full configuration interaction (FCI) ground state energy of the benzene molecule in a standard correlation-consistent basis set of double-$ζ$ quality. As a broad international endeavour, our suite of wave function-based correlation methods collectively represents a diverse view of the high-accuracy repertoire of…
▽ More
We report on the findings of a blind challenge devoted to determining the frozen-core, full configuration interaction (FCI) ground state energy of the benzene molecule in a standard correlation-consistent basis set of double-$ζ$ quality. As a broad international endeavour, our suite of wave function-based correlation methods collectively represents a diverse view of the high-accuracy repertoire offered by modern electronic structure theory. In our assessment, the evaluated high-level methods are all found to qualitatively agree on a final correlation energy, with most methods yielding an estimate of the FCI value around $-863$ m$E_{\text{H}}$. However, we find the root-mean-square deviation of the energies from the studied methods to be considerable (1.3 m$E_{\text{H}}$), which in light of the acclaimed performance of each of the methods for smaller molecular systems clearly displays the challenges faced in extending reliable, near-exact correlation methods to larger systems. While the discrepancies exposed by our study thus emphasize the fact that the current state-of-the-art approaches leave room for improvement, we still expect the present assessment to provide a valuable community resource for benchmark and calibration purposes going forward.
△ Less
Submitted 7 October, 2020; v1 submitted 6 August, 2020;
originally announced August 2020.
-
NECI: N-Electron Configuration Interaction with emphasis on state-of-the-art stochastic methods
Authors:
Kai Guther,
Robert J. Anderson,
Nick S. Blunt,
Nikolay A. Bogdanov,
Deidre Cleland,
Nike Dattani,
Werner Dobrautz,
Khaldoon Ghanem,
Peter Jeszenski,
Niklas Liebermann,
Giovanni Li Manni,
Alexander Y. Lozovoi,
Hongjun Luo,
Dongxia Ma,
Florian Merz,
Catherine Overy,
Markus Rampp,
Pradipta K. Samanta,
Lauretta R. Schwarz,
James J. Shepherd,
Simon D. Smart,
Eugenio Vitale,
Oskar Weser,
George H. Booth,
Ali Alavi
Abstract:
We present NECI, a state-of-the-art implementation of the Full Configuration Interaction Quantum Monte Carlo algorithm, a method based on a stochastic application of the Hamiltonian matrix on a sparse sampling of the wave function. The program utilizes a very powerful parallelization and scales efficiently to more than 24000 CPU cores. In this paper, we describe the core functionalities of NECI an…
▽ More
We present NECI, a state-of-the-art implementation of the Full Configuration Interaction Quantum Monte Carlo algorithm, a method based on a stochastic application of the Hamiltonian matrix on a sparse sampling of the wave function. The program utilizes a very powerful parallelization and scales efficiently to more than 24000 CPU cores. In this paper, we describe the core functionalities of NECI and recent developments. This includes the capabilities to calculate ground and excited state energies, properties via the one- and two-body reduced density matrices, as well as spectral and Green's functions for ab initio and model systems. A number of enhancements of the bare FCIQMC algorithm are available within NECI, allowing to use a partially deterministic formulation of the algorithm, working in a spin-adapted basis or supporting transcorrelated Hamiltonians. NECI supports the FCIDUMP file format for integrals, supplying a convenient interface to numerous quantum chemistry programs and it is licensed under GPL-3.0.
△ Less
Submitted 26 June, 2020;
originally announced June 2020.
-
Extending the average spectrum method: Grid points sampling and density averaging
Authors:
Khaldoon Ghanem,
Erik Koch
Abstract:
Analytic continuation of imaginary time or frequency data to the real axis is a crucial step in extracting dynamical properties from quantum Monte Carlo simulations. The average spectrum method provides an elegant solution by integrating over all non-negative spectra weighted by how well they fit the data. In a recent paper, we found that discretizing the functional integral as in Feynman's path-i…
▽ More
Analytic continuation of imaginary time or frequency data to the real axis is a crucial step in extracting dynamical properties from quantum Monte Carlo simulations. The average spectrum method provides an elegant solution by integrating over all non-negative spectra weighted by how well they fit the data. In a recent paper, we found that discretizing the functional integral as in Feynman's path-integrals, does not have a well-defined continuum limit. Instead, the limit depends on the discretization grid whose choice may strongly bias the results. In this paper, we demonstrate that sampling the grid points, instead of keeping them fixed, also changes the functional integral limit and rather helps to overcome the bias considerably. We provide an efficient algorithm for doing the sampling and show how the density of the grid points acts now as a default model with a significantly reduced biasing effect. The remaining bias depends mainly on the width of the grid density, so we go one step further and average also over densities of different widths. For a certain class of densities, including Gaussian and exponential ones, this width averaging can be done analytically, eliminating the need to specify this parameter without introducing any computational overhead.
△ Less
Submitted 2 April, 2020;
originally announced April 2020.
-
Unbiasing the initiator approximation in Full Configuration Interaction Quantum Monte Carlo
Authors:
Khaldoon Ghanem,
Alexander Y. Lozovoi,
Ali Alavi
Abstract:
We identify and rectify a crucial source of bias in the initiator FCIQMC algorithm. Non-initiator determinants (i.e. determinants whose population is below the initiator threshold) are subject to a systematic {\em undersampling} bias, which in large systems leads to a bias in the energy when an insufficient number of walkers is used. We show that the acceptance probability ($p_{acc}$), that a non-…
▽ More
We identify and rectify a crucial source of bias in the initiator FCIQMC algorithm. Non-initiator determinants (i.e. determinants whose population is below the initiator threshold) are subject to a systematic {\em undersampling} bias, which in large systems leads to a bias in the energy when an insufficient number of walkers is used. We show that the acceptance probability ($p_{acc}$), that a non-initiator determinant has its spawns accepted, can be used to unbias the initiator bias, in a simple and accurate manner, by reducing the applied shift to the non-initiator proportionately to $p_{acc}$. This modification preserves the property that in the large walker limit, when $p_{acc}\rightarrow1$, the unbiasing procedure disappears, and the initiator approximation becomes exact. We demonstrate that this algorithm shows rapid convergence to the FCI limit with respect to walker number, and furthermore largely removes the dependence of the algorithm on the initiator threshold, enabling highly accurate results to be obtained even with large values of the threshold. This is exemplified in the case of butadiene/ANO-L-pVDZ and benzene/cc-pVDZ, correlating 22 and 30 electrons in 82 and 108 orbitals respectively. In butadiene $5\times 10^7$ and in benzene $10^8$ walkers suffice to obtain an energy to within a milli-Hartree of the CCSDT(Q) result, in Hilbert spaces of $10^{26}$ and $10^{35}$ respectively. Essentially converged results require $\sim 10^8$ walkers for butadiene and $\sim 10^9$ walkers for benzene, and lie slightly lower than CCSDT(Q). Owing to large-scale parallelisability, these calculations can be executed in a matter of hours on a few hundred processors. The present method largely solves the initiator-bias problems that the initiator method suffered from when applied to medium-sized molecules.
△ Less
Submitted 25 November, 2019;
originally announced December 2019.
-
The Average Spectrum Method for Analytic Continuation: Efficient Blocked Modes Sampling and Dependence on Discretization Grid
Authors:
Khaldoon Ghanem,
Erik Koch
Abstract:
The average spectrum method is a promising approach for the analytic continuation of imaginary time or frequency data to the real axis. It determines the analytic continuation of noisy data from a functional average over all admissible spectral functions, weighted by how well they fit the data. Its main advantage is the apparent lack of adjustable parameters and smoothness constraints, using inste…
▽ More
The average spectrum method is a promising approach for the analytic continuation of imaginary time or frequency data to the real axis. It determines the analytic continuation of noisy data from a functional average over all admissible spectral functions, weighted by how well they fit the data. Its main advantage is the apparent lack of adjustable parameters and smoothness constraints, using instead the information on the statistical noise in the data. Its main disadvantage is the enormous computational cost of performing the functional integral. Here we introduce an efficient implementation, based on the singular value decomposition of the integral kernel, eliminating this problem. It allows us to analyze the behavior of the average spectrum method in detail. We find that the discretization of the real-frequency grid, on which the spectral function is represented, biases the results. The distribution of the grid points plays the role of a default model while the number of grid points acts as a regularization parameter. We give a quantitative explanation for this behavior, point out the crucial role of the default model and provide a practical method for choosing it, making the average spectrum method a reliable and efficient technique for analytic continuation.
△ Less
Submitted 3 December, 2019;
originally announced December 2019.
