Showing 1–21 of 21 results for author: Spencer, J S

Neural network variational Monte Carlo for positronic chemistry

Authors: G. Cassella, W. M. C. Foulkes, D. Pfau, J. S. Spencer

Abstract: Quantum chemical calculations of the ground-state properties of positron-molecule complexes are challenging. The main difficulty lies in employing an appropriate basis set for representing the coalescence between electrons and a positron. Here, we tackle this problem with the recently developed Fermionic neural network (FermiNet) wavefunction, which does not depend on a basis set. We find that Fer… ▽ More Quantum chemical calculations of the ground-state properties of positron-molecule complexes are challenging. The main difficulty lies in employing an appropriate basis set for representing the coalescence between electrons and a positron. Here, we tackle this problem with the recently developed Fermionic neural network (FermiNet) wavefunction, which does not depend on a basis set. We find that FermiNet produces highly accurate, in some cases state-of-the-art, ground-state energies across a range of atoms and small molecules with a wide variety of qualitatively distinct positron binding characteristics. We calculate the binding energy of the challenging non-polar benzene molecule, finding good agreement with the experimental value, and obtain annihilation rates which compare favourably with those obtained with explicitly correlated Gaussian wavefunctions. Our results demonstrate a generic advantage of neural network wavefunction-based methods and broaden their applicability to systems beyond the standard molecular Hamiltonian. △ Less

Submitted 7 February, 2024; v1 submitted 9 October, 2023; originally announced October 2023.

Comments: 14 pages, 3 figures

Accurate Computation of Quantum Excited States with Neural Networks

Authors: David Pfau, Simon Axelrod, Halvard Sutterud, Ingrid von Glehn, James S. Spencer

Abstract: We present a variational Monte Carlo algorithm for estimating the lowest excited states of a quantum system which is a natural generalization of the estimation of ground states. The method has no free parameters and requires no explicit orthogonalization of the different states, instead transforming the problem of finding excited states of a given system into that of finding the ground state of an… ▽ More We present a variational Monte Carlo algorithm for estimating the lowest excited states of a quantum system which is a natural generalization of the estimation of ground states. The method has no free parameters and requires no explicit orthogonalization of the different states, instead transforming the problem of finding excited states of a given system into that of finding the ground state of an expanded system. Expected values of arbitrary observables can be calculated, including off-diagonal expectations between different states such as the transition dipole moment. Although the method is entirely general, it works particularly well in conjunction with recent work on using neural networks as variational Ansätze for many-electron systems, and we show that by combining this method with the FermiNet and Psiformer Ansätze we can accurately recover vertical excitation energies and oscillator strengths on a range of molecules. Our method is the first deep learning approach to achieve accurate vertical excitation energies, including challenging double excitations, on benzene-scale molecules. Beyond the chemistry examples here, we expect this technique will be of great interest for applications to atomic, nuclear and condensed matter physics. △ Less

Submitted 3 September, 2024; v1 submitted 31 August, 2023; originally announced August 2023.

Comments: The content of this version is identical to the manuscript draft which was sent to Science on May 17th 2024

Journal ref: Science 385, 6711 (2024)

Neural Wave Functions for Superfluids

Authors: Wan Tong Lou, Halvard Sutterud, Gino Cassella, W. M. C. Foulkes, Johannes Knolle, David Pfau, James S. Spencer

Abstract: Understanding superfluidity remains a major goal of condensed matter physics. Here we tackle this challenge utilizing the recently developed Fermionic neural network (FermiNet) wave function Ansatz [D. Pfau et al., Phys. Rev. Res. 2, 033429 (2020).] for variational Monte Carlo calculations. We study the unitary Fermi gas, a system with strong, short-range, two-body interactions known to possess a… ▽ More Understanding superfluidity remains a major goal of condensed matter physics. Here we tackle this challenge utilizing the recently developed Fermionic neural network (FermiNet) wave function Ansatz [D. Pfau et al., Phys. Rev. Res. 2, 033429 (2020).] for variational Monte Carlo calculations. We study the unitary Fermi gas, a system with strong, short-range, two-body interactions known to possess a superfluid ground state but difficult to describe quantitatively. We demonstrate key limitations of the FermiNet Ansatz in studying the unitary Fermi gas and propose a simple modification based on the idea of an antisymmetric geminal power singlet (AGPs) wave function. The new AGPs FermiNet outperforms the original FermiNet significantly in paired systems, giving results which are more accurate than fixed-node diffusion Monte Carlo and are consistent with experiment. We prove mathematically that the new Ansatz, which only differs from the original Ansatz by the method of antisymmetrization, is a strict generalization of the original FermiNet architecture, despite the use of fewer parameters. Our approach shares several advantages with the original FermiNet: the use of a neural network removes the need for an underlying basis set; and the flexibility of the network yields extremely accurate results within a variational quantum Monte Carlo framework that provides access to unbiased estimates of arbitrary ground-state expectation values. We discuss how the method can be extended to study other superfluids. △ Less

Submitted 10 June, 2024; v1 submitted 11 May, 2023; originally announced May 2023.

Comments: 19 pages, 8 figures. Talk presented at the 2023 APS March Meeting, March 5-10, 2023, Las Vegas, Nevada, United States

Journal ref: Phys. Rev. X 14, 021030 (2024)

A Self-Attention Ansatz for Ab-initio Quantum Chemistry

Authors: Ingrid von Glehn, James S. Spencer, David Pfau

Abstract: We present a novel neural network architecture using self-attention, the Wavefunction Transformer (Psiformer), which can be used as an approximation (or Ansatz) for solving the many-electron Schrödinger equation, the fundamental equation for quantum chemistry and material science. This equation can be solved from first principles, requiring no external training data. In recent years, deep neural n… ▽ More We present a novel neural network architecture using self-attention, the Wavefunction Transformer (Psiformer), which can be used as an approximation (or Ansatz) for solving the many-electron Schrödinger equation, the fundamental equation for quantum chemistry and material science. This equation can be solved from first principles, requiring no external training data. In recent years, deep neural networks like the FermiNet and PauliNet have been used to significantly improve the accuracy of these first-principle calculations, but they lack an attention-like mechanism for gating interactions between electrons. Here we show that the Psiformer can be used as a drop-in replacement for these other neural networks, often dramatically improving the accuracy of the calculations. On larger molecules especially, the ground state energy can be improved by dozens of kcal/mol, a qualitative leap over previous methods. This demonstrates that self-attention networks can learn complex quantum mechanical correlations between electrons, and are a promising route to reaching unprecedented accuracy in chemical calculations on larger systems. △ Less

Submitted 19 April, 2023; v1 submitted 24 November, 2022; originally announced November 2022.

Learned Force Fields Are Ready For Ground State Catalyst Discovery

Authors: Michael Schaarschmidt, Morgane Riviere, Alex M. Ganose, James S. Spencer, Alexander L. Gaunt, James Kirkpatrick, Simon Axelrod, Peter W. Battaglia, Jonathan Godwin

Abstract: We present evidence that learned density functional theory (``DFT'') force fields are ready for ground state catalyst discovery. Our key finding is that relaxation using forces from a learned potential yields structures with similar or lower energy to those relaxed using the RPBE functional in over 50\% of evaluated systems, despite the fact that the predicted forces differ significantly from the… ▽ More We present evidence that learned density functional theory (``DFT'') force fields are ready for ground state catalyst discovery. Our key finding is that relaxation using forces from a learned potential yields structures with similar or lower energy to those relaxed using the RPBE functional in over 50\% of evaluated systems, despite the fact that the predicted forces differ significantly from the ground truth. This has the surprising implication that learned potentials may be ready for replacing DFT in challenging catalytic systems such as those found in the Open Catalyst 2020 dataset. Furthermore, we show that a force field trained on a locally harmonic energy surface with the same minima as a target DFT energy is also able to find lower or similar energy structures in over 50\% of cases. This ``Easy Potential'' converges in fewer steps than a standard model trained on true energies and forces, which further accelerates calculations. Its success illustrates a key point: learned potentials can locate energy minima even when the model has high force errors. The main requirement for structure optimisation is simply that the learned potential has the correct minima. Since learned potentials are fast and scale linearly with system size, our results open the possibility of quickly finding ground states for large systems. △ Less

Submitted 26 September, 2022; originally announced September 2022.

ipie: A Python-based Auxiliary-Field Quantum Monte Carlo Program with Flexibility and Efficiency on CPUs and GPUs

Authors: Fionn D. Malone, Ankit Mahajan, James S. Spencer, Joonho Lee

Abstract: We report the development of a python-based auxiliary-field quantum Monte Carlo (AFQMC) program, ipie, with preliminary timing benchmarks and new AFQMC results on the isomerization of [Cu$_2$O$_2$$]^{2+}$. We demonstrate how implementations for both central and graphical processing units (CPUs and GPUs) are achieved in ipie. We show an interface of ipie with PySCF as well as a straightforward temp… ▽ More We report the development of a python-based auxiliary-field quantum Monte Carlo (AFQMC) program, ipie, with preliminary timing benchmarks and new AFQMC results on the isomerization of [Cu$_2$O$_2$$]^{2+}$. We demonstrate how implementations for both central and graphical processing units (CPUs and GPUs) are achieved in ipie. We show an interface of ipie with PySCF as well as a straightforward template for adding new estimators to ipie. Our timing benchmarks against other C++ codes, QMCPACK and Dice, suggest that ipie is faster or similarly performing for all chemical systems considered on both CPUs and GPUs. Our results on [Cu$_2$O$_2$$]^{2+}$ using selected configuration interaction trials show that it is possible to converge the ph-AFQMC isomerization energy between bis($μ$-oxo) and $μ$-$η^2$:$η^2$ peroxo configurations to the exact known results for small basis sets with $10^5$ to $10^6$ determinants. We also report the isomerization energy with a quadruple-zeta basis set with an estimated error less than a kcal/mol, which involved 52 electrons and 290 orbitals with $10^6$ determinants in the trial wavefunction. These results highlight the utility of ph-AFQMC and ipie for systems with modest strong correlation and large-scale dynamic correlation. △ Less

Submitted 8 November, 2022; v1 submitted 8 September, 2022; originally announced September 2022.

Discovering Quantum Phase Transitions with Fermionic Neural Networks

Authors: G. Cassella, H. Sutterud, S. Azadi, N. D. Drummond, D. Pfau, J. S. Spencer, W. M. C. Foulkes

Abstract: Deep neural networks have been extremely successful as highly accurate wave function ansätze for variational Monte Carlo calculations of molecular ground states. We present an extension of one such ansatz, FermiNet, to calculations of the ground states of periodic Hamiltonians, and study the homogeneous electron gas. FermiNet calculations of the ground-state energies of small electron gas systems… ▽ More Deep neural networks have been extremely successful as highly accurate wave function ansätze for variational Monte Carlo calculations of molecular ground states. We present an extension of one such ansatz, FermiNet, to calculations of the ground states of periodic Hamiltonians, and study the homogeneous electron gas. FermiNet calculations of the ground-state energies of small electron gas systems are in excellent agreement with previous initiator full configuration interaction quantum Monte Carlo and diffusion Monte Carlo calculations. We investigate the spin-polarized homogeneous electron gas and demonstrate that the same neural network architecture is capable of accurately representing both the delocalized Fermi liquid state and the localized Wigner crystal state. The network is given no \emph{a priori} knowledge that a phase transition exists, but converges on the translationally invariant ground state at high density and spontaneously breaks the symmetry to produce the crystalline ground state at low density. △ Less

Submitted 5 July, 2022; v1 submitted 10 February, 2022; originally announced February 2022.

Comments: 12 pages, 3 figures

Better, Faster Fermionic Neural Networks

Authors: James S. Spencer, David Pfau, Aleksandar Botev, W. M. C. Foulkes

Abstract: The Fermionic Neural Network (FermiNet) is a recently-developed neural network architecture that can be used as a wavefunction Ansatz for many-electron systems, and has already demonstrated high accuracy on small systems. Here we present several improvements to the FermiNet that allow us to set new records for speed and accuracy on challenging systems. We find that increasing the size of the netwo… ▽ More The Fermionic Neural Network (FermiNet) is a recently-developed neural network architecture that can be used as a wavefunction Ansatz for many-electron systems, and has already demonstrated high accuracy on small systems. Here we present several improvements to the FermiNet that allow us to set new records for speed and accuracy on challenging systems. We find that increasing the size of the network is sufficient to reach chemical accuracy on atoms as large as argon. Through a combination of implementing FermiNet in JAX and simplifying several parts of the network, we are able to reduce the number of GPU hours needed to train the FermiNet on large systems by an order of magnitude. This enables us to run the FermiNet on the challenging transition of bicyclobutane to butadiene and compare against the PauliNet on the automerization of cyclobutadiene, and we achieve results near the state of the art for both. △ Less

Submitted 13 November, 2020; originally announced November 2020.

Comments: To appear at the 3rd NeurIPS Workshop on Machine Learning and Physical Science

Ab-Initio Solution of the Many-Electron Schrödinger Equation with Deep Neural Networks

Authors: David Pfau, James S. Spencer, Alexander G. de G. Matthews, W. M. C. Foulkes

Abstract: Given access to accurate solutions of the many-electron Schrödinger equation, nearly all chemistry could be derived from first principles. Exact wavefunctions of interesting chemical systems are out of reach because they are NP-hard to compute in general, but approximations can be found using polynomially-scaling algorithms. The key challenge for many of these algorithms is the choice of wavefunct… ▽ More Given access to accurate solutions of the many-electron Schrödinger equation, nearly all chemistry could be derived from first principles. Exact wavefunctions of interesting chemical systems are out of reach because they are NP-hard to compute in general, but approximations can be found using polynomially-scaling algorithms. The key challenge for many of these algorithms is the choice of wavefunction approximation, or Ansatz, which must trade off between efficiency and accuracy. Neural networks have shown impressive power as accurate practical function approximators and promise as a compact wavefunction Ansatz for spin systems, but problems in electronic structure require wavefunctions that obey Fermi-Dirac statistics. Here we introduce a novel deep learning architecture, the Fermionic Neural Network, as a powerful wavefunction Ansatz for many-electron systems. The Fermionic Neural Network is able to achieve accuracy beyond other variational quantum Monte Carlo Ansätze on a variety of atoms and small molecules. Using no data other than atomic positions and charges, we predict the dissociation curves of the nitrogen molecule and hydrogen chain, two challenging strongly-correlated systems, to significantly higher accuracy than the coupled cluster method, widely considered the most accurate scalable method for quantum chemistry at equilibrium geometry. This demonstrates that deep neural networks can improve the accuracy of variational quantum Monte Carlo to the point where it outperforms other ab-initio quantum chemistry methods, opening the possibility of accurate direct optimization of wavefunctions for previously intractable many-electron systems. △ Less

Submitted 25 March, 2021; v1 submitted 5 September, 2019; originally announced September 2019.

Comments: Final proof for Physical Review Research

Journal ref: Phys. Rev. Research 2, 033429 (2020)

The HANDE-QMC project: open-source stochastic quantum chemistry from the ground state up

Authors: James S. Spencer, Nick S. Blunt, Seonghoon Choi, Jiri Etrych, Maria-Andreea Filip, W. M. C. Foulkes, Ruth S. T. Franklin, Will J. Handley, Fionn D. Malone, Verena A. Neufeld, Roberto Di Remigio, Thomas W. Rogers, Charles J. C. Scott, James J. Shepherd, William A. Vigor, Joseph Weston, RuQing Xu, Alex J. W. Thom

Abstract: Building on the success of Quantum Monte Carlo techniques such as diffusion Monte Carlo, alternative stochastic approaches to solve electronic structure problems have emerged over the last decade. The full configuration interaction quantum Monte Carlo (FCIQMC) method allows one to systematically approach the exact solution of such problems, for cases where very high accuracy is desired. The introd… ▽ More Building on the success of Quantum Monte Carlo techniques such as diffusion Monte Carlo, alternative stochastic approaches to solve electronic structure problems have emerged over the last decade. The full configuration interaction quantum Monte Carlo (FCIQMC) method allows one to systematically approach the exact solution of such problems, for cases where very high accuracy is desired. The introduction of FCIQMC has subsequently led to the development of coupled cluster Monte Carlo (CCMC) and density matrix quantum Monte Carlo (DMQMC), allowing stochastic sampling of the coupled cluster wave function and the exact thermal density matrix, respectively. In this article we describe the HANDE-QMC code, an open-source implementation of FCIQMC, CCMC and DMQMC, including initiator and semi-stochastic adaptations. We describe our code and demonstrate its use on three example systems; a molecule (nitric oxide), a model solid (the uniform electron gas), and a real solid (diamond). An illustrative tutorial is also included. △ Less

Submitted 4 December, 2018; v1 submitted 28 November, 2018; originally announced November 2018.

Large Scale Parallelization in Stochastic Coupled Cluster

Authors: James S. Spencer, Verena A. Neufeld, William A. Vigor, Ruth S. T. Franklin, Alex J. W. Thom

Abstract: Coupled cluster theory is a vital cornerstone of electronic structure theory and is being applied to ever-larger systems. Stochastic approaches to quantum chemistry have grown in importance and offer compelling advantages over traditional deterministic algorithms in terms of computational demands, theoretical flexibility or lower scaling with system size. We present a highly parallelizable algorit… ▽ More Coupled cluster theory is a vital cornerstone of electronic structure theory and is being applied to ever-larger systems. Stochastic approaches to quantum chemistry have grown in importance and offer compelling advantages over traditional deterministic algorithms in terms of computational demands, theoretical flexibility or lower scaling with system size. We present a highly parallelizable algorithm of the coupled cluster Monte Carlo method involving sampling of clusters of excitors over multiple time steps. The behaviour of the algorithm is investigated on the uniform electron gas and the water dimer at CCSD, CCSDT and CCSDTQ levels. We also describe two improvements to the original sampling algorithm, full non-composite and multi-spawn sampling. A stochastic approach to coupled cluster results in an efficient and scalable implementation at arbitrary truncation levels in the coupled cluster expansion. △ Less

Submitted 12 December, 2018; v1 submitted 10 July, 2018; originally announced July 2018.

Comments: This article may be downloaded for personal use only. Any other use requires prior permission of the author and AIP Publishing. The following article appeared in "Spencer, J.S. et al., J. Chem. Phys. 149, 204103 (2018)", and may be found at https://doi.org/10.1063/1.5047420. Data and further info can be accessed at https://doi.org/10.17863/CAM.30359

Journal ref: J. Chem. Phys. 149, 204103 (2018)

Understanding and Improving the Efficiency of Full Configuration Interaction Quantum Monte Carlo

Authors: W. A. Vigor, J. S. Spencer, M. J. Bearpark, A. J. W. Thom

Abstract: Within Full Configuration Interaction Quantum Monte Carlo, we investigate how the statistical error behaves as a function of the parameters which control the stochastic sampling. We define the inefficiency as a measure of the statistical error per particle sampling the space and per timestep and show there is a sizeable parameter regime where this is minimised. We find that this inefficiency incre… ▽ More Within Full Configuration Interaction Quantum Monte Carlo, we investigate how the statistical error behaves as a function of the parameters which control the stochastic sampling. We define the inefficiency as a measure of the statistical error per particle sampling the space and per timestep and show there is a sizeable parameter regime where this is minimised. We find that this inefficiency increases sublinearly with Hilbert space size and can be reduced by localising the canonical Hartree--Fock molecular orbitals, suggesting that the choice of basis impacts the method beyond that of the sign problem. △ Less

Submitted 14 March, 2016; v1 submitted 5 January, 2016; originally announced January 2016.

Comments: 7 pages, 4 figures, Supplementary material available as 'Ancillary Files'

Journal ref: J. Chem. Phys. 144, 094110 (2016)

Linked Coupled Cluster Monte Carlo

Authors: Ruth S. T. Franklin, James S. Spencer, Alberto Zoccante, Alex J. W. Thom

Abstract: We consider a new formulation of the stochastic coupled cluster method in terms of the similarity transformed Hamiltonian. We show that improvement in the granularity with which the wavefunction is represented results in a reduction in the critical population required to correctly sample the wavefunction for a range of systems and excitation levels and hence leads to a substantial reduction in the… ▽ More We consider a new formulation of the stochastic coupled cluster method in terms of the similarity transformed Hamiltonian. We show that improvement in the granularity with which the wavefunction is represented results in a reduction in the critical population required to correctly sample the wavefunction for a range of systems and excitation levels and hence leads to a substantial reduction in the computational cost. This development has the potential to substantially extend the range of the method, enabling it to be used to treat larger systems with excitation levels not easily accessible with conventional deterministic methods. △ Less

Submitted 30 January, 2016; v1 submitted 25 November, 2015; originally announced November 2015.

Journal ref: J. Chem. Phys. 144, 044111 (2016);

Developments in Stochastic Coupled Cluster Theory: The initiator approximation and application to the Uniform Electron Gas

Authors: James S. Spencer, Alex J. W. Thom

Abstract: We describe further details of the Stochastic Coupled Cluster method and a diagnostic of such calculations, the shoulder height, akin to the plateau found in Full Configuration Interaction Quantum Monte Carlo. We describe an initiator modification to Stochastic Coupled Cluster Theory and show that initiator calculations can be extrapolated to the unbiased limit. We apply this method to the 3D 14-e… ▽ More We describe further details of the Stochastic Coupled Cluster method and a diagnostic of such calculations, the shoulder height, akin to the plateau found in Full Configuration Interaction Quantum Monte Carlo. We describe an initiator modification to Stochastic Coupled Cluster Theory and show that initiator calculations can be extrapolated to the unbiased limit. We apply this method to the 3D 14-electron uniform electron gas and present complete basis set limit values of the CCSD and previously unattainable CCSDT correlation energies for up to rs = 2, showing a requirement to include triple excitations to accurately calculate energies at high densities. △ Less

Submitted 18 November, 2015; originally announced November 2015.

Comments: 14 pages, 12 figures

Interaction Picture Density Matrix Quantum Monte Carlo

Authors: Fionn D. Malone, N. S. Blunt, James J. Shepherd, D. K. K. Lee, J. S. Spencer, W. M. C. Foulkes

Abstract: The recently developed density matrix quantum Monte Carlo (DMQMC) algorithm stochastically samples the N -body thermal density matrix and hence provides access to exact properties of many-particle quantum systems at arbitrary temperatures. We demonstrate that moving to the interaction picture provides substantial benefits when applying DMQMC to interacting fermions. In this first study, we focus o… ▽ More The recently developed density matrix quantum Monte Carlo (DMQMC) algorithm stochastically samples the N -body thermal density matrix and hence provides access to exact properties of many-particle quantum systems at arbitrary temperatures. We demonstrate that moving to the interaction picture provides substantial benefits when applying DMQMC to interacting fermions. In this first study, we focus on a system of much recent interest: the uniform electron gas in the warm dense regime. The basis set incompleteness error at finite temperature is investigated and extrapolated via a simple Monte Carlo sampling procedure. Finally, we provide benchmark calculations for a four-electron system, comparing our results to previous work where possible. △ Less

Submitted 14 October, 2015; v1 submitted 9 June, 2015; originally announced June 2015.

Comments: Minor text modifications and added deviation subplot to Fig. 9 following referee's review comments. Include link to supplementary material in references

Journal ref: J. Chem. Phys. 143, 044116 (2015)

Semi-stochastic full configuration interaction quantum Monte Carlo: developments and application

Authors: N. S. Blunt, Simon D. Smart, J. A. F. Kersten, J. S. Spencer, George H. Booth, Ali Alavi

Abstract: We expand upon the recent semi-stochastic adaptation to full configuration interaction quantum Monte Carlo (FCIQMC). We present an alternate method for generating the deterministic space without a priori knowledge of the wave function and present stochastic efficiencies for a variety of both molecular and lattice systems. The algorithmic details of an efficient semi-stochastic implementation are p… ▽ More We expand upon the recent semi-stochastic adaptation to full configuration interaction quantum Monte Carlo (FCIQMC). We present an alternate method for generating the deterministic space without a priori knowledge of the wave function and present stochastic efficiencies for a variety of both molecular and lattice systems. The algorithmic details of an efficient semi-stochastic implementation are presented, with particular consideration given to the effect that the adaptation has on parallel performance in FCIQMC. We further demonstrate the benefit for calculation of reduced density matrices in FCIQMC through replica sampling, where the semi-stochastic adaptation seems to have even larger efficiency gains. We then combine these ideas to produce explicitly correlated corrected FCIQMC energies for the Beryllium dimer, for which stochastic errors on the order of wavenumber accuracy are achievable. △ Less

Submitted 29 April, 2015; v1 submitted 17 February, 2015; originally announced February 2015.

Comments: 10 pages, 7 figures

Journal ref: J. Chem. Phys. 142 (2015), 184107

The sign problem in full configuration interaction quantum Monte Carlo: Linear and sub-linear representation regimes for the exact wave function

Authors: James J. Shepherd, Gustavo E. Scuseria, James S. Spencer

Abstract: We investigate the sign problem for full configuration interaction quantum Monte Carlo (FCIQMC), a stochastic algorithm for finding the ground state solution of the Schrödinger equation with substantially reduced computational cost compared with exact diagonalisation. We find $k$-space Hubbard models for which the solution is yielded with storage that grows sub-linearly in the size of the many-bod… ▽ More We investigate the sign problem for full configuration interaction quantum Monte Carlo (FCIQMC), a stochastic algorithm for finding the ground state solution of the Schrödinger equation with substantially reduced computational cost compared with exact diagonalisation. We find $k$-space Hubbard models for which the solution is yielded with storage that grows sub-linearly in the size of the many-body Hilbert space, in spite of using a wave function that is simply linear combination of states. The FCIQMC algorithm is able to find this sub-linear scaling regime without bias and with only a choice of Hamiltonian basis. By means of a demonstration we solve for the energy of a 70-site half-filled system (with a space of $10^{38}$ determinants) in 250 core hours, substantially quicker than the $\sim$10$^{36}$ core hours that would be required by exact diagonalisation. This is the largest space that has been sampled in an unbiased fashion. The challenge for the recently-developed FCIQMC method is made clear: expand the sub-linear scaling regime whilst retaining exact on average accuracy. This result rationalizes the success of the initiator adaptation (i-FCIQMC) and offers clues to improve it. We argue that our results changes the landscape for development of FCIQMC and related methods. △ Less

Submitted 17 July, 2014; originally announced July 2014.

Comments: 6 pages, 4 figures. The mentioned supplementary material is included as "Ancillary files". Comments welcome

Journal ref: Phys. Rev. B 90, 155130 (2014)

Minimising biases in Full Configuration Interaction Quantum Monte Carlo

Authors: W. A. Vigor, J. S. Spencer, M. J. Bearpark, A. J. W. Thom

Abstract: We show that Full Configuration Interaction Quantum Monte Carlo (FCIQMC) is a Markov Chain in its present form. We construct the Markov matrix of FCIQMC for a two determinant system and hence compute the stationary distribution. These solutions are used to quantify the dependence of the population dynamics on the parameters defining the Markov chain. Despite the simplicity of a system with only tw… ▽ More We show that Full Configuration Interaction Quantum Monte Carlo (FCIQMC) is a Markov Chain in its present form. We construct the Markov matrix of FCIQMC for a two determinant system and hence compute the stationary distribution. These solutions are used to quantify the dependence of the population dynamics on the parameters defining the Markov chain. Despite the simplicity of a system with only two determinants, it still reveals a population control bias inherent to the FCIQMC algorithm. We investigate the effect of simulation parameters on the population control bias for the neon atom and suggest simulation setups to in general minimise the bias. We show a reweighting scheme to remove the bias caused by population control commonly used in Diffusion Monte Carlo [J. Chem. Phys. 99, 2865 (1993)] is effective and recommend its use as a post processing step. △ Less

Submitted 11 June, 2015; v1 submitted 7 July, 2014; originally announced July 2014.

Comments: Supplementary material available as 'Ancillary Files'

Journal ref: J. Chem. Phys. 142, 104101 (2015)

Density matrix quantum Monte Carlo

Authors: N. S. Blunt, T. W. Rogers, J. S. Spencer, W. M. C. Foulkes

Abstract: We present a quantum Monte Carlo method capable of sampling the full density matrix of a many-particle system at finite temperature. This allows arbitrary reduced density matrix elements and expectation values of complicated non-local observables to be evaluated easily. The method resembles full configuration interaction quantum Monte Carlo but works in the space of many-particle operators instead… ▽ More We present a quantum Monte Carlo method capable of sampling the full density matrix of a many-particle system at finite temperature. This allows arbitrary reduced density matrix elements and expectation values of complicated non-local observables to be evaluated easily. The method resembles full configuration interaction quantum Monte Carlo but works in the space of many-particle operators instead of the space of many-particle wave functions. One simulation provides the density matrix at all temperatures simultaneously, from $T=\infty$ to $T=0$, allowing the temperature dependence of expectation values to be studied. The direct sampling of the density matrix also allows the calculation of some previously inaccessible entanglement measures. We explain the theory underlying the method, describe the algorithm, and introduce an importance-sampling procedure to improve the stochastic efficiency. To demonstrate the potential of our approach, the energy and staggered magnetization of the isotropic antiferromagnetic Heisenberg model on small lattices, the concurrence of one-dimensional spin rings, and the Renyi $S_2$ entanglement entropy of various sublattices of the $6 \times 6$ Heisenberg model are calculated. The nature of the sign problem in the method is also investigated. △ Less

Submitted 26 April, 2014; v1 submitted 20 March, 2013; originally announced March 2013.

Comments: 13 pages, 6 figures

The effect of quantization on the FCIQMC sign problem

Authors: Michael H. Kolodrubetz, James S. Spencer, Bryan K. Clark, W. Matthew C. Foulkes

Abstract: The sign problem in Full Configuration Interaction Quantum Monte Carlo (FCIQMC) without annihilation can be understood as an instability of the psi-particle population to the ground state of the matrix obtained by making all off-diagonal elements of the Hamiltonian negative. Such a matrix, and hence the sign problem, is basis dependent. In this paper we discuss the properties of a physically impor… ▽ More The sign problem in Full Configuration Interaction Quantum Monte Carlo (FCIQMC) without annihilation can be understood as an instability of the psi-particle population to the ground state of the matrix obtained by making all off-diagonal elements of the Hamiltonian negative. Such a matrix, and hence the sign problem, is basis dependent. In this paper we discuss the properties of a physically important basis choice: first versus second quantization. For a given choice of single-particle orbitals, we identify the conditions under which the fermion sign problem in the second quantized basis of antisymmetric Slater determinants is identical to the sign problem in the first quantized basis of unsymmetrized Hartree products. We also show that, when the two differ, the fermion sign problem is always less severe in the second quantized basis. This supports the idea that FCIQMC, even in the absence of annihilation, improves the sign problem relative to first quantized methods. Finally, we point out some theoretically interesting classes of Hamiltonians where first and second quantized sign problems differ, and others where they do not. △ Less

Submitted 7 January, 2013; v1 submitted 13 September, 2012; originally announced September 2012.

Comments: 4 pages w/ 2 page appendix, 2 figures, 1 table

Journal ref: J. Chem. Phys. 138, 024110 (2013)

The sign problem and population dynamics in the full configuration interaction quantum Monte Carlo method

Authors: J. S. Spencer, N. S. Blunt, W. M. C. Foulkes

Abstract: The recently proposed full configuration interaction quantum Monte Carlo method allows access to essentially exact ground-state energies of systems of interacting fermions substantially larger than previously tractable without knowledge of the nodal structure of the ground-state wave function. We investigate the nature of the sign problem in this method and how its severity depends on the system s… ▽ More The recently proposed full configuration interaction quantum Monte Carlo method allows access to essentially exact ground-state energies of systems of interacting fermions substantially larger than previously tractable without knowledge of the nodal structure of the ground-state wave function. We investigate the nature of the sign problem in this method and how its severity depends on the system studied. We explain how cancelation of the positive and negative particles sampling the wave function ensures convergence to a stochastic representation of the many-fermion ground state and accounts for the characteristic population dynamics observed in simulations. △ Less

Submitted 28 January, 2012; v1 submitted 25 October, 2011; originally announced October 2011.

Comments: 11 pages. 6 figures

Journal ref: J. Chem. Phys. 136, 054110 (2012)