Skip to main content

Showing 1–20 of 20 results for author: Shanahan, P

Searching in archive cs. Search in all archives.
.
  1. arXiv:2410.03602  [pdf, other

    hep-lat cs.LG

    Exploring gauge-fixing conditions with gradient-based optimization

    Authors: William Detmold, Gurtej Kanwar, Yin Lin, Phiala E. Shanahan, Michael L. Wagman

    Abstract: Lattice gauge fixing is required to compute gauge-variant quantities, for example those used in RI-MOM renormalization schemes or as objects of comparison for model calculations. Recently, gauge-variant quantities have also been found to be more amenable to signal-to-noise optimization using contour deformations. These applications motivate systematic parameterization and exploration of gauge-fixi… ▽ More

    Submitted 4 October, 2024; originally announced October 2024.

    Comments: 9 pages, 2 figures; Proceedings of the 41st International Symposium on Lattice Field Theory (Lattice 2024)

    Report number: MIT-CTP/5786

  2. arXiv:2404.11674  [pdf, other

    hep-lat cond-mat.stat-mech cs.LG

    Practical applications of machine-learned flows on gauge fields

    Authors: Ryan Abbott, Michael S. Albergo, Denis Boyda, Daniel C. Hackett, Gurtej Kanwar, Fernando Romero-López, Phiala E. Shanahan, Julian M. Urban

    Abstract: Normalizing flows are machine-learned maps between different lattice theories which can be used as components in exact sampling and inference schemes. Ongoing work yields increasingly expressive flows on gauge fields, but it remains an open question how flows can improve lattice QCD at state-of-the-art scales. We discuss and demonstrate two applications of flows in replica exchange (parallel tempe… ▽ More

    Submitted 17 April, 2024; originally announced April 2024.

    Comments: 9 pages, 5 figures, proceedings of the 40th International Symposium on Lattice Field Theory (Lattice 2023)

    Report number: FERMILAB-CONF-24-0007-T, MIT-CTP/5669

  3. arXiv:2401.10874  [pdf, other

    hep-lat cs.LG

    Applications of flow models to the generation of correlated lattice QCD ensembles

    Authors: Ryan Abbott, Aleksandar Botev, Denis Boyda, Daniel C. Hackett, Gurtej Kanwar, Sébastien Racanière, Danilo J. Rezende, Fernando Romero-López, Phiala E. Shanahan, Julian M. Urban

    Abstract: Machine-learned normalizing flows can be used in the context of lattice quantum field theory to generate statistically correlated ensembles of lattice gauge fields at different action parameters. This work demonstrates how these correlations can be exploited for variance reduction in the computation of observables. Three different proof-of-concept applications are demonstrated using a novel residu… ▽ More

    Submitted 28 May, 2024; v1 submitted 19 January, 2024; originally announced January 2024.

    Comments: 12 pages, 2 tables, 5 figures. v2: accepted for publication

    Report number: MIT-CTP/5658, FERMILAB-PUB-24-0014-T

  4. Advances in machine-learning-based sampling motivated by lattice quantum chromodynamics

    Authors: Kyle Cranmer, Gurtej Kanwar, Sébastien Racanière, Danilo J. Rezende, Phiala E. Shanahan

    Abstract: Sampling from known probability distributions is a ubiquitous task in computational science, underlying calculations in domains from linguistics to biology and physics. Generative machine-learning (ML) models have emerged as a promising tool in this space, building on the success of this approach in applications such as image, text, and audio generation. Often, however, generative tasks in scienti… ▽ More

    Submitted 3 September, 2023; originally announced September 2023.

    Comments: 11 pages, 5 figures

    Journal ref: Nature Reviews Physics 5, 526-535 (2023)

  5. arXiv:2305.02402  [pdf, other

    hep-lat cond-mat.stat-mech cs.LG

    Normalizing flows for lattice gauge theory in arbitrary space-time dimension

    Authors: Ryan Abbott, Michael S. Albergo, Aleksandar Botev, Denis Boyda, Kyle Cranmer, Daniel C. Hackett, Gurtej Kanwar, Alexander G. D. G. Matthews, Sébastien Racanière, Ali Razavi, Danilo J. Rezende, Fernando Romero-López, Phiala E. Shanahan, Julian M. Urban

    Abstract: Applications of normalizing flows to the sampling of field configurations in lattice gauge theory have so far been explored almost exclusively in two space-time dimensions. We report new algorithmic developments of gauge-equivariant flow architectures facilitating the generalization to higher-dimensional lattice geometries. Specifically, we discuss masked autoregressive transformations with tracta… ▽ More

    Submitted 3 May, 2023; originally announced May 2023.

  6. arXiv:2211.07541  [pdf, other

    hep-lat cond-mat.stat-mech cs.LG

    Aspects of scaling and scalability for flow-based sampling of lattice QCD

    Authors: Ryan Abbott, Michael S. Albergo, Aleksandar Botev, Denis Boyda, Kyle Cranmer, Daniel C. Hackett, Alexander G. D. G. Matthews, Sébastien Racanière, Ali Razavi, Danilo J. Rezende, Fernando Romero-López, Phiala E. Shanahan, Julian M. Urban

    Abstract: Recent applications of machine-learned normalizing flows to sampling in lattice field theory suggest that such methods may be able to mitigate critical slowing down and topological freezing. However, these demonstrations have been at the scale of toy models, and it remains to be determined whether they can be applied to state-of-the-art lattice quantum chromodynamics calculations. Assessing the vi… ▽ More

    Submitted 14 November, 2022; originally announced November 2022.

    Comments: 22 pages, 8 figures

    Report number: MIT-CTP/5496

  7. arXiv:2209.07559  [pdf, other

    physics.comp-ph cs.AI hep-ex hep-lat hep-th

    Snowmass 2021 Computational Frontier CompF03 Topical Group Report: Machine Learning

    Authors: Phiala Shanahan, Kazuhiro Terao, Daniel Whiteson

    Abstract: The rapidly-developing intersection of machine learning (ML) with high-energy physics (HEP) presents both opportunities and challenges to our community. Far beyond applications of standard ML tools to HEP problems, genuinely new and potentially revolutionary approaches are being developed by a generation of talent literate in both fields. There is an urgent need to support the needs of the interdi… ▽ More

    Submitted 15 September, 2022; originally announced September 2022.

    Comments: Contribution to Snowmass 2021

  8. Neural-network preconditioners for solving the Dirac equation in lattice gauge theory

    Authors: Salvatore Calì, Daniel C. Hackett, Yin Lin, Phiala E. Shanahan, Brian Xiao

    Abstract: This work develops neural-network--based preconditioners to accelerate solution of the Wilson-Dirac normal equation in lattice quantum field theories. The approach is implemented for the two-flavor lattice Schwinger model near the critical point. In this system, neural-network preconditioners are found to accelerate the convergence of the conjugate gradient solver compared with the solution of unp… ▽ More

    Submitted 4 August, 2022; originally announced August 2022.

    Comments: 11 pages, 6 figures, and 2 tables

  9. Gauge-equivariant flow models for sampling in lattice field theories with pseudofermions

    Authors: Ryan Abbott, Michael S. Albergo, Denis Boyda, Kyle Cranmer, Daniel C. Hackett, Gurtej Kanwar, Sébastien Racanière, Danilo J. Rezende, Fernando Romero-López, Phiala E. Shanahan, Betsy Tian, Julian M. Urban

    Abstract: This work presents gauge-equivariant architectures for flow-based sampling in fermionic lattice field theories using pseudofermions as stochastic estimators for the fermionic determinant. This is the default approach in state-of-the-art lattice field theory calculations, making this development critical to the practical application of flow models to theories such as QCD. Methods by which flow-base… ▽ More

    Submitted 16 October, 2022; v1 submitted 18 July, 2022; originally announced July 2022.

    Comments: 15 pages, 7 figures. v3: accepted version for publication. New appendix C

    Report number: MIT-CTP/5446, INT-PUB-22-017

    Journal ref: Phys.Rev.D 106 (2022) 7, 074506

  10. arXiv:2203.06153  [pdf, other

    cs.LG astro-ph.IM cs.AI hep-ex hep-ph

    Symmetry Group Equivariant Architectures for Physics

    Authors: Alexander Bogatskiy, Sanmay Ganguly, Thomas Kipf, Risi Kondor, David W. Miller, Daniel Murnane, Jan T. Offermann, Mariel Pettee, Phiala Shanahan, Chase Shimmin, Savannah Thais

    Abstract: Physical theories grounded in mathematical symmetries are an essential component of our understanding of a wide range of properties of the universe. Similarly, in the domain of machine learning, an awareness of symmetries such as rotation or permutation invariance has driven impressive performance breakthroughs in computer vision, natural language processing, and other important applications. In t… ▽ More

    Submitted 11 March, 2022; originally announced March 2022.

    Comments: Contribution to Snowmass 2021

  11. arXiv:2202.11712  [pdf, other

    hep-lat cond-mat.stat-mech cs.LG

    Flow-based sampling in the lattice Schwinger model at criticality

    Authors: Michael S. Albergo, Denis Boyda, Kyle Cranmer, Daniel C. Hackett, Gurtej Kanwar, Sébastien Racanière, Danilo J. Rezende, Fernando Romero-López, Phiala E. Shanahan, Julian M. Urban

    Abstract: Recent results suggest that flow-based algorithms may provide efficient sampling of field distributions for lattice field theory applications, such as studies of quantum chromodynamics and the Schwinger model. In this work, we provide a numerical demonstration of robust flow-based sampling in the Schwinger model at the critical value of the fermion mass. In contrast, at the same parameters, conven… ▽ More

    Submitted 23 February, 2022; originally announced February 2022.

    Comments: 5 pages main text, 3 pages supplementary material. 4 figures

    Report number: MIT-CTP/5409

  12. arXiv:2202.05838  [pdf, ps, other

    hep-lat cs.LG hep-ph

    Applications of Machine Learning to Lattice Quantum Field Theory

    Authors: Denis Boyda, Salvatore Calì, Sam Foreman, Lena Funcke, Daniel C. Hackett, Yin Lin, Gert Aarts, Andrei Alexandru, Xiao-Yong Jin, Biagio Lucini, Phiala E. Shanahan

    Abstract: There is great potential to apply machine learning in the area of numerical lattice quantum field theory, but full exploitation of that potential will require new strategies. In this white paper for the Snowmass community planning process, we discuss the unique requirements of machine learning for lattice quantum field theory research and outline what is needed to enable exploration and deployment… ▽ More

    Submitted 10 February, 2022; originally announced February 2022.

    Comments: 10 pages, contribution to Snowmass 2022

    Report number: MIT-CTP/5405

  13. arXiv:2107.00734  [pdf, other

    hep-lat cond-mat.stat-mech cs.LG

    Flow-based sampling for multimodal and extended-mode distributions in lattice field theory

    Authors: Daniel C. Hackett, Chung-Chun Hsieh, Sahil Pontula, Michael S. Albergo, Denis Boyda, Jiunn-Wei Chen, Kai-Feng Chen, Kyle Cranmer, Gurtej Kanwar, Phiala E. Shanahan

    Abstract: Recent results have demonstrated that samplers constructed with flow-based generative models are a promising new approach for configuration generation in lattice field theory. In this paper, we present a set of training- and architecture-based methods to construct flow models for targets with multiple separated modes (i.e.~vacua) as well as targets with extended/continuous modes. We demonstrate th… ▽ More

    Submitted 14 February, 2025; v1 submitted 1 July, 2021; originally announced July 2021.

    Comments: 38+3 pages, 39 figures. v2: major revisions including new application to extended modes

    Report number: MIT-CTP/5312,FERMILAB-PUB-25-0090-T

  14. arXiv:2106.05934  [pdf, other

    hep-lat cond-mat.stat-mech cs.LG

    Flow-based sampling for fermionic lattice field theories

    Authors: Michael S. Albergo, Gurtej Kanwar, Sébastien Racanière, Danilo J. Rezende, Julian M. Urban, Denis Boyda, Kyle Cranmer, Daniel C. Hackett, Phiala E. Shanahan

    Abstract: Algorithms based on normalizing flows are emerging as promising machine learning approaches to sampling complicated probability distributions in a way that can be made asymptotically exact. In the context of lattice field theory, proof-of-principle studies have demonstrated the effectiveness of this approach for scalar theories, gauge theories, and statistical systems. This work develops approache… ▽ More

    Submitted 28 December, 2021; v1 submitted 10 June, 2021; originally announced June 2021.

    Comments: 26 pages, 5 figures

    Report number: MIT-CTP/5307

    Journal ref: Phys. Rev. D 104, 114507 (2021)

  15. arXiv:2101.08176  [pdf, other

    hep-lat cond-mat.stat-mech cs.LG

    Introduction to Normalizing Flows for Lattice Field Theory

    Authors: Michael S. Albergo, Denis Boyda, Daniel C. Hackett, Gurtej Kanwar, Kyle Cranmer, Sébastien Racanière, Danilo Jimenez Rezende, Phiala E. Shanahan

    Abstract: This notebook tutorial demonstrates a method for sampling Boltzmann distributions of lattice field theories using a class of machine learning models known as normalizing flows. The ideas and approaches proposed in arXiv:1904.12072, arXiv:2002.02428, and arXiv:2003.06413 are reviewed and a concrete implementation of the framework is presented. We apply this framework to a lattice scalar field theor… ▽ More

    Submitted 6 August, 2021; v1 submitted 20 January, 2021; originally announced January 2021.

    Comments: 38 pages, 5 numbered figures, Jupyter notebook included as ancillary file

    Report number: MIT-CTP/5272

  16. arXiv:2008.05456  [pdf, other

    hep-lat cs.LG stat.ML

    Sampling using $SU(N)$ gauge equivariant flows

    Authors: Denis Boyda, Gurtej Kanwar, Sébastien Racanière, Danilo Jimenez Rezende, Michael S. Albergo, Kyle Cranmer, Daniel C. Hackett, Phiala E. Shanahan

    Abstract: We develop a flow-based sampling algorithm for $SU(N)$ lattice gauge theories that is gauge-invariant by construction. Our key contribution is constructing a class of flows on an $SU(N)$ variable (or on a $U(N)$ variable by a simple alternative) that respect matrix conjugation symmetry. We apply this technique to sample distributions of single $SU(N)$ variables and to construct flow-based samplers… ▽ More

    Submitted 18 September, 2020; v1 submitted 12 August, 2020; originally announced August 2020.

    Comments: 24 pages, 19 figures

    Report number: MIT-CTP/5228

    Journal ref: Phys. Rev. D 103, 074504 (2021)

  17. arXiv:2003.06413  [pdf, other

    hep-lat cond-mat.stat-mech cs.LG

    Equivariant flow-based sampling for lattice gauge theory

    Authors: Gurtej Kanwar, Michael S. Albergo, Denis Boyda, Kyle Cranmer, Daniel C. Hackett, Sébastien Racanière, Danilo Jimenez Rezende, Phiala E. Shanahan

    Abstract: We define a class of machine-learned flow-based sampling algorithms for lattice gauge theories that are gauge-invariant by construction. We demonstrate the application of this framework to U(1) gauge theory in two spacetime dimensions, and find that near critical points in parameter space the approach is orders of magnitude more efficient at sampling topological quantities than more traditional sa… ▽ More

    Submitted 13 March, 2020; originally announced March 2020.

    Comments: 6 pages, 4 figures

    Report number: MIT-CTP/5181

    Journal ref: Phys. Rev. Lett. 125, 121601 (2020)

  18. arXiv:2002.02428  [pdf, other

    stat.ML cs.LG

    Normalizing Flows on Tori and Spheres

    Authors: Danilo Jimenez Rezende, George Papamakarios, Sébastien Racanière, Michael S. Albergo, Gurtej Kanwar, Phiala E. Shanahan, Kyle Cranmer

    Abstract: Normalizing flows are a powerful tool for building expressive distributions in high dimensions. So far, most of the literature has concentrated on learning flows on Euclidean spaces. Some problems however, such as those involving angles, are defined on spaces with more complex geometries, such as tori or spheres. In this paper, we propose and compare expressive and numerically stable flows on such… ▽ More

    Submitted 1 July, 2020; v1 submitted 6 February, 2020; originally announced February 2020.

    Comments: Accepted to the International Conference on Machine Learning (ICML) 2020

  19. arXiv:1904.12072  [pdf, other

    hep-lat cond-mat.dis-nn cond-mat.stat-mech cs.LG

    Flow-based generative models for Markov chain Monte Carlo in lattice field theory

    Authors: M. S. Albergo, G. Kanwar, P. E. Shanahan

    Abstract: A Markov chain update scheme using a machine-learned flow-based generative model is proposed for Monte Carlo sampling in lattice field theories. The generative model may be optimized (trained) to produce samples from a distribution approximating the desired Boltzmann distribution determined by the lattice action of the theory being studied. Training the model systematically improves autocorrelatio… ▽ More

    Submitted 9 September, 2019; v1 submitted 26 April, 2019; originally announced April 2019.

    Comments: 13 pages, 7 figures; corrected normalization conventions in eqns. 20 and 23

    Report number: MIT-CTP/5114

    Journal ref: Phys. Rev. D 100, 034515 (2019)

  20. arXiv:1902.11162  [pdf

    cs.DL

    The FAIR Funder pilot programme to make it easy for funders to require and for grantees to produce FAIR Data

    Authors: P. Wittenburg, H. Pergl Sustkova, A. Montesanti, S. M. Bloemers, S. H. de Waard, M. A. Musen, J. B. Graybeal, K. M. Hettne, A. Jacobsen, R. Pergl, R. W. W. Hooft, C. Staiger, C. W. G. van Gelder, S. L. Knijnenburg, A. C. van Arkel, B. Meerman, M. D. Wilkinson, S-A Sansone, P. Rocca-Serra, P. McQuilton, A. N. Gonzalez-Beltran, G. J. C. Aben, P. Henning, S. Alencar, C. Ribeiro , et al. (35 additional authors not shown)

    Abstract: There is a growing acknowledgement in the scientific community of the importance of making experimental data machine findable, accessible, interoperable, and reusable (FAIR). Recognizing that high quality metadata are essential to make datasets FAIR, members of the GO FAIR Initiative and the Research Data Alliance (RDA) have initiated a series of workshops to encourage the creation of Metadata for… ▽ More

    Submitted 6 March, 2019; v1 submitted 26 February, 2019; originally announced February 2019.

    Comments: This is a pre-print of the FAIR Funders pilot, an outcome of the first Metadata for Machines workshop, see: https://www.go-fair.org/resources/go-fair-workshop-series/metadata-for-machines-workshops/. Corresponding author: E. A Schultes, ORCID 0000-0001-8888-635X