-
Enabling real-time multi-messenger astrophysics discoveries with deep learning
Authors:
E. A. Huerta,
Gabrielle Allen,
Igor Andreoni,
Javier M. Antelis,
Etienne Bachelet,
Bruce Berriman,
Federica Bianco,
Rahul Biswas,
Matias Carrasco,
Kyle Chard,
Minsik Cho,
Philip S. Cowperthwaite,
Zachariah B. Etienne,
Maya Fishbach,
Francisco Förster,
Daniel George,
Tom Gibbs,
Matthew Graham,
William Gropp,
Robert Gruendl,
Anushri Gupta,
Roland Haas,
Sarah Habib,
Elise Jennings,
Margaret W. G. Johnson
, et al. (35 additional authors not shown)
Abstract:
Multi-messenger astrophysics is a fast-growing, interdisciplinary field that combines data, which vary in volume and speed of data processing, from many different instruments that probe the Universe using different cosmic messengers: electromagnetic waves, cosmic rays, gravitational waves and neutrinos. In this Expert Recommendation, we review the key challenges of real-time observations of gravit…
▽ More
Multi-messenger astrophysics is a fast-growing, interdisciplinary field that combines data, which vary in volume and speed of data processing, from many different instruments that probe the Universe using different cosmic messengers: electromagnetic waves, cosmic rays, gravitational waves and neutrinos. In this Expert Recommendation, we review the key challenges of real-time observations of gravitational wave sources and their electromagnetic and astroparticle counterparts, and make a number of recommendations to maximize their potential for scientific discovery. These recommendations refer to the design of scalable and computationally efficient machine learning algorithms; the cyber-infrastructure to numerically simulate astrophysical sources, and to process and interpret multi-messenger astrophysics data; the management of gravitational wave detections to trigger real-time alerts for electromagnetic and astroparticle follow-ups; a vision to harness future developments of machine learning and cyber-infrastructure resources to cope with the big-data requirements; and the need to build a community of experts to realize the goals of multi-messenger astrophysics.
△ Less
Submitted 26 November, 2019;
originally announced November 2019.
-
Deep Learning for Multi-Messenger Astrophysics: A Gateway for Discovery in the Big Data Era
Authors:
Gabrielle Allen,
Igor Andreoni,
Etienne Bachelet,
G. Bruce Berriman,
Federica B. Bianco,
Rahul Biswas,
Matias Carrasco Kind,
Kyle Chard,
Minsik Cho,
Philip S. Cowperthwaite,
Zachariah B. Etienne,
Daniel George,
Tom Gibbs,
Matthew Graham,
William Gropp,
Anushri Gupta,
Roland Haas,
E. A. Huerta,
Elise Jennings,
Daniel S. Katz,
Asad Khan,
Volodymyr Kindratenko,
William T. C. Kramer,
Xin Liu,
Ashish Mahabal
, et al. (23 additional authors not shown)
Abstract:
This report provides an overview of recent work that harnesses the Big Data Revolution and Large Scale Computing to address grand computational challenges in Multi-Messenger Astrophysics, with a particular emphasis on real-time discovery campaigns. Acknowledging the transdisciplinary nature of Multi-Messenger Astrophysics, this document has been prepared by members of the physics, astronomy, compu…
▽ More
This report provides an overview of recent work that harnesses the Big Data Revolution and Large Scale Computing to address grand computational challenges in Multi-Messenger Astrophysics, with a particular emphasis on real-time discovery campaigns. Acknowledging the transdisciplinary nature of Multi-Messenger Astrophysics, this document has been prepared by members of the physics, astronomy, computer science, data science, software and cyberinfrastructure communities who attended the NSF-, DOE- and NVIDIA-funded "Deep Learning for Multi-Messenger Astrophysics: Real-time Discovery at Scale" workshop, hosted at the National Center for Supercomputing Applications, October 17-19, 2018. Highlights of this report include unanimous agreement that it is critical to accelerate the development and deployment of novel, signal-processing algorithms that use the synergy between artificial intelligence (AI) and high performance computing to maximize the potential for scientific discovery with Multi-Messenger Astrophysics. We discuss key aspects to realize this endeavor, namely (i) the design and exploitation of scalable and computationally efficient AI algorithms for Multi-Messenger Astrophysics; (ii) cyberinfrastructure requirements to numerically simulate astrophysical sources, and to process and interpret Multi-Messenger Astrophysics data; (iii) management of gravitational wave detections and triggers to enable electromagnetic and astro-particle follow-ups; (iv) a vision to harness future developments of machine and deep learning and cyberinfrastructure resources to cope with the scale of discovery in the Big Data Era; (v) and the need to build a community that brings domain experts together with data scientists on equal footing to maximize and accelerate discovery in the nascent field of Multi-Messenger Astrophysics.
△ Less
Submitted 1 February, 2019;
originally announced February 2019.
-
Deep Learning at Scale for the Construction of Galaxy Catalogs in the Dark Energy Survey
Authors:
Asad Khan,
E. A. Huerta,
Sibo Wang,
Robert Gruendl,
Elise Jennings,
Huihuo Zheng
Abstract:
The scale of ongoing and future electromagnetic surveys pose formidable challenges to classify astronomical objects. Pioneering efforts on this front include citizen science campaigns adopted by the Sloan Digital Sky Survey (SDSS). SDSS datasets have been recently used to train neural network models to classify galaxies in the Dark Energy Survey (DES) that overlap the footprint of both surveys. He…
▽ More
The scale of ongoing and future electromagnetic surveys pose formidable challenges to classify astronomical objects. Pioneering efforts on this front include citizen science campaigns adopted by the Sloan Digital Sky Survey (SDSS). SDSS datasets have been recently used to train neural network models to classify galaxies in the Dark Energy Survey (DES) that overlap the footprint of both surveys. Herein, we demonstrate that knowledge from deep learning algorithms, pre-trained with real-object images, can be transferred to classify galaxies that overlap both SDSS and DES surveys, achieving state-of-the-art accuracy $\gtrsim99.6\%$. We demonstrate that this process can be completed within just eight minutes using distributed training. While this represents a significant step towards the classification of DES galaxies that overlap previous surveys, we need to initiate the characterization of unlabelled DES galaxies in new regions of parameter space. To accelerate this program, we use our neural network classifier to label over ten thousand unlabelled DES galaxies, which do not overlap previous surveys. Furthermore, we use our neural network model as a feature extractor for unsupervised clustering and find that unlabeled DES images can be grouped together in two distinct galaxy classes based on their morphology, which provides a heuristic check that the learning is successfully transferred to the classification of unlabelled DES images. We conclude by showing that these newly labeled datasets can be combined with unsupervised recursive training to create large-scale DES galaxy catalogs in preparation for the Large Synoptic Survey Telescope era.
△ Less
Submitted 8 July, 2019; v1 submitted 5 December, 2018;
originally announced December 2018.
-
Biased Tracers in Redshift Space in the EFT of Large-Scale Structure
Authors:
Ashley Perko,
Leonardo Senatore,
Elise Jennings,
Risa H. Wechsler
Abstract:
The Effective Field Theory of Large-Scale Structure (EFTofLSS) provides a novel formalism that is able to accurately predict the clustering of large-scale structure (LSS) in the mildly non-linear regime. Here we provide the first computation of the power spectrum of biased tracers in redshift space at one loop order, and we make the associated code publicly available. We compare the multipoles…
▽ More
The Effective Field Theory of Large-Scale Structure (EFTofLSS) provides a novel formalism that is able to accurately predict the clustering of large-scale structure (LSS) in the mildly non-linear regime. Here we provide the first computation of the power spectrum of biased tracers in redshift space at one loop order, and we make the associated code publicly available. We compare the multipoles $\ell=0,2$ of the redshift-space halo power spectrum, together with the real-space matter and halo power spectra, with data from numerical simulations at $z=0.67$. For the samples we compare to, which have a number density of $\bar n=3.8 \cdot 10^{-2}(h \ {\rm Mpc}^{-1})^3$ and $\bar n=3.9 \cdot 10^{-4}(h \ {\rm Mpc}^{-1})^3$, we find that the calculation at one-loop order matches numerical measurements to within a few percent up to $k\simeq 0.43 \ h \ {\rm Mpc}^{-1}$, a significant improvement with respect to former techniques. By performing the so-called IR-resummation, we find that the Baryon Acoustic Oscillation peak is accurately reproduced. Based on the results presented here, long-wavelength statistics that are routinely observed in LSS surveys can be finally computed in the EFTofLSS. This formalism thus is ready to start to be compared directly to observational data.
△ Less
Submitted 28 October, 2016;
originally announced October 2016.
-
Simulations of Galileon modified gravity: Clustering statistics in real and redshift space
Authors:
Mark Wyman,
Elise Jennings,
Marcos Lima
Abstract:
We use N-body simulations to study the statistics of massive halos and redshift space distortions for theories with a standard ΛCDM expansion history and a galileon-type scalar field. The extra scalar field increases the gravitational force, leading to enhanced structure formation. We compare our measurements of the real space matter power spectrum and halo properties with fitting formula for esti…
▽ More
We use N-body simulations to study the statistics of massive halos and redshift space distortions for theories with a standard ΛCDM expansion history and a galileon-type scalar field. The extra scalar field increases the gravitational force, leading to enhanced structure formation. We compare our measurements of the real space matter power spectrum and halo properties with fitting formula for estimating these quantities analytically. We find that a model for power spectrum, halo mass-function and halo bias, derived from ΛCDM simulations can fit the results from our simulations of modified gravity when σ_8 is appropriately adjusted. We also study the redshift space distortions in the two point correlation function measured from these simulations, finding a difference in the ratio of the redshift space to real space clustering amplitude relative to standard gravity on all scales. We find enhanced clustering on scales r>10 Mpc/h and increased damping of the correlation function for scales r<9 Mpc/h. The boost in the clustering on large scales due to the enhanced gravitational forces cannot be mimicked in a standard gravity model by simply changing σ_8. This result illustrates the usefulness of redshift space distortion measurements as a probe of modifications to General Relativity.
△ Less
Submitted 26 March, 2013;
originally announced March 2013.
-
Testing gravity using the growth of large scale structure in the Universe
Authors:
Elise Jennings,
Carlton M. Baugh,
Silvia Pascoli
Abstract:
Future galaxy surveys hope to distinguish between the dark energy and modified gravity scenarios for the accelerating expansion of the Universe using the distortion of clustering in redshift space. The aim is to model the form and size of the distortion to infer the rate at which large scale structure grows. We test this hypothesis and assess the performance of current theoretical models for the r…
▽ More
Future galaxy surveys hope to distinguish between the dark energy and modified gravity scenarios for the accelerating expansion of the Universe using the distortion of clustering in redshift space. The aim is to model the form and size of the distortion to infer the rate at which large scale structure grows. We test this hypothesis and assess the performance of current theoretical models for the redshift space distortion using large volume N-body simulations of the gravitational instability process. We simulate competing cosmological models which have identical expansion histories - one is a quintessence dark energy model with a scalar field and the other is a modified gravity model with a time varying gravitational constant - and demonstrate that they do indeed produce different redshift space distortions. This is the first time this approach has been verified using a technique that can follow the growth of structure at the required level of accuracy. Our comparisons show that theoretical models for the redshift space distortion based on linear perturbation theory give a surprisingly poor description of the simulation results. Furthermore, the application of such models can give rise to catastrophic systematic errors leading to incorrect interpretation of the observations. We show that an improved model is able to extract the correct growth rate. Further enhancements to theoretical models of redshift space distortions, calibrated against simulations, are needed to fully exploit the forthcoming high precision clustering measurements.
△ Less
Submitted 4 January, 2011; v1 submitted 12 November, 2010;
originally announced November 2010.
