-
PhotoD with LSST: Stellar Photometric Distances Out to the Edge of the Galaxy
Authors:
Lovro Palaversa,
Željko Ivezić,
Neven Caplar,
Karlo Mrakovčić,
Bob Abel,
Oleksandra Razim,
Filip Matković,
Connor Yablonski,
Toni Šarić,
Tomislav Jurkić,
Sandro Campos,
Melissa DeLucchi,
Derek Jones,
Konstantin Malanchev,
Alex I. Malz,
Sean McGuire,
Mario Jurić
Abstract:
As demonstrated with the Sloan Digital Sky Survey (SDSS), Pan-STARRS, and most recently with Gaia data, broadband near-UV to near-IR stellar photometry can be used to estimate distance, metallicity, and interstellar dust extinction along the line of sight for stars in the Galaxy. Anticipating photometric catalogs with tens of billions of stars from Rubin's Legacy Survey of Space and Time (LSST), w…
▽ More
As demonstrated with the Sloan Digital Sky Survey (SDSS), Pan-STARRS, and most recently with Gaia data, broadband near-UV to near-IR stellar photometry can be used to estimate distance, metallicity, and interstellar dust extinction along the line of sight for stars in the Galaxy. Anticipating photometric catalogs with tens of billions of stars from Rubin's Legacy Survey of Space and Time (LSST), we present a Bayesian model and pipeline that build on previous work and can handle LSST-sized datasets. Likelihood computations utilize MIST/Dartmouth isochrones and priors are derived from TRILEGAL-based simulated LSST catalogs from P. Dal Tio et al. The computation speed is about 10 ms per star on a single core for both optimized grid search and Markov Chain Monte Carlo methods; we show in a companion paper by K. Mrakovčić et al. how to utilize neural networks to accelerate this performance by up to an order of magnitude. We validate our pipeline, named PhotoD (in analogy with photo-z, photometric redshifts of galaxies) using both simulated catalogs and SDSS, DECam, and Gaia photometry. We intend to make LSST-based value-added PhotoD catalogs publicly available via the Rubin Science Platform with every LSST data release.
△ Less
Submitted 5 February, 2025;
originally announced February 2025.
-
Using LSDB to enable large-scale catalog distribution, cross-matching, and analytics
Authors:
Neven Caplar,
Wilson Beebe,
Doug Branton,
Sandro Campos,
Andrew Connolly,
Melissa DeLucchi,
Derek Jones,
Mario Juric,
Jeremy Kubica,
Konstantin Malanchev,
Rachel Mandelbaum,
Sean McGuire
Abstract:
The Vera C. Rubin Observatory will generate an unprecedented volume of data, including approximately 60 petabytes of raw data and around 30 trillion observed sources, posing a significant challenge for large-scale and end-user scientific analysis. As part of the LINCC Frameworks Project we are addressing these challenges with the development of the HATS (Hierarchical Adaptive Tiling Scheme) format…
▽ More
The Vera C. Rubin Observatory will generate an unprecedented volume of data, including approximately 60 petabytes of raw data and around 30 trillion observed sources, posing a significant challenge for large-scale and end-user scientific analysis. As part of the LINCC Frameworks Project we are addressing these challenges with the development of the HATS (Hierarchical Adaptive Tiling Scheme) format and analysis package LSDB (Large Scale Database). HATS partitions data adaptively using a hierarchical tiling system to balance the file sizes, enabling efficient parallel analysis. Recent updates include improved metadata consistency, support for incremental updates, and enhanced compatibility with evolving datasets. LSDB complements HATS by providing a scalable, user-friendly interface for large catalog analysis, integrating spatial queries, crossmatching, and time-series tools while utilizing Dask for parallelization. We have successfully demonstrated the use of these tools with datasets such as ZTF and Pan-STARRS data releases on both cluster and cloud environments. We are deeply involved in several ongoing collaborations to ensure alignment with community needs, with future plans for IVOA standardization and support for upcoming Rubin, Euclid and Roman data. We provide our code and materials at lsdb.io.
△ Less
Submitted 3 January, 2025;
originally announced January 2025.
-
DeepDISC-photoz: Deep Learning-Based Photometric Redshift Estimation for Rubin LSST
Authors:
Grant Merz,
Xin Liu,
Samuel Schmidt,
Alex I. Malz,
Tianqing Zhang,
Doug Branton,
Colin J. Burke,
Melissa Delucchi,
Yaswant Sai Ejjagiri,
Jeremy Kubica,
Yichen Liu,
Olivia Lynn,
Drew Oldag,
The LSST Dark Energy Science Collaboration
Abstract:
Photometric redshifts will be a key data product for the Rubin Observatory Legacy Survey of Space and Time (LSST) as well as for future ground and space-based surveys. The need for photometric redshifts, or photo-zs, arises from sparse spectroscopic coverage of observed galaxies. LSST is expected to observe billions of objects, making it crucial to have a photo-z estimator that is accurate and eff…
▽ More
Photometric redshifts will be a key data product for the Rubin Observatory Legacy Survey of Space and Time (LSST) as well as for future ground and space-based surveys. The need for photometric redshifts, or photo-zs, arises from sparse spectroscopic coverage of observed galaxies. LSST is expected to observe billions of objects, making it crucial to have a photo-z estimator that is accurate and efficient. To that end, we present DeepDISC photo-z, a photo-z estimator that is an extension of the DeepDISC framework. The base DeepDISC network simultaneously detects, segments, and classifies objects in multi-band coadded images. We introduce photo-z capabilities to DeepDISC by adding a redshift estimation Region of Interest head, which produces a photo-z probability distribution function for each detected object. On simulated LSST images, DeepDISC photo-z outperforms traditional catalog-based estimators, in both point estimate and probabilistic metrics. We validate DeepDISC by examining dependencies on systematics including galactic extinction, blending and PSF effects. We also examine the impact of the data quality and the size of the training set and model. We find that the biggest factor in DeepDISC photo-z quality is the signal-to-noise of the imaging data, and see a reduction in photo-z scatter approximately proportional to the image data signal-to-noise. Our code is fully public and integrated in the RAIL photo-z package for ease of use and comparison to other codes at https://github.com/LSSTDESC/rail_deepdisc
△ Less
Submitted 14 April, 2025; v1 submitted 27 November, 2024;
originally announced November 2024.
-
Superphot+: Realtime Fitting and Classification of Supernova Light Curves
Authors:
Kaylee M. de Soto,
Ashley Villar,
Edo Berger,
Sebastian Gomez,
Griffin Hosseinzadeh,
Doug Branton,
Sandro Campos,
Melissa DeLucchi,
Jeremy Kubica,
Olivia Lynn,
Konstantin Malanchev,
Alex I. Malz
Abstract:
Photometric classifications of supernova (SN) light curves have become necessary to utilize the full potential of large samples of observations obtained from wide-field photometric surveys, such as the Zwicky Transient Facility (ZTF) and the Vera C. Rubin Observatory. Here, we present a photometric classifier for SN light curves that does not rely on redshift information and still maintains compar…
▽ More
Photometric classifications of supernova (SN) light curves have become necessary to utilize the full potential of large samples of observations obtained from wide-field photometric surveys, such as the Zwicky Transient Facility (ZTF) and the Vera C. Rubin Observatory. Here, we present a photometric classifier for SN light curves that does not rely on redshift information and still maintains comparable accuracy to redshift-dependent classifiers. Our new package, Superphot+, uses a parametric model to extract meaningful features from multiband SN light curves. We train a gradient-boosted machine with fit parameters from 6,061 ZTF SNe that pass data quality cuts and are spectroscopically classified as one of five classes: SN Ia, SN II, SN Ib/c, SN IIn, and SLSN-I. Without redshift information, our classifier yields a class-averaged F1-score of 0.61 +/- 0.02 and a total accuracy of 0.83 +/- 0.01. Including redshift information improves these metrics to 0.71 +/- 0.02 and 0.88 +/- 0.01, respectively. We assign new class probabilities to 3,558 ZTF transients that show SN-like characteristics (based on the ALeRCE Broker light curve and stamp classifiers), but lack spectroscopic classifications. Finally, we compare our predicted SN labels with those generated by the ALeRCE light curve classifier, finding that the two classifiers agree on photometric labels for 82 +/- 2% of light curves with spectroscopic labels and 72% of light curves without spectroscopic labels. Superphot+ is currently classifying ZTF SNe in real time via the ANTARES Broker, and is designed for simple adaptation to six-band Rubin light curves in the future.
△ Less
Submitted 12 March, 2024;
originally announced March 2024.
