-
Using AI for Wavefront Estimation with the Rubin Observatory Active Optics System
Authors:
John Franklin Crenshaw,
Andrew J. Connolly,
Joshua E. Meyers,
J. Bryce Kalmbach,
Guillem Megias Homar,
Tiago Ribeiro,
Krzysztof Suberlak,
Sandrine Thomas,
Te-wei Tsai
Abstract:
The Vera C. Rubin Observatory will, over a period of 10 years, repeatedly survey the southern sky. To ensure that images generated by Rubin meet the quality requirements for precision science, the observatory will use an Active Optics System (AOS) to correct for alignment and mirror surface perturbations introduced by gravity and temperature gradients in the optical system. To accomplish this Rubi…
▽ More
The Vera C. Rubin Observatory will, over a period of 10 years, repeatedly survey the southern sky. To ensure that images generated by Rubin meet the quality requirements for precision science, the observatory will use an Active Optics System (AOS) to correct for alignment and mirror surface perturbations introduced by gravity and temperature gradients in the optical system. To accomplish this Rubin will use out-of-focus images from sensors located at the edge of the focal plane to learn and correct for perturbations to the wavefront. We have designed and integrated a deep learning model for wavefront estimation into the AOS pipeline. In this paper, we compare the performance of this deep learning approach to Rubin's baseline algorithm when applied to images from two different simulations of the Rubin optical system. We show the deep learning approach is faster and more accurate, achieving the atmospheric error floor both for high-quality images, and low-quality images with heavy blending and vignetting. Compared to the baseline algorithm, the deep learning model is 40x faster, the median error 2x better under ideal conditions, 5x better in the presence of vignetting by the Rubin camera, and 14x better in the presence of blending in crowded fields. In addition, the deep learning model surpasses the required optical quality in simulations of the AOS closed loop. This system promises to increase the survey area useful for precision science by up to 8%. We discuss how this system might be deployed when commissioning and operating Rubin.
△ Less
Submitted 12 February, 2024;
originally announced February 2024.
-
Improving Damped Random Walk parameters for SDSS Stripe 82 Quasars with Pan-STARRS1
Authors:
Krzysztof Suberlak,
Željko Ivezić,
Chelsea MacLeod
Abstract:
We use the Panoramic Survey Telescope and Rapid Response System 1 Survey (Pan-STARRS1, PS1) data to extend the Sloan Digital Sky Survey (SDSS) Stripe 82 quasar light curves. Combining PS1 and SDSS light curves provides a 15 yr baseline for 9248 quasars - 5 yr longer than prior studies that used only SDSS. We fit the light curves with the damped random walk (DRW) model model - a statistical descrip…
▽ More
We use the Panoramic Survey Telescope and Rapid Response System 1 Survey (Pan-STARRS1, PS1) data to extend the Sloan Digital Sky Survey (SDSS) Stripe 82 quasar light curves. Combining PS1 and SDSS light curves provides a 15 yr baseline for 9248 quasars - 5 yr longer than prior studies that used only SDSS. We fit the light curves with the damped random walk (DRW) model model - a statistical description of their variability. We correlate the resulting DRW model parameters: asymptotic variability amplitude SF$_{\infty}$, and characteristic timescale $τ$, with quasar physical properties - black hole mass, bolometric luminosity, and redshift. Using simulated light curves, we find that a longer baseline allows us to better constrain the DRW parameters. After adding PS1 data, the variability amplitude is a stronger function of the black hole mass, and has a weaker dependence on quasar luminosity. In addition, the characteristic timescale $τ$ dependence on quasar luminosity is marginally weaker. We also make predictions for the fidelity of DRW model parameter retrieval when light curves will be further extended with Zwicky Transient Facility (ZTF) and the Rubin Observatory Legacy Survey of Space and Time (LSST) data. Finally, we show how updated DRW parameters offer an independent method of discovering changing-look quasar candidates (CLQSOs). The candidates are outliers in terms of differences in magnitude and scatter between SDSS and PS1 segments. We identify 40 objects (35 newly reported) with tenfold increase in variability timescale between SDSS and SDSS--PS1 data, which is due to a large change in brightness (over 0.5 mag) - characteristic for CLQSOs.
△ Less
Submitted 23 December, 2020;
originally announced December 2020.
-
AXS: A framework for fast astronomical data processing based on Apache Spark
Authors:
Petar Zečević,
Colin T. Slater,
Mario Jurić,
Andrew J. Connolly,
Sven Lončarić,
Eric C. Bellm,
V. Zach Golkhou,
Krzysztof Suberlak
Abstract:
We introduce AXS (Astronomy eXtensions for Spark), a scalable open-source astronomical data analysis framework built on Apache Spark, a widely used industry-standard engine for big data processing. Building on capabilities present in Spark, AXS aims to enable querying and analyzing almost arbitrarily large astronomical catalogs using familiar Python/AstroPy concepts, DataFrame APIs, and SQL statem…
▽ More
We introduce AXS (Astronomy eXtensions for Spark), a scalable open-source astronomical data analysis framework built on Apache Spark, a widely used industry-standard engine for big data processing. Building on capabilities present in Spark, AXS aims to enable querying and analyzing almost arbitrarily large astronomical catalogs using familiar Python/AstroPy concepts, DataFrame APIs, and SQL statements. We achieve this by i) adding support to Spark for efficient on-line positional cross-matching and ii) supplying a Python library supporting commonly-used operations for astronomical data analysis. To support scalable cross-matching, we developed a variant of the ZONES algorithm (Gray et al. 2004) capable of operating in distributed, shared-nothing architecture. We couple this to a data partitioning scheme that enables fast catalog cross-matching and handles the data skew often present in deep all-sky data sets. The cross-match and other often-used functionalities are exposed to the end users through an easy-to-use Python API. We demonstrate AXS' technical and scientific performance on SDSS, ZTF, Gaia DR2, and AllWise catalogs. Using AXS we were able to perform on-the-fly cross-match of Gaia DR2 (1.8 billion rows) and AllWise (900 million rows) data sets in ~ 30 seconds. We discuss how cloud-ready distributed systems like AXS provide a natural way to enable comprehensive end-user analyses of large datasets such as LSST.
△ Less
Submitted 24 May, 2019; v1 submitted 22 May, 2019;
originally announced May 2019.
-
Solving the puzzle of discrepant quasar variability on monthly time-scales implied by SDSS and CRTS data sets
Authors:
Krzysztof Suberlak,
Željko Ivezić,
Chelsea L. MacLeod,
Matthew Graham,
Branimir Sesar
Abstract:
We present an improved photometric error analysis for the 7,100 CRTS (Catalina Real-Time Transient Survey) optical light curves for quasars from the SDSS (Sloan Digital Sky Survey) Stripe 82 catalogue. The SDSS imaging survey has provided a time-resolved photometric data set which greatly improved our understanding of the quasar optical continuum variability: Data for monthly and longer time-scale…
▽ More
We present an improved photometric error analysis for the 7,100 CRTS (Catalina Real-Time Transient Survey) optical light curves for quasars from the SDSS (Sloan Digital Sky Survey) Stripe 82 catalogue. The SDSS imaging survey has provided a time-resolved photometric data set which greatly improved our understanding of the quasar optical continuum variability: Data for monthly and longer time-scales are consistent with a damped random walk (DRW). Recently, newer data obtained by CRTS provided puzzling evidence for enhanced variability, compared to SDSS results, on monthly time-scales. Quantitatively, SDSS results predict about 0.06 mag root-mean-square (rms) variability for monthly time-scales, while CRTS data show about a factor of 2 larger rms, for spectroscopically confirmed SDSS quasars. Our analysis has successfully resolved this discrepancy as due to slightly underestimated photometric uncertainties from the CRTS image processing pipelines. As a result, the correction for observational noise is too small and the implied quasar variability is too large. The CRTS photometric error correction factors, derived from detailed analysis of non-variable SDSS standard stars that were re-observed by CRTS, are about 20-30%, and result in reconciling quasar variability behaviour implied by the CRTS data with earlier SDSS results. An additional analysis based on independent light curve data for the same objects obtained by the Palomar Transient Factory provides further support for this conclusion. In summary, the quasar variability constraints on weekly and monthly time-scales from SDSS, CRTS and PTF surveys are mutually compatible, as well as consistent with DRW model.
△ Less
Submitted 5 December, 2017;
originally announced December 2017.
