-
What ZTF Saw Where Rubin Looked: Anomaly Hunting in DR23
Authors:
Maria V. Pruzhinskaya,
Anastasia D. Lavrukhina,
Timofey A. Semenikhi,
Alina A. Volnova,
Sreevarsha Sreejith,
Vadim V. Krushinsky,
Emmanuel Gangler,
Emille E. O. Ishida,
Matwey V. Kornilov,
Konstantin L. Malanchev
Abstract:
We present results from the SNAD VIII Workshop, during which we conducted the first systematic anomaly search in the ZTF fields also observed by LSSTComCam during Rubin Scientific Pipeline commissioning. Using the PineForest active anomaly detection algorithm, we analysed four selected fields (two galactic and two extragalactic) and visually inspected 400 candidates. As a result, we discovered six…
▽ More
We present results from the SNAD VIII Workshop, during which we conducted the first systematic anomaly search in the ZTF fields also observed by LSSTComCam during Rubin Scientific Pipeline commissioning. Using the PineForest active anomaly detection algorithm, we analysed four selected fields (two galactic and two extragalactic) and visually inspected 400 candidates. As a result, we discovered six previously uncatalogued variable stars, including RS~CVn, BY Draconis, ellipsoidal, and solar-type variables, and refined classifications and periods for six known objects. These results demonstrate the effectiveness of the SNAD anomaly detection pipeline and provide a preview of the discovery potential in the upcoming LSST data.
△ Less
Submitted 8 July, 2025;
originally announced July 2025.
-
An outer-disk SX Phe variable star in Rubin Data Preview 1
Authors:
Jeffrey L. Carlin,
Peter S. Ferguson,
A. Katherina Vivas,
Neven Caplar,
Konstantin Malanchev
Abstract:
We report the discovery of an SX Phoenicis-type pulsating variable star via 217 epochs of time-series photometry from the Vera C. Rubin Observatory's Data Preview 1. The star, designated LSST-DP1-O- 614435753623041404 (or LSST-C25_var1 for short), has mean magnitudes of $(\langle g\rangle, \langle r\rangle) = (18.65, 18.63)$, with pulsation amplitudes of (0.60, 0.38)~mag in these bands. Its period…
▽ More
We report the discovery of an SX Phoenicis-type pulsating variable star via 217 epochs of time-series photometry from the Vera C. Rubin Observatory's Data Preview 1. The star, designated LSST-DP1-O- 614435753623041404 (or LSST-C25_var1 for short), has mean magnitudes of $(\langle g\rangle, \langle r\rangle) = (18.65, 18.63)$, with pulsation amplitudes of (0.60, 0.38)~mag in these bands. Its period is 0.0767 days (1.841 hours), typical of SX Phe pulsators. We derive a distance to the star of 16.6 kpc based on an SX Phe period-luminosity relation. Its position $\sim5$ kpc from the Galactic plane, in the outer Milky Way disk at a Galactocentric distance of $\sim22$ kpc, and its proper motion suggest that LSST-C25_var1 is part of the Monoceros Ring structure. This star is presented as a small taste of the many thousands of variable stars expected in Rubin/LSST data.
△ Less
Submitted 30 June, 2025;
originally announced July 2025.
-
Variability-finding in Rubin Data Preview 1 with LSDB
Authors:
Konstantin Malanchev,
Melissa DeLucchi,
Neven Caplar,
Alex I. Malz,
Wilson Beebe,
Doug Branton,
Sandro Campos,
Andrew Connolly,
Mi Dai,
Jeremy Kubica,
Olivia Lynn,
Rachel Mandelbaum,
Sean McGuire,
Eric Aubourg,
Robert David Blum,
Jeffrey L. Carlin,
Francisco Delgado,
Emmanuel Gangler,
Buell T. Jannuzi,
Tim Jenness,
Yijung Kang,
Arun Kannawadi,
Marc Moniez,
Andrés A. Plazas Malagón,
Wouter van Reeven
, et al. (3 additional authors not shown)
Abstract:
The Vera C. Rubin Observatory recently released Data Preview 1 (DP1) in advance of the upcoming Legacy Survey of Space and Time (LSST), which will enable boundless discoveries in time-domain astronomy over the next ten years. DP1 provides an ideal sandbox for validating innovative data analysis approaches for the LSST mission, whose scale challenges established software infrastructure paradigms. T…
▽ More
The Vera C. Rubin Observatory recently released Data Preview 1 (DP1) in advance of the upcoming Legacy Survey of Space and Time (LSST), which will enable boundless discoveries in time-domain astronomy over the next ten years. DP1 provides an ideal sandbox for validating innovative data analysis approaches for the LSST mission, whose scale challenges established software infrastructure paradigms. This note presents a pair of such pipelines for variability-finding using powerful software infrastructure suited to LSST data, namely the HATS (Hierarchical Adaptive Tiling Scheme) format and the LSDB framework, developed by the LSST Interdisciplinary Network for Collaboration and Computing (LINCC) Frameworks team. This note presents a pair of variability-finding pipelines built on LSDB, the HATS catalog of DP1 data, and preliminary results of detected variable objects, two of which are novel discoveries.
△ Less
Submitted 30 June, 2025;
originally announced June 2025.
-
Signatures to help interpretability of anomalies
Authors:
Emmanuel Gangler,
Emille E. O. Ishida,
Matwey V. Kornilov,
Vladimir Korolev,
Anastasia Lavrukhina,
Konstantin Malanchev,
Maria V. Pruzhinskaya,
Etienne Russeil,
Timofey Semenikhin,
Sreevarsha Sreejith,
Alina A. Volnova
Abstract:
Machine learning is often viewed as a black box when it comes to understanding its output, be it a decision or a score. Automatic anomaly detection is no exception to this rule, and quite often the astronomer is left to independently analyze the data in order to understand why a given event is tagged as an anomaly. We introduce here idea of anomaly signature, whose aim is to help the interpretabil…
▽ More
Machine learning is often viewed as a black box when it comes to understanding its output, be it a decision or a score. Automatic anomaly detection is no exception to this rule, and quite often the astronomer is left to independently analyze the data in order to understand why a given event is tagged as an anomaly. We introduce here idea of anomaly signature, whose aim is to help the interpretability of anomalies by highlighting which features contributed to the decision.
△ Less
Submitted 19 June, 2025;
originally announced June 2025.
-
Dataset of artefacts for machine learning applications in astronomy
Authors:
Sreevarsha Sreejith,
Maria V. Pruzhinskaya,
Alina A. Volnova,
Vadim V. Krushinsky,
Konstantin L. Malanchev,
Emille E. O. Ishida,
Anastasia D. Lavrukhina,
Timofey A. Semenikhin,
Emmanuel Gangler,
Matwey V. Kornilov,
Vladimir S. Korolev
Abstract:
Accurate photometry in astronomical surveys is challenged by image artefacts, which affect measurements and degrade data quality. Due to the large amount of available data, this task is increasingly handled using machine learning algorithms, which often require a labelled training set to learn data patterns. We present an expert-labelled dataset of 1127 artefacts with 1213 labels from 26 fields in…
▽ More
Accurate photometry in astronomical surveys is challenged by image artefacts, which affect measurements and degrade data quality. Due to the large amount of available data, this task is increasingly handled using machine learning algorithms, which often require a labelled training set to learn data patterns. We present an expert-labelled dataset of 1127 artefacts with 1213 labels from 26 fields in ZTF DR3, along with a complementary set of nominal objects. The artefact dataset was compiled using the active anomaly detection algorithm PineForest, developed by the SNAD team. These datasets can serve as valuable resources for real-bogus classification, catalogue cleaning, anomaly detection, and educational purposes. Both artefacts and nominal images are provided in FITS format in two sizes (28 x 28 and 63 x 63 pixels). The datasets are publicly available for further scientific applications.
△ Less
Submitted 10 April, 2025;
originally announced April 2025.
-
PhotoD with LSST: Stellar Photometric Distances Out to the Edge of the Galaxy
Authors:
Lovro Palaversa,
Željko Ivezić,
Neven Caplar,
Karlo Mrakovčić,
Bob Abel,
Oleksandra Razim,
Filip Matković,
Connor Yablonski,
Toni Šarić,
Tomislav Jurkić,
Sandro Campos,
Melissa DeLucchi,
Derek Jones,
Konstantin Malanchev,
Alex I. Malz,
Sean McGuire,
Mario Jurić
Abstract:
As demonstrated with the Sloan Digital Sky Survey (SDSS), Pan-STARRS, and most recently with Gaia data, broadband near-UV to near-IR stellar photometry can be used to estimate distance, metallicity, and interstellar dust extinction along the line of sight for stars in the Galaxy. Anticipating photometric catalogs with tens of billions of stars from Rubin's Legacy Survey of Space and Time (LSST), w…
▽ More
As demonstrated with the Sloan Digital Sky Survey (SDSS), Pan-STARRS, and most recently with Gaia data, broadband near-UV to near-IR stellar photometry can be used to estimate distance, metallicity, and interstellar dust extinction along the line of sight for stars in the Galaxy. Anticipating photometric catalogs with tens of billions of stars from Rubin's Legacy Survey of Space and Time (LSST), we present a Bayesian model and pipeline that build on previous work and can handle LSST-sized datasets. Likelihood computations utilize MIST/Dartmouth isochrones and priors are derived from TRILEGAL-based simulated LSST catalogs from P. Dal Tio et al. The computation speed is about 10 ms per star on a single core for both optimized grid search and Markov Chain Monte Carlo methods; we show in a companion paper by K. Mrakovčić et al. how to utilize neural networks to accelerate this performance by up to an order of magnitude. We validate our pipeline, named PhotoD (in analogy with photo-z, photometric redshifts of galaxies) using both simulated catalogs and SDSS, DECam, and Gaia photometry. We intend to make LSST-based value-added PhotoD catalogs publicly available via the Rubin Science Platform with every LSST data release.
△ Less
Submitted 5 February, 2025;
originally announced February 2025.
-
Using LSDB to enable large-scale catalog distribution, cross-matching, and analytics
Authors:
Neven Caplar,
Wilson Beebe,
Doug Branton,
Sandro Campos,
Andrew Connolly,
Melissa DeLucchi,
Derek Jones,
Mario Juric,
Jeremy Kubica,
Konstantin Malanchev,
Rachel Mandelbaum,
Sean McGuire
Abstract:
The Vera C. Rubin Observatory will generate an unprecedented volume of data, including approximately 60 petabytes of raw data and around 30 trillion observed sources, posing a significant challenge for large-scale and end-user scientific analysis. As part of the LINCC Frameworks Project we are addressing these challenges with the development of the HATS (Hierarchical Adaptive Tiling Scheme) format…
▽ More
The Vera C. Rubin Observatory will generate an unprecedented volume of data, including approximately 60 petabytes of raw data and around 30 trillion observed sources, posing a significant challenge for large-scale and end-user scientific analysis. As part of the LINCC Frameworks Project we are addressing these challenges with the development of the HATS (Hierarchical Adaptive Tiling Scheme) format and analysis package LSDB (Large Scale Database). HATS partitions data adaptively using a hierarchical tiling system to balance the file sizes, enabling efficient parallel analysis. Recent updates include improved metadata consistency, support for incremental updates, and enhanced compatibility with evolving datasets. LSDB complements HATS by providing a scalable, user-friendly interface for large catalog analysis, integrating spatial queries, crossmatching, and time-series tools while utilizing Dask for parallelization. We have successfully demonstrated the use of these tools with datasets such as ZTF and Pan-STARRS data releases on both cluster and cloud environments. We are deeply involved in several ongoing collaborations to ensure alignment with community needs, with future plans for IVOA standardization and support for upcoming Rubin, Euclid and Roman data. We provide our code and materials at lsdb.io.
△ Less
Submitted 3 January, 2025;
originally announced January 2025.
-
ORACLE: A Real-Time, Hierarchical, Deep-Learning Photometric Classifier for the LSST
Authors:
Ved G. Shah,
Alex Gagliano,
Konstantin Malanchev,
Gautham Narayan,
The LSST Dark Energy Science Collaboration
Abstract:
We present ORACLE, the first hierarchical deep-learning model for real-time, context-aware classification of transient and variable astrophysical phenomena. ORACLE is a recurrent neural network with Gated Recurrent Units (GRUs), and has been trained using a custom hierarchical cross-entropy loss function to provide high-confidence classifications along an observationally-driven taxonomy with as li…
▽ More
We present ORACLE, the first hierarchical deep-learning model for real-time, context-aware classification of transient and variable astrophysical phenomena. ORACLE is a recurrent neural network with Gated Recurrent Units (GRUs), and has been trained using a custom hierarchical cross-entropy loss function to provide high-confidence classifications along an observationally-driven taxonomy with as little as a single photometric observation. Contextual information for each object, including host galaxy photometric redshift, offset, ellipticity and brightness, is concatenated to the light curve embedding and used to make a final prediction. Training on $\sim$0.5M events from the Extended LSST Astronomical Time-Series Classification Challenge, we achieve a top-level (Transient vs Variable) macro-averaged precision of 0.96 using only 1 day of photometric observations after the first detection in addition to contextual information, for each event; this increases to $>$0.99 once 64 days of the light curve has been obtained, and 0.83 at 1024 days after first detection for 19-way classification (including supernova sub-types, active galactic nuclei, variable stars, microlensing events, and kilonovae). We also compare ORACLE with other state-of-the-art classifiers and report comparable performance for the 19-way classification task, in addition to delivering accurate top-level classifications much earlier. The code and model weights used in this work are publicly available at our associated GitHub repository (https://github.com/uiucsn/ELAsTiCC-Classification).
△ Less
Submitted 2 January, 2025;
originally announced January 2025.
-
Superluminous supernova search with PineForest
Authors:
T. Majumder,
M. V. Pruzhinskaya,
E. E. O. Ishida,
K. L. Malanchev,
T. A. Semenikhin
Abstract:
The advent of large astronomical surveys has made available large and complex data sets. However, the process of discovery and interpretation of each potentially new astronomical source is, many times, still handcrafted. In this context, machine learning algorithms have emerged as a powerful tool to mine large data sets and lower the burden on the domain expert. Active learning strategies are spec…
▽ More
The advent of large astronomical surveys has made available large and complex data sets. However, the process of discovery and interpretation of each potentially new astronomical source is, many times, still handcrafted. In this context, machine learning algorithms have emerged as a powerful tool to mine large data sets and lower the burden on the domain expert. Active learning strategies are specially good in this task. In this report, we used the PineForest algorithm to search for superluminous supernova (SLSN) candidates in the Zwicky Transient Facility. We showcase how the use of previously confirmed sources can provide important information to boost the convergence of the active learning algorithm. Starting from a data set of $\sim$14 million objects, and using 8 previously confirmed SLSN light curves as priors, we scrutinized 120 candidates and found 8 SLSN candidates, 2 of which have not been reported before (AT 2018moa and AT 2018mob). These results demonstrate how existing spectroscopic samples can be used to improve the efficiency of active learning strategies in searching for rare astronomical sources.
△ Less
Submitted 28 October, 2024;
originally announced October 2024.
-
Exploring the Universe with SNAD: Anomaly Detection in Astronomy
Authors:
Alina A. Volnova,
Patrick D. Aleo,
Anastasia Lavrukhina,
Etienne Russeil,
Timofey Semenikhin,
Emmanuel Gangler,
Emille E. O. Ishida,
Matwey V. Kornilov,
Vladimir Korolev,
Konstantin Malanchev,
Maria V. Pruzhinskaya,
Sreevarsha Sreejith
Abstract:
SNAD is an international project with a primary focus on detecting astronomical anomalies within large-scale surveys, using active learning and other machine learning algorithms. The work carried out by SNAD not only contributes to the discovery and classification of various astronomical phenomena but also enhances our understanding and implementation of machine learning techniques within the fiel…
▽ More
SNAD is an international project with a primary focus on detecting astronomical anomalies within large-scale surveys, using active learning and other machine learning algorithms. The work carried out by SNAD not only contributes to the discovery and classification of various astronomical phenomena but also enhances our understanding and implementation of machine learning techniques within the field of astrophysics. This paper provides a review of the SNAD project and summarizes the advancements and achievements made by the team over several years.
△ Less
Submitted 24 October, 2024;
originally announced October 2024.
-
Coniferest: a complete active anomaly detection framework
Authors:
M. V. Kornilov,
V. S. Korolev,
K. L. Malanchev,
A. D. Lavrukhina,
E. Russeil,
T. A. Semenikhin,
E. Gangler,
E. E. O. Ishida,
M. V. Pruzhinskaya,
A. A. Volnova,
S. Sreejith
Abstract:
We present coniferest, an open source generic purpose active anomaly detection framework written in Python. The package design and implemented algorithms are described. Currently, static outlier detection analysis is supported via the Isolation forest algorithm. Moreover, Active Anomaly Discovery (AAD) and Pineforest algorithms are available to tackle active anomaly detection problems. The algorit…
▽ More
We present coniferest, an open source generic purpose active anomaly detection framework written in Python. The package design and implemented algorithms are described. Currently, static outlier detection analysis is supported via the Isolation forest algorithm. Moreover, Active Anomaly Discovery (AAD) and Pineforest algorithms are available to tackle active anomaly detection problems. The algorithms and package performance are evaluated on a series of synthetic datasets. We also describe a few success cases which resulted from applying the package to real astronomical data in active anomaly detection tasks within the SNAD project.
△ Less
Submitted 15 November, 2024; v1 submitted 22 October, 2024;
originally announced October 2024.
-
Real-bogus scores for active anomaly detection
Authors:
T. A. Semenikhin,
M. V. Kornilov,
M. V. Pruzhinskaya,
A. D. Lavrukhina,
E. Russeil,
E. Gangler,
E. E. O. Ishida,
V. S. Korolev,
K. L. Malanchev,
A. A. Volnova,
S. Sreejith
Abstract:
In the task of anomaly detection in modern time-domain photometric surveys, the primary goal is to identify astrophysically interesting, rare, and unusual objects among a large volume of data. Unfortunately, artifacts -- such as plane or satellite tracks, bad columns on CCDs, and ghosts -- often constitute significant contaminants in results from anomaly detection analysis. In such contexts, the A…
▽ More
In the task of anomaly detection in modern time-domain photometric surveys, the primary goal is to identify astrophysically interesting, rare, and unusual objects among a large volume of data. Unfortunately, artifacts -- such as plane or satellite tracks, bad columns on CCDs, and ghosts -- often constitute significant contaminants in results from anomaly detection analysis. In such contexts, the Active Anomaly Discovery (AAD) algorithm allows tailoring the output of anomaly detection pipelines according to what the expert judges to be scientifically interesting. We demonstrate how the introduction real-bogus scores, obtained from a machine learning classifier, improves the results from AAD. Using labeled data from the SNAD ZTF knowledge database, we train four real-bogus classifiers: XGBoost, CatBoost, Random Forest, and Extremely Randomized Trees. All the models perform real-bogus classification with similar effectiveness, achieving ROC-AUC scores ranging from 0.93 to 0.95. Consequently, we select the Random Forest model as the main model due to its simplicity and interpretability. The Random Forest classifier is applied to 67 million light curves from ZTF DR17. The output real-bogus score is used as an additional feature for two anomaly detection algorithms: static Isolation Forest and AAD. While results from Isolation Forest remained unchanged, the number of artifacts detected by the active approach decreases significantly with the inclusion of the real-bogus score, from 27 to 3 out of 100. We conclude that incorporating the real-bogus classifier result as an additional feature in the active anomaly detection pipeline significantly reduces the number of artifacts in the outputs, thereby increasing the incidence of astrophysically interesting objects presented to human experts.
△ Less
Submitted 20 December, 2024; v1 submitted 16 September, 2024;
originally announced September 2024.
-
Fast giant flares in discs around supermassive black holes
Authors:
G. V. Lipunova,
A. S. Tavleev,
K. L. Malanchev
Abstract:
We study the thermal stability of non-self-gravitating turbulent $α$ discs around supermassive black holes (SMBHs) to test a new type of high-amplitude active galactic nuclei (AGN) flares. On calculating discs structures, we compute the critical points of stability curves for discs around SMBH, which cover a wide range of accretion rates and resemble the shape of a $ξ$ curve. We find that there ar…
▽ More
We study the thermal stability of non-self-gravitating turbulent $α$ discs around supermassive black holes (SMBHs) to test a new type of high-amplitude active galactic nuclei (AGN) flares. On calculating discs structures, we compute the critical points of stability curves for discs around SMBH, which cover a wide range of accretion rates and resemble the shape of a $ξ$ curve. We find that there are values of the disc parameters that favour the transition of a disc ring from a recombined cool state to a hot, fully ionised, advection dominated, geometrically thick state with higher viscosity parameter $α$. For SMBH with masses $\sim 10^6-10^8 M_\odot$, such a flare can occur in the geometrically thin and optically thick neutral disc with convective energy transfer through the disc thickness surrounding a radiatively inefficient accretion flow. When self-gravity effects are negligible, the duration of a flare and the associated mass exhibit a positive correlation with the truncation radius of the geometrically thin disc prior to the flare. According to our rough estimates, $\sim 4-3000 M_\odot$ can be involved in a giant flare, i.e. can be accreted or entrained with an outflow lasting 1 to 400 years, if the flare is triggered somewhere between $60$ and $600$ gravitational radii in a disc around SMBH with $10^7 M_\odot$. The accretion rate on SMBH peaks at a super-Eddington value about ten times faster. The peak effective disc temperature at the trigger radius is $\sim 10^5\,$K, but it can be obscured by an optically thick outflow that reprocesses the emission to longer wavelengths. Such a transfer of disc state could trigger a massive outburst, similar to that following a tidal disruption event.
△ Less
Submitted 12 April, 2024;
originally announced April 2024.
-
SNAD catalogue of M-dwarf flares from the Zwicky Transient Facility
Authors:
A. S. Voloshina,
A. D. Lavrukhina,
M. V. Pruzhinskaya,
K. L. Malanchev,
E. E. O. Ishida,
V. V. Krushinsky,
P. D. Aleo,
E. Gangler,
M. V. Kornilov,
V. S. Korolev,
E. Russeil,
T. A. Semenikhin,
S. Sreejith,
A. A. Volnova
Abstract:
Most of the stars in the Universe are M spectral class dwarfs, which are known to be the source of bright and frequent stellar flares. In this paper, we propose new approaches to discover M-dwarf flares in ground-based photometric surveys. We employ two approaches: a modification of a traditional method of parametric fit search and a machine learning algorithm based on active anomaly detection. Th…
▽ More
Most of the stars in the Universe are M spectral class dwarfs, which are known to be the source of bright and frequent stellar flares. In this paper, we propose new approaches to discover M-dwarf flares in ground-based photometric surveys. We employ two approaches: a modification of a traditional method of parametric fit search and a machine learning algorithm based on active anomaly detection. The algorithms are applied to Zwicky Transient Facility (ZTF) data release 8, which includes the data from the ZTF high-cadence survey, allowing us to reveal flares lasting from minutes to hours. We analyze over 35 million ZTF light curves and visually scrutinize 1168 candidates suggested by the algorithms to filter out artifacts, occultations of a star by an asteroid, and other types of known variable objects. The result of this analysis is the largest catalogue of ZTF flaring stars to date, representing 134 flares with amplitudes ranging from -0.2 to -4.6 magnitudes, including repeated flares. Using Pan-STARRS DR2 colors, we assign a spectral subclass to each object in the sample. For 13 flares with well-sampled light curves and available geometric distances from Gaia DR3, we estimate the bolometric energy. This research shows that the proposed methods combined with the ZTF's cadence strategy are suitable for identifying M-dwarf flares and other fast transients, allowing for the extraction of significant astrophysical information from their light curves.
△ Less
Submitted 29 September, 2024; v1 submitted 11 April, 2024;
originally announced April 2024.
-
Anomaly Detection and Approximate Similarity Searches of Transients in Real-time Data Streams
Authors:
P. D. Aleo,
A. W. Engel,
G. Narayan,
C. R. Angus,
K. Malanchev,
K. Auchettl,
V. F. Baldassare,
A. Berres,
T. J. L. de Boer,
B. M. Boyd,
K. C. Chambers,
K. W. Davis,
N. Esquivel,
D. Farias,
R. J. Foley,
A. Gagliano,
C. Gall,
H. Gao,
S. Gomez,
M. Grayling,
D. O. Jones,
C. -C. Lin,
E. A. Magnier,
K. S. Mandel,
T. Matheson
, et al. (7 additional authors not shown)
Abstract:
We present LAISS (Lightcurve Anomaly Identification and Similarity Search), an automated pipeline to detect anomalous astrophysical transients in real-time data streams. We deploy our anomaly detection model on the nightly ZTF Alert Stream via the ANTARES broker, identifying a manageable $\sim$1-5 candidates per night for expert vetting and coordinating follow-up observations. Our method leverages…
▽ More
We present LAISS (Lightcurve Anomaly Identification and Similarity Search), an automated pipeline to detect anomalous astrophysical transients in real-time data streams. We deploy our anomaly detection model on the nightly ZTF Alert Stream via the ANTARES broker, identifying a manageable $\sim$1-5 candidates per night for expert vetting and coordinating follow-up observations. Our method leverages statistical light-curve and contextual host-galaxy features within a random forest classifier, tagging transients of rare classes (spectroscopic anomalies), of uncommon host-galaxy environments (contextual anomalies), and of peculiar or interaction-powered phenomena (behavioral anomalies). Moreover, we demonstrate the power of a low-latency ($\sim$ms) approximate similarity search method to find transient analogs with similar light-curve evolution and host-galaxy environments. We use analogs for data-driven discovery, characterization, (re-)classification, and imputation in retrospective and real-time searches. To date we have identified $\sim$50 previously known and previously missed rare transients from real-time and retrospective searches, including but not limited to: SLSNe, TDEs, SNe IIn, SNe IIb, SNe Ia-CSM, SNe Ia-91bg-like, SNe Ib, SNe Ic, SNe Ic-BL, and M31 novae. Lastly, we report the discovery of 325 total transients, all observed between 2018-2021 and absent from public catalogs ($\sim$1% of all ZTF Astronomical Transient reports to the Transient Name Server through 2021). These methods enable a systematic approach to finding the "needle in the haystack" in large-volume data streams. Because of its integration with the ANTARES broker, LAISS is built to detect exciting transients in Rubin data.
△ Less
Submitted 24 July, 2024; v1 submitted 1 April, 2024;
originally announced April 2024.
-
Superphot+: Realtime Fitting and Classification of Supernova Light Curves
Authors:
Kaylee M. de Soto,
Ashley Villar,
Edo Berger,
Sebastian Gomez,
Griffin Hosseinzadeh,
Doug Branton,
Sandro Campos,
Melissa DeLucchi,
Jeremy Kubica,
Olivia Lynn,
Konstantin Malanchev,
Alex I. Malz
Abstract:
Photometric classifications of supernova (SN) light curves have become necessary to utilize the full potential of large samples of observations obtained from wide-field photometric surveys, such as the Zwicky Transient Facility (ZTF) and the Vera C. Rubin Observatory. Here, we present a photometric classifier for SN light curves that does not rely on redshift information and still maintains compar…
▽ More
Photometric classifications of supernova (SN) light curves have become necessary to utilize the full potential of large samples of observations obtained from wide-field photometric surveys, such as the Zwicky Transient Facility (ZTF) and the Vera C. Rubin Observatory. Here, we present a photometric classifier for SN light curves that does not rely on redshift information and still maintains comparable accuracy to redshift-dependent classifiers. Our new package, Superphot+, uses a parametric model to extract meaningful features from multiband SN light curves. We train a gradient-boosted machine with fit parameters from 6,061 ZTF SNe that pass data quality cuts and are spectroscopically classified as one of five classes: SN Ia, SN II, SN Ib/c, SN IIn, and SLSN-I. Without redshift information, our classifier yields a class-averaged F1-score of 0.61 +/- 0.02 and a total accuracy of 0.83 +/- 0.01. Including redshift information improves these metrics to 0.71 +/- 0.02 and 0.88 +/- 0.01, respectively. We assign new class probabilities to 3,558 ZTF transients that show SN-like characteristics (based on the ALeRCE Broker light curve and stamp classifiers), but lack spectroscopic classifications. Finally, we compare our predicted SN labels with those generated by the ALeRCE light curve classifier, finding that the two classifiers agree on photometric labels for 82 +/- 2% of light curves with spectroscopic labels and 72% of light curves without spectroscopic labels. Superphot+ is currently classifying ZTF SNe in real time via the ANTARES Broker, and is designed for simple adaptation to six-band Rubin light curves in the future.
△ Less
Submitted 12 March, 2024;
originally announced March 2024.
-
Multi-View Symbolic Regression
Authors:
Etienne Russeil,
Fabrício Olivetti de França,
Konstantin Malanchev,
Bogdan Burlacu,
Emille E. O. Ishida,
Marion Leroux,
Clément Michelin,
Guillaume Moinard,
Emmanuel Gangler
Abstract:
Symbolic regression (SR) searches for analytical expressions representing the relationship between a set of explanatory and response variables. Current SR methods assume a single dataset extracted from a single experiment. Nevertheless, frequently, the researcher is confronted with multiple sets of results obtained from experiments conducted with different setups. Traditional SR methods may fail t…
▽ More
Symbolic regression (SR) searches for analytical expressions representing the relationship between a set of explanatory and response variables. Current SR methods assume a single dataset extracted from a single experiment. Nevertheless, frequently, the researcher is confronted with multiple sets of results obtained from experiments conducted with different setups. Traditional SR methods may fail to find the underlying expression since the parameters of each experiment can be different. In this work we present Multi-View Symbolic Regression (MvSR), which takes into account multiple datasets simultaneously, mimicking experimental environments, and outputs a general parametric solution. This approach fits the evaluated expression to each independent dataset and returns a parametric family of functions f(x; theta) simultaneously capable of accurately fitting all datasets. We demonstrate the effectiveness of MvSR using data generated from known expressions, as well as real-world data from astronomy, chemistry and economy, for which an a priori analytical expression is not available. Results show that MvSR obtains the correct expression more frequently and is robust to hyperparameters change. In real-world data, it is able to grasp the group behavior, recovering known expressions from the literature as well as promising alternatives, thus enabling the use of SR to a large range of experimental scenarios.
△ Less
Submitted 15 November, 2024; v1 submitted 6 February, 2024;
originally announced February 2024.
-
TESS photometry of the nova eruption in V606 Vul: asymmetric photosphere and multiple ejections?
Authors:
Kirill V. Sokolovsky,
Elias Aydi,
Konstantin Malanchev,
Colin J. Burke,
Koji Mukai,
Jennifer L. Sokoloski,
Brian D. Metzger,
Kirill E. Atapin,
Aleksandre A. Belinski,
Yu-Ching Chen,
Laura Chomiuk,
Pavol A. Dubovsky,
Claude-Andre Faucher-Giguere,
Rebekah A. Hounsell,
Natalia P. Ikonnikova,
Vsevolod Yu. Lander,
Junyao Li,
Justin D. Linford,
Amy J. Mioduszewski,
Isabella Molina,
Ulisse Munari,
Sergey A. Potanin,
Robert M. Quimby,
Michael P. Rupen,
Simone Scaringi
, et al. (48 additional authors not shown)
Abstract:
Lightcurves of many classical novae deviate from the canonical "fast rise - smooth decline" pattern and display complex variability behavior. We present the first TESS-space-photometry-based investigation of this phenomenon. We use Sector 41 full-frame images to extract a lightcurve of the slow Galactic nova V606 Vul that erupted nine days prior to the start of the TESS observations. The lightcurv…
▽ More
Lightcurves of many classical novae deviate from the canonical "fast rise - smooth decline" pattern and display complex variability behavior. We present the first TESS-space-photometry-based investigation of this phenomenon. We use Sector 41 full-frame images to extract a lightcurve of the slow Galactic nova V606 Vul that erupted nine days prior to the start of the TESS observations. The lightcurve covers the first of two major peaks of V606 Vul that was reached 19 days after the start of the eruption. The nova reached its brightest visual magnitude V=9.9 in its second peak 64 days after the eruption onset, following the completion of Sector 41 observations. To increase the confidence level of the extracted lightcurve, we performed the analysis using four different codes implementing the aperture photometry (Lightkurve, VaST) and image subtraction (TESSreduce, tequila_shots) and find good agreement between them. We performed ground-based photometric and spectroscopic monitoring to complement the TESS data. The TESS lightcurve reveals two features: periodic variations (0.12771 d, 0.01 mag average peak-to-peak amplitude) that disappeared when the source was within 1 mag of peak optical brightness and a series of isolated mini-flares (with peak-to-peak amplitudes of up to 0.5 mag) appearing at seemingly random times. We interpret the periodic variations as the result of azimuthal asymmetry of the photosphere engulfing the nova-hosting binary that was distorted by and rotating with the binary. Whereas we use spectra to associate the two major peaks in the nova lightcurve with distinct episodes of mass ejection, the origin of mini-flares remains elusive.
△ Less
Submitted 12 April, 2025; v1 submitted 8 November, 2023;
originally announced November 2023.
-
The effect of thermal winds on the outbursts evolution of LMXB systems
Authors:
A. L. Avakyan,
G. V. Lipunova,
K. L. Malanchev
Abstract:
Theoretical models of accretion discs and observational data indicate that the X-ray emission from the inner parts of an accretion disc can irradiate its outer regions and induce a thermal wind, which carries away the mass and angular momentum from the disc. Our aim is to investigate the influence of the thermal wind on the outburst light curves of black hole X-ray binary systems. We carry out num…
▽ More
Theoretical models of accretion discs and observational data indicate that the X-ray emission from the inner parts of an accretion disc can irradiate its outer regions and induce a thermal wind, which carries away the mass and angular momentum from the disc. Our aim is to investigate the influence of the thermal wind on the outburst light curves of black hole X-ray binary systems. We carry out numerical simulations of a non-stationary disc accretion with wind using upgraded open code freddi. We assume that the wind launches only from the ionised part of the disc and may turn off if the latter shrinks fast enough. Our estimates of the viscosity parameter $α$ are shifted downward compared to a scenario without a wind. Generally, correction of $α$ depends on the spectral hardness of central X-rays and the disc outer radius, but unlikely to exceed a factor of 10 in the case of a black hole low-mass X-ray binary (BH LMXB). We fit 2002 outburst of BH LMXB 4U 1543-47 taking into account the thermal wind. The mass loss in the thermal wind is of order of the accretion rate on the central object at the peak of the outburst. New estimate of the viscosity parameter $α$ for the accretion disc in this system is about two times lower than the previous one. Additionally, we calculate evolution of the number of hydrogen atoms towards 4U 1543-47 due to the thermal wind from the hot disc.
△ Less
Submitted 31 October, 2023;
originally announced October 2023.
-
Rainbow: a colorful approach on multi-passband light curve estimation
Authors:
E. Russeil,
K. L. Malanchev,
P. D. Aleo,
E. E. O. Ishida,
M. V. Pruzhinskaya,
E. Gangler,
A. D. Lavrukhina,
A. A. Volnova,
A. Voloshina,
T. Semenikhin,
S. Sreejith,
M. V. Kornilov,
V. S. Korolev
Abstract:
We present Rainbow, a physically motivated framework which enables simultaneous multi-band light curve fitting. It allows the user to construct a 2-dimensional continuous surface across wavelength and time, even in situations where the number of observations in each filter is significantly limited. Assuming the electromagnetic radiation emission from the transient can be approximated by a black-bo…
▽ More
We present Rainbow, a physically motivated framework which enables simultaneous multi-band light curve fitting. It allows the user to construct a 2-dimensional continuous surface across wavelength and time, even in situations where the number of observations in each filter is significantly limited. Assuming the electromagnetic radiation emission from the transient can be approximated by a black-body, we combined an expected temperature evolution and a parametric function describing its bolometric light curve. These three ingredients allow the information available in one passband to guide the reconstruction in the others, thus enabling a proper use of multi-survey data. We demonstrate the effectiveness of our method by applying it to simulated data from the Photometric LSST Astronomical Time-series Classification Challenge (PLAsTiCC) as well as real data from the Young Supernova Experiment (YSE DR1). We evaluate the quality of the estimated light curves according to three different tests: goodness of fit, time of peak prediction and ability to transfer information to machine learning (ML) based classifiers. Results confirm that Rainbow leads to equivalent (SNII) or up to 75% better (SN Ibc) goodness of fit when compared to the Monochromatic approach. Similarly, accuracy when using Rainbow best-fit values as a parameter space in multi-class ML classification improves for all classes in our sample. An efficient implementation of Rainbow has been publicly released as part of the light curve package at https://github.com/light-curve/light-curve-python. Our approach enables straight forward light curve estimation for objects with observations in multiple filters and from multiple experiments. It is particularly well suited for situations where light curve sampling is sparse.
△ Less
Submitted 5 October, 2023; v1 submitted 4 October, 2023;
originally announced October 2023.
-
Automatic detection of plateau phases in light curves of variable stars
Authors:
Anastasia Lavrukhina,
Konstantin Malanchev,
Matwey V. Kornilov
Abstract:
Modern astronomical surveys produce millions of light curves of variable sources. These massive data sets challenge the community to create automatic light-curve processing methods for detection, classification, and characterisation of variable stars. In this paper, we present a novel method for extracting the variable components of a light curve based on Otsu's thresholding method. To validate th…
▽ More
Modern astronomical surveys produce millions of light curves of variable sources. These massive data sets challenge the community to create automatic light-curve processing methods for detection, classification, and characterisation of variable stars. In this paper, we present a novel method for extracting the variable components of a light curve based on Otsu's thresholding method. To validate the effectiveness of this method, we apply it to the light curves of detached eclipsing binaries and dwarf novae, sourced from OGLE catalogues.
△ Less
Submitted 18 September, 2023;
originally announced September 2023.
-
Applications of Deep Learning to physics workflows
Authors:
Manan Agarwal,
Jay Alameda,
Jeroen Audenaert,
Will Benoit,
Damon Beveridge,
Meghna Bhattacharya,
Chayan Chatterjee,
Deep Chatterjee,
Andy Chen,
Muhammed Saleem Cholayil,
Chia-Jui Chou,
Sunil Choudhary,
Michael Coughlin,
Maximilian Dax,
Aman Desai,
Andrea Di Luca,
Javier Mauricio Duarte,
Steven Farrell,
Yongbin Feng,
Pooyan Goodarzi,
Ekaterina Govorkova,
Matthew Graham,
Jonathan Guiang,
Alec Gunny,
Weichangfeng Guo
, et al. (43 additional authors not shown)
Abstract:
Modern large-scale physics experiments create datasets with sizes and streaming rates that can exceed those from industry leaders such as Google Cloud and Netflix. Fully processing these datasets requires both sufficient compute power and efficient workflows. Recent advances in Machine Learning (ML) and Artificial Intelligence (AI) can either improve or replace existing domain-specific algorithms…
▽ More
Modern large-scale physics experiments create datasets with sizes and streaming rates that can exceed those from industry leaders such as Google Cloud and Netflix. Fully processing these datasets requires both sufficient compute power and efficient workflows. Recent advances in Machine Learning (ML) and Artificial Intelligence (AI) can either improve or replace existing domain-specific algorithms to increase workflow efficiency. Not only can these algorithms improve the physics performance of current algorithms, but they can often be executed more quickly, especially when run on coprocessors such as GPUs or FPGAs. In the winter of 2023, MIT hosted the Accelerating Physics with ML at MIT workshop, which brought together researchers from gravitational-wave physics, multi-messenger astrophysics, and particle physics to discuss and share current efforts to integrate ML tools into their workflows. The following white paper highlights examples of algorithms and computing frameworks discussed during this workshop and summarizes the expected computing needs for the immediate future of the involved fields.
△ Less
Submitted 13 June, 2023;
originally announced June 2023.
-
All-Sky Faint DA White Dwarf Spectrophotometric Standards for Astrophysical Observatories: The Complete Sample
Authors:
Tim Axelrod,
Abhijit Saha,
Thomas Matheson,
Edward W. Olszewski,
Ralph C. Bohlin,
Annalisa Calamida,
Jenna Claver,
Susana Deustua,
Jay B. Holberg,
Ivan Hubeny,
John W. Mackenty,
Konstantin Malanchev,
Gautham Narayan,
Sean Points,
Armin Rest,
Elena Sabbi,
Christopher W. Stubbs
Abstract:
Hot DA white dwarfs have fully radiative pure hydrogen atmospheres that are the least complicated to model. Pulsationally stable, they are fully characterized by their effective temperature Teff, and surface gravity log g, which can be deduced from their optical spectra and used in model atmospheres to predict their spectral energy distribution (SED). Based on this, three bright DAWDs have defined…
▽ More
Hot DA white dwarfs have fully radiative pure hydrogen atmospheres that are the least complicated to model. Pulsationally stable, they are fully characterized by their effective temperature Teff, and surface gravity log g, which can be deduced from their optical spectra and used in model atmospheres to predict their spectral energy distribution (SED). Based on this, three bright DAWDs have defined the spectrophotometric flux scale of the CALSPEC system of HST. In this paper we add 32 new fainter (16.5 < V < 19.5) DAWDs spread over the whole sky and within the dynamic range of large telescopes. Using ground based spectra and panchromatic photometry with HST/WFC3, a new hierarchical analysis process demonstrates consistency between model and observed fluxes above the terrestrial atmosphere to < 0.004 mag rms from 2700 Å to 7750 Å and to 0.008 mag rms at 1.6μm for the total set of 35 DAWDs. These DAWDs are thus established as spectrophotometric standards with unprecedented accuracy from the near ultraviolet to the near-infrared, suitable for both ground and space based observatories. They are embedded in existing surveys like SDSS, PanSTARRS and GAIA, and will be naturally included in the LSST survey by Rubin Observatory. With additional data and analysis to extend the validity of their SEDs further into the IR, these spectrophotometric standard stars could be used for JWST, as well as for the Roman and Euclid observatories.
△ Less
Submitted 16 May, 2023; v1 submitted 12 May, 2023;
originally announced May 2023.
-
Analysis of accretion disc structure and stability using open code for vertical structure
Authors:
A. S. Tavleev,
G. V. Lipunova,
K. L. Malanchev
Abstract:
Radial structure of accretion discs around compact objects is often described using analytic approximations which are derived from averaging or integrating vertical structure equations. For non-solar chemical composition, partial ionization, or for supermassive black holes, this approach is not accurate. Additionally, radial extension of `analytically-described' disc zones is not evident in many c…
▽ More
Radial structure of accretion discs around compact objects is often described using analytic approximations which are derived from averaging or integrating vertical structure equations. For non-solar chemical composition, partial ionization, or for supermassive black holes, this approach is not accurate. Additionally, radial extension of `analytically-described' disc zones is not evident in many cases. We calculate vertical structure of accretion discs around compact objects, with and without external irradiation, with radiative and convective energy transport taken into account. For this, we introduce a new open Python code, allowing different equations of state (EoS) and opacity laws, including tabular values. As a result, radial structure and stability `S-curves' are calculated for specific disc parameters and chemical composition. In particular, based on more accurate power-law approximations for opacity in the disc, we supply new analytic formulas for the farthest regions of the hot disc around stellar-mass object. On calculating vertical structure of a self-irradiated disc, we calculate a self-consistent value of the irradiation parameter $C_{\rm irr}$ for stationary $α$-disc. We find that, for a fixed shape of the X-ray spectrum, $C_{\rm irr}$ depends weakly on the accretion rate but changes with radius, and the dependence is driven by the conditions in the photosphere and disc opening angle. The hot zone extent depends on the ratio between irradiating and intrinsic flux: corresponding relation for $T_{\rm irr,\, crit}$ is obtained.
△ Less
Submitted 22 June, 2023; v1 submitted 3 March, 2023;
originally announced March 2023.
-
Performant feature extraction for photometric time series
Authors:
Anastasia Lavrukhina,
Konstantin Malanchev
Abstract:
Astronomy is entering the era of large surveys of the variable sky such as Zwicky Transient Facility (ZTF) and the forthcoming Legacy Survey of Space and Time (LSST) which are intended to produce up to a million alerts per night. Such an amount of photometric data requires efficient light-curve pre-processing algorithms for the purposes of subsequent data quality cuts, classification, and characte…
▽ More
Astronomy is entering the era of large surveys of the variable sky such as Zwicky Transient Facility (ZTF) and the forthcoming Legacy Survey of Space and Time (LSST) which are intended to produce up to a million alerts per night. Such an amount of photometric data requires efficient light-curve pre-processing algorithms for the purposes of subsequent data quality cuts, classification, and characterization analysis. In this work, we present the new library "light-curve" for Python and Rust, which is intended for feature extraction from light curves of variable astronomical sources. The library is suitable for machine learning classification problems: it provides a fast implementation of feature extractors, which outperforms other public available codes, and consists of dozens features describing shape, magnitude distribution, and periodic properties of light curves. It includes not only features which had been shown to provide a high performance in classification tasks, but also new features we developed to improve classification quality of selected types of objects. The "light-curve" library is currently used by the ANTARES, AMPEL, and Fink broker systems for analyzing the ZTF alert stream, and has been selected for use with the LSST.
△ Less
Submitted 21 February, 2023;
originally announced February 2023.
-
The SNAD Viewer: Everything You Want to Know about Your Favorite ZTF Object
Authors:
Konstantin Malanchev,
Matwey V. Kornilov,
Maria V. Pruzhinskaya,
Emille E. O. Ishida,
Patrick D. Aleo,
Vladimir S. Korolev,
Anastasia Lavrukhina,
Etienne Russeil,
Sreevarsha Sreejith,
Alina A. Volnova,
Anastasiya Voloshina,
Alberto Krone-Martins
Abstract:
We describe the SNAD Viewer, a web portal for astronomers which presents a centralized view of individual objects from the Zwicky Transient Facility's (ZTF) data releases, including data gathered from multiple publicly available astronomical archives and data sources. Initially built to enable efficient expert feedback in the context of adaptive machine learning applications, it has evolved into a…
▽ More
We describe the SNAD Viewer, a web portal for astronomers which presents a centralized view of individual objects from the Zwicky Transient Facility's (ZTF) data releases, including data gathered from multiple publicly available astronomical archives and data sources. Initially built to enable efficient expert feedback in the context of adaptive machine learning applications, it has evolved into a full-fledged community asset that centralizes public information and provides a multi-dimensional view of ZTF sources. For users, we provide detailed descriptions of the data sources and choices underlying the information displayed in the portal. For developers, we describe our architectural choices and their consequences such that our experience can help others engaged in similar endeavors or in adapting our publicly released code to their requirements. The infrastructure we describe here is scalable and flexible and can be personalized and used by other surveys and for other science goals. The Viewer has been instrumental in highlighting the crucial roles domain experts retain in the era of big data in astronomy. Given the arrival of the upcoming generation of large-scale surveys, we believe similar systems will be paramount in enabling an optimal exploitation of the scientific potential enclosed in current terabyte and future petabyte-scale data sets. The Viewer is publicly available online at https://ztf.snad.space
△ Less
Submitted 3 March, 2023; v1 submitted 14 November, 2022;
originally announced November 2022.
-
The Young Supernova Experiment Data Release 1 (YSE DR1): Light Curves and Photometric Classification of 1975 Supernovae
Authors:
P. D. Aleo,
K. Malanchev,
S. Sharief,
D. O. Jones,
G. Narayan,
R. J. Foley,
V. A. Villar,
C. R. Angus,
V. F. Baldassare,
M. J. Bustamante-Rosell,
D. Chatterjee,
C. Cold,
D. A. Coulter,
K. W. Davis,
S. Dhawan,
M. R. Drout,
A. Engel,
K. D. French,
A. Gagliano,
C. Gall,
J. Hjorth,
M. E. Huber,
W. V. Jacobson-Galán,
C. D. Kilpatrick,
D. Langeroodi
, et al. (58 additional authors not shown)
Abstract:
We present the Young Supernova Experiment Data Release 1 (YSE DR1), comprised of processed multi-color Pan-STARRS1 (PS1) griz and Zwicky Transient Facility (ZTF) gr photometry of 1975 transients with host-galaxy associations, redshifts, spectroscopic/photometric classifications, and additional data products from 2019 November 24 to 2021 December 20. YSE DR1 spans discoveries and observations from…
▽ More
We present the Young Supernova Experiment Data Release 1 (YSE DR1), comprised of processed multi-color Pan-STARRS1 (PS1) griz and Zwicky Transient Facility (ZTF) gr photometry of 1975 transients with host-galaxy associations, redshifts, spectroscopic/photometric classifications, and additional data products from 2019 November 24 to 2021 December 20. YSE DR1 spans discoveries and observations from young and fast-rising supernovae (SNe) to transients that persist for over a year, with a redshift distribution reaching z~0.5. We present relative SN rates from YSE's magnitude- and volume-limited surveys, which are consistent with previously published values within estimated uncertainties for untargeted surveys. We combine YSE and ZTF data, and create multi-survey SN simulations to train the ParSNIP and SuperRAENN photometric classification algorithms; when validating our ParSNIP classifier on 472 spectroscopically classified YSE DR1 SNe, we achieve 82% accuracy across three SN classes (SNe Ia, II, Ib/Ic) and 90% accuracy across two SN classes (SNe Ia, core-collapse SNe). Our classifier performs particularly well on SNe Ia, with high (>90%) individual completeness and purity, which will help build an anchor photometric SNe Ia sample for cosmology. We then use our photometric classifier to characterize our photometric sample of 1483 SNe, labeling 1048 (~71%) SNe Ia, 339 (~23%) SNe II, and 96 (~6%) SNe Ib/Ic. YSE DR1 provides a training ground for building discovery, anomaly detection, and classification algorithms, performing cosmological analyses, understanding the nature of red and rare transients, exploring tidal disruption events and nuclear variability, and preparing for the forthcoming Vera C. Rubin Observatory Legacy Survey of Space and Time.
△ Less
Submitted 21 February, 2023; v1 submitted 14 November, 2022;
originally announced November 2022.
-
Perfecting our set of spectrophotometric standard DA white dwarfs
Authors:
A. Calamida,
T. Matheson,
E. W. Olszewski,
A. Saha,
Tim Axelrod,
C. Shanahan,
J. Holberg,
S. Points,
G. Narayan,
K. Malanchev,
R. Ridden-Harper,
N. Gentile-Fusillo,
R. Raddi,
R. Bohlin,
A. Rest,
I. Hubeny,
S. Deustua,
. J. Mackenty,
E. Sabbi,
C. W. Stubbs
Abstract:
We verified for photometric stability a set of DA white dwarfs with Hubble Space Telescope magnitudes from the near-ultraviolet to the near-infrared and ground-based spectroscopy by using time-spaced observations from the Las Cumbres Observatory network of telescopes. The initial list of 38 stars was whittled to 32 final ones which comprise a high quality set of spectrophotometric standards. These…
▽ More
We verified for photometric stability a set of DA white dwarfs with Hubble Space Telescope magnitudes from the near-ultraviolet to the near-infrared and ground-based spectroscopy by using time-spaced observations from the Las Cumbres Observatory network of telescopes. The initial list of 38 stars was whittled to 32 final ones which comprise a high quality set of spectrophotometric standards. These stars are homogeneously distributed around the sky and are all fainter than r ~ 16.5 mag. Their distribution is such that at least two of them would be available to be observed from any observatory on the ground at any time at airmass less than two. Light curves and different variability indices from the Las Cumbres Observatory data were used to determine the stability of the candidate standards. When available, Pan-STARRS1, Zwicky Transient Facility and TESS data were also used to confirm the star classification. Our analysis showed that four DA white dwarfs may exhibit evidence of photometric variability, while a fifth is cooler than our established lower temperature limit, and a sixth star might be a binary. In some instances, due to the presence of faint nearby red sources, care should be used when observing a few of the spectrophotometric standards with ground-based telescopes. Light curves and finding charts for all the stars are provided.
△ Less
Submitted 20 September, 2022;
originally announced September 2022.
-
Understanding of the properties of neural network approaches for transient light curve approximations
Authors:
Mariia Demianenko,
Konstantin Malanchev,
Ekaterina Samorodova,
Mikhail Sysak,
Aleksandr Shiriaev,
Denis Derkach,
Mikhail Hushchyn
Abstract:
Modern-day time-domain photometric surveys collect a lot of observations of various astronomical objects and the coming era of large-scale surveys will provide even more information on their properties. Spectroscopic follow-ups are especially crucial for transients such as supernovae and most of these objects have not been subject to such studies. }{Flux time series are actively used as an afforda…
▽ More
Modern-day time-domain photometric surveys collect a lot of observations of various astronomical objects and the coming era of large-scale surveys will provide even more information on their properties. Spectroscopic follow-ups are especially crucial for transients such as supernovae and most of these objects have not been subject to such studies. }{Flux time series are actively used as an affordable alternative for photometric classification and characterization, for instance, peak identifications and luminosity decline estimations. However, the collected time series are multidimensional and irregularly sampled, while also containing outliers and without any well-defined systematic uncertainties. This paper presents a search for the best-performing methods to approximate the observed light curves over time and wavelength for the purpose of generating time series with regular time steps in each passband.}{We examined several light curve approximation methods based on neural networks such as multilayer perceptrons, Bayesian neural networks, and normalizing flows to approximate observations of a single light curve. Test datasets include simulated PLAsTiCC and real Zwicky Transient Facility Bright Transient Survey light curves of transients.}{The tests demonstrate that even just a few observations are enough to fit the networks and improve the quality of approximation, compared to state-of-the-art models. The methods described in this work have a low computational complexity and are significantly faster than Gaussian processes. Additionally, we analyzed the performance of the approximation techniques from the perspective of further peak identification and transients classification. The study results have been released in an open and user-friendly Fulu Python library available on GitHub for the scientific community.
△ Less
Submitted 16 September, 2023; v1 submitted 15 September, 2022;
originally announced September 2022.
-
Supernova search with active learning in ZTF DR3
Authors:
Maria V. Pruzhinskaya,
Emille E. O. Ishida,
Alexandra K. Novinskaya,
Etienne Russeil,
Alina A. Volnova,
Konstantin L. Malanchev,
Matwey V. Kornilov,
Patrick D. Aleo,
Vladimir S. Korolev,
Vadim V. Krushinsky,
Sreevarsha Sreejith,
Emmanuel Gangler
Abstract:
We provide the first results from the complete SNAD adaptive learning pipeline in the context of a broad scope of data from large-scale astronomical surveys. The main goal of this work is to explore the potential of adaptive learning techniques in application to big data sets. Our SNAD team used Active Anomaly Discovery (AAD) as a tool to search for new supernova (SN) candidates in the photometric…
▽ More
We provide the first results from the complete SNAD adaptive learning pipeline in the context of a broad scope of data from large-scale astronomical surveys. The main goal of this work is to explore the potential of adaptive learning techniques in application to big data sets. Our SNAD team used Active Anomaly Discovery (AAD) as a tool to search for new supernova (SN) candidates in the photometric data from the first 9.4 months of the Zwicky Transient Facility (ZTF) survey, namely, between March 17 and December 31 2018 (58194 < MJD < 58483). We analysed 70 ZTF fields at a high galactic latitude and visually inspected 2100 outliers. This resulted in 104 SN-like objects being found, 57 of which were reported to the Transient Name Server for the first time and with 47 having previously been mentioned in other catalogues, either as SNe with known types or as SN candidates. We visually inspected the multi-colour light curves of the non-catalogued transients and performed fittings with different supernova models to assign it to a probable photometric class: Ia, Ib/c, IIP, IIL, or IIn. Moreover, we also identified unreported slow-evolving transients that are good superluminous SN candidates, along with a few other non-catalogued objects, such as red dwarf flares and active galactic nuclei. Beyond confirming the effectiveness of human-machine integration underlying the AAD strategy, our results shed light on potential leaks in currently available pipelines. These findings can help avoid similar losses in future large-scale astronomical surveys. Furthermore, the algorithm enables direct searches of any type of data and based on any definition of an anomaly set by the expert.
△ Less
Submitted 27 March, 2023; v1 submitted 18 August, 2022;
originally announced August 2022.
-
Rubin Observatory LSST Transients and Variable Stars Roadmap
Authors:
Kelly M. Hambleton,
Federica B. Bianco,
Rachel Street,
Keaton Bell,
David Buckley,
Melissa Graham,
Nina Hernitschek,
Michael B. Lund,
Elena Mason,
Joshua Pepper,
Andrej Prsa,
Markus Rabus,
Claudia M. Raiteri,
Robert Szabo,
Paula Szkody,
Igor Andreoni,
Simone Antoniucci,
Barbara Balmaverde,
Eric Bellm,
Rosaria Bonito,
Giuseppe Bono,
Maria Teresa Botticella,
Enzo Brocato,
Katja Bucar Bricman,
Enrico Cappellaro
, et al. (57 additional authors not shown)
Abstract:
The Vera C. Rubin Legacy Survey of Space and Time holds the potential to revolutionize time domain astrophysics, reaching completely unexplored areas of the Universe and mapping variability time scales from minutes to a decade. To prepare to maximize the potential of the Rubin LSST data for the exploration of the transient and variable Universe, one of the four pillars of Rubin LSST science, the T…
▽ More
The Vera C. Rubin Legacy Survey of Space and Time holds the potential to revolutionize time domain astrophysics, reaching completely unexplored areas of the Universe and mapping variability time scales from minutes to a decade. To prepare to maximize the potential of the Rubin LSST data for the exploration of the transient and variable Universe, one of the four pillars of Rubin LSST science, the Transient and Variable Stars Science Collaboration, one of the eight Rubin LSST Science Collaborations, has identified research areas of interest and requirements, and paths to enable them. While our roadmap is ever-evolving, this document represents a snapshot of our plans and preparatory work in the final years and months leading up to the survey's first light.
△ Less
Submitted 8 August, 2022;
originally announced August 2022.
-
Supernova Light Curves Approximation based on Neural Network Models
Authors:
Mariia Demianenko,
Ekaterina Samorodova,
Mikhail Sysak,
Aleksandr Shiriaev,
Konstantin Malanchev,
Denis Derkach,
Mikhail Hushchyn
Abstract:
Photometric data-driven classification of supernovae becomes a challenge due to the appearance of real-time processing of big data in astronomy. Recent studies have demonstrated the superior quality of solutions based on various machine learning models. These models learn to classify supernova types using their light curves as inputs. Preprocessing these curves is a crucial step that significantly…
▽ More
Photometric data-driven classification of supernovae becomes a challenge due to the appearance of real-time processing of big data in astronomy. Recent studies have demonstrated the superior quality of solutions based on various machine learning models. These models learn to classify supernova types using their light curves as inputs. Preprocessing these curves is a crucial step that significantly affects the final quality. In this talk, we study the application of multilayer perceptron (MLP), bayesian neural network (BNN), and normalizing flows (NF) to approximate observations for a single light curve. We use these approximations as inputs for supernovae classification models and demonstrate that the proposed methods outperform the state-of-the-art based on Gaussian processes applying to the Zwicky Transient Facility Bright Transient Survey light curves. MLP demonstrates similar quality as Gaussian processes and speed increase. Normalizing Flows exceeds Gaussian processes in terms of approximation quality as well.
△ Less
Submitted 27 June, 2022;
originally announced June 2022.
-
SNAD Transient Miner: Finding Missed Transient Events in ZTF DR4 using k-D trees
Authors:
P. D. Aleo,
K. L. Malanchev,
M. V. Pruzhinskaya,
E. E. O. Ishida,
E. Russeil,
M. V. Kornilov,
V. S. Korolev,
S. Sreejith,
A. A. Volnova,
G. S. Narayan
Abstract:
We report the automatic detection of 11 transients (7 possible supernovae and 4 active galactic nuclei candidates) within the Zwicky Transient Facility fourth data release (ZTF DR4), all of them observed in 2018 and absent from public catalogs. Among these, three were not part of the ZTF alert stream. Our transient mining strategy employs 41 physically motivated features extracted from both real l…
▽ More
We report the automatic detection of 11 transients (7 possible supernovae and 4 active galactic nuclei candidates) within the Zwicky Transient Facility fourth data release (ZTF DR4), all of them observed in 2018 and absent from public catalogs. Among these, three were not part of the ZTF alert stream. Our transient mining strategy employs 41 physically motivated features extracted from both real light curves and four simulated light curve models (SN Ia, SN II, TDE, SLSN-I). These features are input to a k-D tree algorithm, from which we calculate the 15 nearest neighbors. After pre-processing and selection cuts, our dataset contained approximately a million objects among which we visually inspected the 105 closest neighbors from seven of our brightest, most well-sampled simulations, comprising 89 unique ZTF DR4 sources. Our result illustrates the potential of coherently incorporating domain knowledge and automatic learning algorithms, which is one of the guiding principles directing the SNAD team. It also demonstrates that the ZTF DR is a suitable testing ground for data mining algorithms aiming to prepare for the next generation of astronomical data.
△ Less
Submitted 4 May, 2022; v1 submitted 22 November, 2021;
originally announced November 2021.
-
Physical modeling of viscous disc evolution around magnetized neutron star. Aql X-1 2013 outburst decay
Authors:
Galina Lipunova,
Konstantin Malanchev,
Sergey Tsygankov,
Nikolai Shakura,
Andrei Tavleev,
Dmitry Kolesnikov
Abstract:
We present a model of a viscously evolving accretion disc around a magnetized neutron star. The model features the varying outer radius of the hot ionized part of the disc due to cooling and the varying inner radius of the disc due to interaction with the magnetosphere. It also includes hindering of accretion on the neutron star because of the centrifugal barrier and irradiation of the outer disc…
▽ More
We present a model of a viscously evolving accretion disc around a magnetized neutron star. The model features the varying outer radius of the hot ionized part of the disc due to cooling and the varying inner radius of the disc due to interaction with the magnetosphere. It also includes hindering of accretion on the neutron star because of the centrifugal barrier and irradiation of the outer disc and companion star by X-rays from the neutron star and disc. When setting inner boundary conditions, we take into account that processes at the inner disc occur on a time scale much less than the viscous time scale of the whole disc. We consider three types of outflow from the disc inner edge: zero outflow, one based on MHD calculations, and a very efficient propeller mechanism. The light curves of an X-ray transient after the outburst peak can be calculated by a corresponding, publicly available code. We compare observed light curves of the 2013 burst of Aql X-1 in X-ray and optical bands with modeled ones. We find that the fast drop of the $0.3-10$ keV flux can be solely explained by a radial shrinking of the hot disc. At the same time, models with the neutron star magnetic field $>10^8$ G have better fits because the accretion efficiency behaviour emphasizes the 'knee' on the light curve. We also find that a plato emission can be produced by a disc-reservoir with stalled accretion.
△ Less
Submitted 15 December, 2021; v1 submitted 15 October, 2021;
originally announced October 2021.
-
El-CID: A filter for Gravitational-wave Electromagnetic Counterpart Identification
Authors:
Deep Chatterjee,
Gautham Narayan,
Patrick D. Aleo,
Konstantin Malanchev,
Daniel Muthukrishna
Abstract:
As gravitational-wave (GW) interferometers become more sensitive and probe ever more distant reaches, the number of detected binary neutron star mergers will increase. However, detecting more events farther away with GWs does not guarantee corresponding increase in the number of electromagnetic counterparts of these events. Current and upcoming wide-field surveys that participate in GW follow-up o…
▽ More
As gravitational-wave (GW) interferometers become more sensitive and probe ever more distant reaches, the number of detected binary neutron star mergers will increase. However, detecting more events farther away with GWs does not guarantee corresponding increase in the number of electromagnetic counterparts of these events. Current and upcoming wide-field surveys that participate in GW follow-up operations will have to contend with distinguishing the kilonova from the ever increasing number of transients they detect, many of which will be consistent with the GW sky-localization. We have developed a novel tool based on a temporal convolutional neural network architecture, trained on sparse early-time photometry and contextual information for Electromagnetic Counterpart Identification (El-CID). The overarching goal for El-CID is to slice through list of new transient candidates that are consistent with the GW sky localization, and determine which sources are consistent with kilonovae, allowing limited target-of-opportunity resources to be used judiciously. In addition to verifying the performance of our algorithm on an extensive testing sample, we validate it on AT2017gfo - the only EM counterpart of a binary neutron star merger discovered to date - and AT2019npv - a supernova that was initially suspected as a counterpart of the gravitational-wave event, GW190814, but was later ruled out after further analysis.
△ Less
Submitted 11 October, 2021; v1 submitted 9 August, 2021;
originally announced August 2021.
-
Change in the orbital period of a binary system due to an outburst in a windy accretion disc
Authors:
A. L. Avakyan,
G. V. Lipunova,
K. L. Malanchev,
N. I. Shakura
Abstract:
We consider a new mechanism for the removal of the angular momentum from an X-ray binary system and the change in its orbital period - the mass loss in the form of a wind from an accretion disc. Both observations and models predict powerful winds from discs in X-ray transients. We have obtained an analytical estimate for the increase in the orbital period of a binary system with a wind from the di…
▽ More
We consider a new mechanism for the removal of the angular momentum from an X-ray binary system and the change in its orbital period - the mass loss in the form of a wind from an accretion disc. Both observations and models predict powerful winds from discs in X-ray transients. We have obtained an analytical estimate for the increase in the orbital period of a binary system with a wind from the disc during an outburst, and quantitative estimates are given for the systems XTE J1118+480, A0620-00 and GRS 1124-68. Resulting rate of period grow is of order of the observed rates of secular decrease in the period. We also compare the predicted rate of change in the period of a binary system due to the flow of matter into the disc and outflow from the second Lagrange point with the observations. It is concluded that the above mechanisms cannot explain the observed secular decrease in the period of the three X-ray Novae, and it is necessary to consider a circumbinary disc that drains the binary's angular momentum.
△ Less
Submitted 25 May, 2021;
originally announced May 2021.
-
New SU UMa-type star ZTF18abdlzhd in the Zwicky Transient Facility data
Authors:
Sergei V. Antipin,
Alexandra M. Zubareva,
Aleksandr A. Belinski,
Marina A. Burlak,
Natalia P. Ikonnikova,
Konstantin L. Malanchev,
Matwey V. Kornilov,
Egor O. Mishin
Abstract:
We carried out a search for unknown dwarf novae in a public data release of the Zwicky Transient Facility survey and suspected that the object ZTF18abdlzhd is a SU UMa-type star. Performed multicolor CCD observations permit us to follow its fading from an outburst in August and an entire superoutburst in October 2020. The duration of the superoutburst is 13 days. We detected superhumps with period…
▽ More
We carried out a search for unknown dwarf novae in a public data release of the Zwicky Transient Facility survey and suspected that the object ZTF18abdlzhd is a SU UMa-type star. Performed multicolor CCD observations permit us to follow its fading from an outburst in August and an entire superoutburst in October 2020. The duration of the superoutburst is 13 days. We detected superhumps with period P = 0.06918(3) d that are characteristic of UGSU type stars.
△ Less
Submitted 4 March, 2021;
originally announced March 2021.
-
Anomaly detection in the Zwicky Transient Facility DR3
Authors:
K. L. Malanchev,
M. V. Pruzhinskaya,
V. S. Korolev,
P. D. Aleo,
M. V. Kornilov,
E. E. O. Ishida,
V. V. Krushinsky,
F. Mondon,
S. Sreejith,
A. A. Volnova,
A. A. Belinski,
A. V. Dodin,
A. M. Tatarnikov,
S. G. Zheltoukhov
Abstract:
We present results from applying the SNAD anomaly detection pipeline to the third public data release of the Zwicky Transient Facility (ZTF DR3). The pipeline is composed of 3 stages: feature extraction, search of outliers with machine learning algorithms and anomaly identification with followup by human experts. Our analysis concentrates in three ZTF fields, comprising more than 2.25 million obje…
▽ More
We present results from applying the SNAD anomaly detection pipeline to the third public data release of the Zwicky Transient Facility (ZTF DR3). The pipeline is composed of 3 stages: feature extraction, search of outliers with machine learning algorithms and anomaly identification with followup by human experts. Our analysis concentrates in three ZTF fields, comprising more than 2.25 million objects. A set of 4 automatic learning algorithms was used to identify 277 outliers, which were subsequently scrutinised by an expert. From these, 188 (68%) were found to be bogus light curves -- including effects from the image subtraction pipeline as well as overlapping between a star and a known asteroid, 66 (24%) were previously reported sources whereas 23 (8%) correspond to non-catalogued objects, with the two latter cases of potential scientific interest (e. g. 1 spectroscopically confirmed RS Canum Venaticorum star, 4 supernovae candidates, 1 red dwarf flare). Moreover, using results from the expert analysis, we were able to identify a simple bi-dimensional relation which can be used to aid filtering potentially bogus light curves in future studies. We provide a complete list of objects with potential scientific application so they can be further scrutinised by the community. These results confirm the importance of combining automatic machine learning algorithms with domain knowledge in the construction of recommendation systems for astronomy. Our code is publicly available at https://github.com/snad-space/zwad
△ Less
Submitted 2 February, 2021; v1 submitted 2 December, 2020;
originally announced December 2020.
-
The Young Supernova Experiment: Survey Goals, Overview, and Operations
Authors:
D. O. Jones,
R. J. Foley,
G. Narayan,
J. Hjorth,
M. E. Huber,
P. D. Aleo,
K. D. Alexander,
C. R. Angus,
K. Auchettl,
V. F. Baldassare,
S. H. Bruun,
K. C. Chambers,
D. Chatterjee,
D. L. Coppejans,
D. A. Coulter,
L. DeMarchi,
G. Dimitriadis,
M. R. Drout,
A. Engel,
K. D. French,
A. Gagliano,
C. Gall,
T. Hung,
L. Izzo,
W. V. Jacobson-Galán
, et al. (46 additional authors not shown)
Abstract:
Time domain science has undergone a revolution over the past decade, with tens of thousands of new supernovae (SNe) discovered each year. However, several observational domains, including SNe within days or hours of explosion and faint, red transients, are just beginning to be explored. Here, we present the Young Supernova Experiment (YSE), a novel optical time-domain survey on the Pan-STARRS tele…
▽ More
Time domain science has undergone a revolution over the past decade, with tens of thousands of new supernovae (SNe) discovered each year. However, several observational domains, including SNe within days or hours of explosion and faint, red transients, are just beginning to be explored. Here, we present the Young Supernova Experiment (YSE), a novel optical time-domain survey on the Pan-STARRS telescopes. Our survey is designed to obtain well-sampled $griz$ light curves for thousands of transient events up to $z \approx 0.2$. This large sample of transients with 4-band light curves will lay the foundation for the Vera C. Rubin Observatory and the Nancy Grace Roman Space Telescope, providing a critical training set in similar filters and a well-calibrated low-redshift anchor of cosmologically useful SNe Ia to benefit dark energy science. As the name suggests, YSE complements and extends other ongoing time-domain surveys by discovering fast-rising SNe within a few hours to days of explosion. YSE is the only current four-band time-domain survey and is able to discover transients as faint $\sim$21.5 mag in $gri$ and $\sim$20.5 mag in $z$, depths that allow us to probe the earliest epochs of stellar explosions. YSE is currently observing approximately 750 square degrees of sky every three days and we plan to increase the area to 1500 square degrees in the near future. When operating at full capacity, survey simulations show that YSE will find $\sim$5000 new SNe per year and at least two SNe within three days of explosion per month. To date, YSE has discovered or observed 8.3% of the transient candidates reported to the International Astronomical Union in 2020. We present an overview of YSE, including science goals, survey characteristics and a summary of our transient discoveries to date.
△ Less
Submitted 5 January, 2021; v1 submitted 19 October, 2020;
originally announced October 2020.
-
Photometric Data-driven Classification of Type Ia Supernovae in the Open Supernova Catalog
Authors:
Stanislav Dobryakov,
Konstantin Malanchev,
Denis Derkach,
Mikhail Hushchyn
Abstract:
We propose a novel approach for a machine-learning-based detection of the type Ia supernovae using photometric information. Unlike other approaches, only real observation data is used during training. Despite being trained on a relatively small sample, the method shows good results on real data from the Open Supernovae Catalog. We also investigate model transfer from the PLAsTiCC simulations train…
▽ More
We propose a novel approach for a machine-learning-based detection of the type Ia supernovae using photometric information. Unlike other approaches, only real observation data is used during training. Despite being trained on a relatively small sample, the method shows good results on real data from the Open Supernovae Catalog. We also investigate model transfer from the PLAsTiCC simulations train dataset to real data application, and the reverse, and find the performance significantly decreases in both cases, highlighting the existing differences between simulated and real data.
△ Less
Submitted 9 February, 2021; v1 submitted 18 June, 2020;
originally announced June 2020.
-
Active Anomaly Detection for time-domain discoveries
Authors:
Emille E. O. Ishida,
Matwey V. Kornilov,
Konstantin L. Malanchev,
Maria V. Pruzhinskaya,
Alina A. Volnova,
Vladimir S. Korolev,
Florian Mondon,
Sreevarsha Sreejith,
Anastasia Malancheva,
Shubhomoy Das
Abstract:
We present the first evidence that adaptive learning techniques can boost the discovery of unusual objects within astronomical light curve data sets. Our method follows an active learning strategy where the learning algorithm chooses objects which can potentially improve the learner if additional information about them is provided. This new information is subsequently used to update the machine le…
▽ More
We present the first evidence that adaptive learning techniques can boost the discovery of unusual objects within astronomical light curve data sets. Our method follows an active learning strategy where the learning algorithm chooses objects which can potentially improve the learner if additional information about them is provided. This new information is subsequently used to update the machine learning model, allowing its accuracy to evolve with each new information. For the case of anomaly detection, the algorithm aims to maximize the number of scientifically interesting anomalies presented to the expert by slightly modifying the weights of a traditional Isolation Forest (IF) at each iteration. In order to demonstrate the potential of such techniques, we apply the Active Anomaly Discovery (AAD) algorithm to 2 data sets: simulated light curves from the PLAsTiCC challenge and real light curves from the Open Supernova Catalog. We compare the AAD results to those of a static IF. For both methods, we performed a detailed analysis for all objects with the ~2% highest anomaly scores. We show that, in the real data scenario, AAD was able to identify ~80\% more true anomalies than the IF. This result is the first evidence that AAD algorithms can play a central role in the search for new physics in the era of large scale sky surveys.
△ Less
Submitted 14 July, 2020; v1 submitted 29 September, 2019;
originally announced September 2019.
-
Anomaly Detection in the Open Supernova Catalog
Authors:
Maria V. Pruzhinskaya,
Konstantin L. Malanchev,
Matwey V. Kornilov,
Emille E. O. Ishida,
Florian Mondon,
Alina A. Volnova,
Vladimir S. Korolev
Abstract:
In the upcoming decade large astronomical surveys will discover millions of transients raising unprecedented data challenges in the process. Only the use of the machine learning algorithms can process such large data volumes. Most of the discovered transients will belong to the known classes of astronomical objects. However, it is expected that some transients will be rare or completely new events…
▽ More
In the upcoming decade large astronomical surveys will discover millions of transients raising unprecedented data challenges in the process. Only the use of the machine learning algorithms can process such large data volumes. Most of the discovered transients will belong to the known classes of astronomical objects. However, it is expected that some transients will be rare or completely new events of unknown physical nature. The task of finding them can be framed as an anomaly detection problem. In this work, we perform for the first time an automated anomaly detection analysis in the photometric data of the Open Supernova Catalog (OSC), which serves as a proof of concept for the applicability of these methods to future large scale surveys. The analysis consists of the following steps: 1) data selection from the OSC and approximation of the pre-processed data with Gaussian processes, 2) dimensionality reduction, 3) searching for outliers with the use of the isolation forest algorithm, 4) expert analysis of the identified outliers. The pipeline returned 81 candidate anomalies, 27 (33%) of which were confirmed to be from astrophysically peculiar objects. Found anomalies correspond to a selected sample of 1.4% of the initial automatically identified data sample of ~2000 objects. Among the identified outliers we recognised superluminous supernovae, non-classical Type Ia supernovae, unusual Type II supernovae, one active galactic nucleus and one binary microlensing event. We also found that 16 anomalies classified as supernovae in the literature are likely to be quasars or stars. Our proposed pipeline represents an effective strategy to guarantee we shall not overlook exciting new science hidden in the data we fought so hard to acquire. All code and products of this investigation are made publicly available.
△ Less
Submitted 22 August, 2019; v1 submitted 27 May, 2019;
originally announced May 2019.
-
Fips: an OpenGL based FITS viewer
Authors:
Matwey Kornilov,
Konstantin Malanchev
Abstract:
FITS (Flexible Image Transport System) is a common format for astronomical data storage. It was first standardised in the early 1980s. Even though astronomical data is now processed mostly using software, visual data inspection by a human is still important during equipment or software commissioning and while observing. We present Fips, a cross-platform FITS file viewer open source software. To th…
▽ More
FITS (Flexible Image Transport System) is a common format for astronomical data storage. It was first standardised in the early 1980s. Even though astronomical data is now processed mostly using software, visual data inspection by a human is still important during equipment or software commissioning and while observing. We present Fips, a cross-platform FITS file viewer open source software. To the best of our knowledge, it is for the first time that the image rendering algorithms are implemented mostly on GPU (graphics processing unit). We show that it is possible to implement a fully-capable FITS viewer using OpenGL interface. We also emphasise the advantages of using GPUs for efficient image handling.
△ Less
Submitted 29 January, 2019;
originally announced January 2019.
-
Changing-look Narrow-Line Seyfert 1s?
Authors:
Victor L. Oknyansky,
Konstantin L. Malanchev,
C. Martin Gaskell
Abstract:
Two major challenges to unification schemes for active galactic nuclei (AGN) are the existence of Narrow-Line Seyfert 1s (NLS1s) and the existence of changing-look (CL) AGNs. AGNs can drastically change their spectral appearance in the optical (changing their Seyfert type) and/or in the X-ray region. We illustrate the CL phenomenon with our multi-wavelength monitoring of NGC 2617 and discuss its p…
▽ More
Two major challenges to unification schemes for active galactic nuclei (AGN) are the existence of Narrow-Line Seyfert 1s (NLS1s) and the existence of changing-look (CL) AGNs. AGNs can drastically change their spectral appearance in the optical (changing their Seyfert type) and/or in the X-ray region. We illustrate the CL phenomenon with our multi-wavelength monitoring of NGC 2617 and discuss its properties compared with NLS1s. There are few examples of CL NLS1s and the changes are mostly only in the X-ray region. It has been proposed that some of these could be cases of a tidal-disruption events (TDE) or supernova events. If BLRs have a flat geometry and NLS1s are seen face-on then we have to see CL cases only if the orientation of the BLR changes as a result of a TDE or a close encounter of a star without a TDE. If NLS1s include both high Eddington accretion rate and low-inclination AGNs then a significant fraction of NLS1s could be obscured and would not be identified as NLS1s. CL cases might happen more in such objects if dust sublimation occurs following a strong increase in the optical luminosity.
△ Less
Submitted 6 July, 2019; v1 submitted 20 October, 2018;
originally announced October 2018.
-
Multi-wavelenth monitoring of the changing-look AGN NGC 2617 during state changes
Authors:
V. L. Oknyansky,
C. M. Gaskell,
N. A. Huseynov,
Kh. M. Mikailov,
V. M. Lipunov,
N. I. Shatsky,
S. S. Tsygankov,
E. S. Gorbovskoy,
A. M. Tatarnikov,
V. G. Metlov,
K. L. Malanchev,
M. B. Brotherton,
D. Kasper,
P. Du,
X. Chen,
M. A. Burlak,
D. A. H. Buckley,
R. Rebolo,
M. Serra-Ricart,
R. Podesta,
H. Levato
Abstract:
Optical and near-infrared photometry, optical spectroscopy, and soft X-ray and UV monitoring of the changing-look active galactic nucleus NGC 2617 show that it continues to have the appearance of a type-1 Seyfert galaxy. An optical light curve for 2010$-$2017 indicates that the change of type probably occurred between 2010 October and 2012 February and was not related to the brightening in 2013. I…
▽ More
Optical and near-infrared photometry, optical spectroscopy, and soft X-ray and UV monitoring of the changing-look active galactic nucleus NGC 2617 show that it continues to have the appearance of a type-1 Seyfert galaxy. An optical light curve for 2010$-$2017 indicates that the change of type probably occurred between 2010 October and 2012 February and was not related to the brightening in 2013. In 2016 and 2017 NGC 2617 brightened again to a level of activity close to that in 2013 April. However, in 2017 from the end of the March to end of July 2017 it was in very low level and starting to change back to a Seyfert 1.8. We find variations in all passbands and in both the intensities and profiles of the broad Balmer lines. A new displaced emission peak has appeared in H$β$. X-ray variations are well correlated with UV$-$optical variability and possibly lead by $\sim$ 2$-$3 d. The $K$ band lags the $J$ band by about 21.5 $\pm$ 2.5 d and lags the combined $B + J$ bands by $\sim$ 25 d. $J$ lags $B$ by $\sim$ 3 d. This could be because $J$-band variability arises predominantly from the outer part of the accretion disc, while $K$-band variability is dominated by thermal re-emission by dust. We propose that spectral-type changes are a result of increasing central luminosity causing sublimation of the innermost dust in the hollow bi-conical outflow. We briefly discuss various other possible reasons that might explain the dramatic changes in NGC 2617.
△ Less
Submitted 17 July, 2021; v1 submitted 7 November, 2017;
originally announced November 2017.
-
Anomalous eclipses of the young star RW Aur A
Authors:
S. Lamzin,
D. Cheryasov,
G. Chuntonov,
A. Dodin,
K. Grankin,
K. Malanchev,
A. Nadzhip,
B. Safonov,
D. Shakhovskoy,
V. Shenavrin,
A. Tatarnikov,
O. Vozyakova
Abstract:
Results of UBVRIJHKLM photometry, VRI polarimetry and optical spectroscopy of a young star RW Aur A obtained during 2010-11 and 2014-16 dimming events are presented. During the second dimming the star decreased its brightness to ΔV > 4.5 mag, polarization of its light in I-band was up to 30%, and color-magnitude diagram was similar to that of UX Ori type stars. We conclude that the reason of both…
▽ More
Results of UBVRIJHKLM photometry, VRI polarimetry and optical spectroscopy of a young star RW Aur A obtained during 2010-11 and 2014-16 dimming events are presented. During the second dimming the star decreased its brightness to ΔV > 4.5 mag, polarization of its light in I-band was up to 30%, and color-magnitude diagram was similar to that of UX Ori type stars. We conclude that the reason of both dimmings is an eclipses of the star by dust screen, but the size of the screen is much larger than in the case of UXORs.
△ Less
Submitted 30 July, 2017;
originally announced July 2017.
-
3D modelling of accretion disc in eclipsing binary system V1239 Her
Authors:
V. V. Lukin,
K. L. Malanchev,
N. I. Shakura,
K. A. Postnov,
V. M. Chechetkin,
V. P. Utrobin
Abstract:
We present the results of 3D-hydrodynamical simulations of accretion flow in the eclipsing dwarf nova V1239 Her in quiescence. The model includes the optical star filling its Roche lobe, a gas stream emanating from the inner Lagrangian point of the binary system, and the accretion disc structure. A cold hydrogen gas stream is initially emitted towards a point-like gravitational centre. A stationar…
▽ More
We present the results of 3D-hydrodynamical simulations of accretion flow in the eclipsing dwarf nova V1239 Her in quiescence. The model includes the optical star filling its Roche lobe, a gas stream emanating from the inner Lagrangian point of the binary system, and the accretion disc structure. A cold hydrogen gas stream is initially emitted towards a point-like gravitational centre. A stationary accretion disc is formed in about 15 orbital periods after the beginning of accretion. The model takes into account partial ionization of hydrogen and uses realistic cooling function for hydrogen. The light curve of the system is calculated as the volume emission of optically thin layers along the line of sight up to the optical depth τ=2/3 calculated using Planck-averaged opacities. The calculated eclipse light curves show good agreement with observations, with the changing shape of pre-eclipse and post-eclipse light curves being explained entirely due to ~ 50% variations in the mass accretion rate through the gas stream.
△ Less
Submitted 15 February, 2017; v1 submitted 2 February, 2017;
originally announced February 2017.
-
The curtain remains open: NGC 2617 continues in a high state
Authors:
V. L. Oknyansky,
C. M. Gaskell,
N. A. Huseynov,
V. M. Lipunov,
N. I. Shatsky,
S. S. Tsygankov,
E. S. Gorbovskoy,
Kh. M. Mikailov,
A. M. Tatarnikov,
D. A. H. Buckley,
V. G. Metlov,
A. E. Nadzhip,
A. S. Kuznetsov,
P. V. Balanutza,
M. A. Burlak,
G. A. Galazutdinov,
B. P. Artamonov,
I. R. Salmanov,
K. L. Malanchev,
R. S. Oknyansky
Abstract:
Optical and near-infrared photometry, optical spectroscopy, and soft X-ray and UV monitoring of the changing look active galactic nucleus NGC 2617 show that it continues to have the appearance of a type-1 Seyfert galaxy. An optical light curve for 2010-2016 indicates that the change of type probably occurred between 2010 October and 2012 February and was not related to the brightening in 2013. In…
▽ More
Optical and near-infrared photometry, optical spectroscopy, and soft X-ray and UV monitoring of the changing look active galactic nucleus NGC 2617 show that it continues to have the appearance of a type-1 Seyfert galaxy. An optical light curve for 2010-2016 indicates that the change of type probably occurred between 2010 October and 2012 February and was not related to the brightening in 2013. In 2016 NGC 2617 brightened again to a level of activity close to that in 2013 April. We find variations in all passbands and in both the intensities and profiles of the broad Balmer lines. A new displaced emission peak has appeared in H$β$. X-ray variations are well correlated with UV-optical variability and possibly lead by $\sim$ 2-3 d. The $K$ band lags the $J$ band by about 21.5 $\pm$ 2.5 d. and lags the combined $B+J$ filters by $\sim$ 25 d. $J$ lags $B$ by about 3 d. This could be because $J$-band variability arises from the outer part of the accretion disc, while $K$-band variability comes from thermal re-emission by dust. We propose that spectral-type changes are a result of increasing central luminosity causing sublimation of the innermost dust in the hollow biconical outflow. We briefly discuss various other possible reasons that might explain the dramatic changes in NGC 2617.
△ Less
Submitted 23 August, 2021; v1 submitted 18 January, 2017;
originally announced January 2017.
-
Determination of the turbulent parameter in the accretion disks: effects of self-irradiation in 4U 1543-47 during the 2002 outburst
Authors:
G. V. Lipunova,
K. L. Malanchev
Abstract:
We investigate the viscous evolution of the accretion disk in 4U 1543-47, a black hole binary system, during the first 30 days after the peak of the 2002 burst by comparing the observed and theoretical accretion rate evolution $\dot M(t)$. The observed $\dot M(t)$ is obtained from spectral modelling of the archival RXTE/PCA data. Different scenarios of disk decay evolution are possible depending o…
▽ More
We investigate the viscous evolution of the accretion disk in 4U 1543-47, a black hole binary system, during the first 30 days after the peak of the 2002 burst by comparing the observed and theoretical accretion rate evolution $\dot M(t)$. The observed $\dot M(t)$ is obtained from spectral modelling of the archival RXTE/PCA data. Different scenarios of disk decay evolution are possible depending on a degree of self-irradiation of the disk by the emission from its centre. If the self-irradiation, which is parametrized by factor $C_\mathrm{irr}$, had been as high as $\sim 5\times10^{-3}$, then the disk would have been completely ionized up to the tidal radius and the short time of the decay would have required the turbulent parameter $α\sim 3$. We find that the shape of the $\dot M(t)$ curve is much better explained in a model with a shrinking high-viscosity zone. If $C_\mathrm{irr}\approx(2-3)\times 10^{-4}$, the resulting $α$ lie in the interval $0.5-1.5$ for the black hole masses in the range $6-10~\mathrm{M}_\odot$, while the radius of the ionized disk is variable and controlled by irradiation. For very weak irradiation, $C_\mathrm{irr} < 1.5 \times10^{-4}$, the burst decline develops as in normal outbursts of dwarf novae with $α\sim 0.08-0.32$. The optical data indicate that $C_\mathrm{irr}$ in 4U 1543-47 (2002) was not greater than approximately $(3-6)\times10^{-4}$. Generally, modelling of an X-ray nova burst allows one to estimate $α$ that depends on the black hole parameters. We present the public 1-D code Freddi to model the viscous evolution of an accretion disk. Analytic approximations are derived to estimate $α$ in X-ray novae using $\dot M(t)$.
△ Less
Submitted 29 September, 2023; v1 submitted 5 October, 2016;
originally announced October 2016.
-
Convection in axially symmetric accretion discs with microscopic transport coefficients
Authors:
K. L. Malanchev,
K. A. Postnov,
N. I. Shakura
Abstract:
The vertical structure of stationary thin accretion discs is calculated from the energy balance equation with heat generation due to microscopic ion viscosity η and electron heat conductivity κ, both depending on temperature. In the optically thin discs it is found that for the heat conductivity increasing with temperature, the vertical temperature gradient exceeds the adiabatic value at some heig…
▽ More
The vertical structure of stationary thin accretion discs is calculated from the energy balance equation with heat generation due to microscopic ion viscosity η and electron heat conductivity κ, both depending on temperature. In the optically thin discs it is found that for the heat conductivity increasing with temperature, the vertical temperature gradient exceeds the adiabatic value at some height, suggesting convective instability in the upper disc layer. There is a critical Prandtl number, Pr = 4/9, above which a Keplerian disc become fully convective. The vertical density distribution of optically thin laminar accretion discs as found from the hydrostatic equilibrium equation cannot be generally described by a polytrope but in the case of constant viscosity and heat conductivity. In the optically thick discs with radiation heat transfer, the vertical disc structure is found to be convectively stable for both absorption dominated and scattering dominated opacities, unless a very steep dependence of the viscosity coefficient on temperature is assumed. A polytropic-like structure in this case is found for Thomson scattering dominated opacity.
△ Less
Submitted 8 February, 2017; v1 submitted 13 September, 2016;
originally announced September 2016.