Finding radio transients with anomaly detection and active learning based on volunteer classifications
Authors:
Alex Andersson,
Chris Lintott,
Rob Fender,
Michelle Lochner,
Patrick Woudt,
Jakob van den Eijnden,
Alexander van der Horst,
Assaf Horesh,
Payaswini Saikia,
Gregory R. Sivakoff,
Lilia Tremou,
Mattia Vaccari
Abstract:
In this work we explore the applicability of unsupervised machine learning algorithms to finding radio transients. Facilities such as the Square Kilometre Array (SKA) will provide huge volumes of data in which to detect rare transients; the challenge for astronomers is how to find them. We demonstrate the effectiveness of anomaly detection algorithms using 1.3 GHz light curves from the SKA precurs…
▽ More
In this work we explore the applicability of unsupervised machine learning algorithms to finding radio transients. Facilities such as the Square Kilometre Array (SKA) will provide huge volumes of data in which to detect rare transients; the challenge for astronomers is how to find them. We demonstrate the effectiveness of anomaly detection algorithms using 1.3 GHz light curves from the SKA precursor MeerKAT. We make use of three sets of descriptive parameters ('feature sets') as applied to two anomaly detection techniques in the Astronomaly package and analyse our performance by comparison with citizen science labels on the same dataset. Using transients found by volunteers as our ground truth, we demonstrate that anomaly detection techniques can recall over half of the radio transients in the 10 per cent of the data with the highest anomaly scores. We find that the choice of anomaly detection algorithm makes a minor difference, but that feature set choice is crucial, especially when considering available resources for human inspection and/or follow-up. Active learning, where human labels are given for just 2 per cent of the data, improves recall by up to 20 percentage points, depending on the combination of features and model used. The best performing results produce a factor of 5 times fewer sources requiring vetting by experts. This is the first effort to apply anomaly detection techniques to finding radio transients and shows great promise for application to other datasets, and as a real-time transient detection system for upcoming large surveys.
△ Less
Submitted 15 April, 2025; v1 submitted 1 October, 2024;
originally announced October 2024.
