-
Anomaly detection in radio galaxy data with trainable COSFIRE filters
Authors:
Steven Ndung'u,
Trienko Grobler,
Stefan J. Wijnholds,
George Azzopardi
Abstract:
Detecting anomalies in radio astronomy is challenging due to the vast amounts of data and the rarity of labeled anomalous examples. Addressing this challenge requires efficient methods capable of identifying unusual radio galaxy morphologies without relying on extensive supervision. This work introduces an innovative approach to anomaly detection based on morphological characteristics of the radio…
▽ More
Detecting anomalies in radio astronomy is challenging due to the vast amounts of data and the rarity of labeled anomalous examples. Addressing this challenge requires efficient methods capable of identifying unusual radio galaxy morphologies without relying on extensive supervision. This work introduces an innovative approach to anomaly detection based on morphological characteristics of the radio sources using trainable COSFIRE (Combination of Shifted Filter Responses) filters as an efficient alternative to complex deep learning methods. The framework integrates COSFIRE descriptors with an unsupervised Local Outlier Factor (LOF) algorithm to identify unusual radio galaxy morphologies. Evaluations on a radio galaxy benchmark data set demonstrate strong performance, with the COSFIRE-based approach achieving a geometric mean (G-Mean) score of 79%, surpassing the 77% achieved by a computationally intensive deep learning autoencoder. By characterizing normal patterns and detecting deviations, this semi-supervised methodology overcomes the need for anomalous examples in the training set, a major limitation of traditional supervised methods. This approach shows promise for next-generation radio telescopes, where fast processing and the ability to discover unknown phenomena are crucial.
△ Less
Submitted 24 May, 2025;
originally announced May 2025.
-
Content-Based Image Retrieval Using COSFIRE Descriptors with application to Radio Astronomy
Authors:
Steven Ndungu,
Trienko Grobler,
Stefan J. Wijnholds,
George Azzopardi
Abstract:
The morphologies of astronomical sources are highly complex, making it essential not only to classify the identified sources into their predefined categories but also to determine the sources that are most similar to a given query source. Image-based retrieval is essential, as it allows an astronomer with a source under study to ask a computer to sift through the large archived database of sources…
▽ More
The morphologies of astronomical sources are highly complex, making it essential not only to classify the identified sources into their predefined categories but also to determine the sources that are most similar to a given query source. Image-based retrieval is essential, as it allows an astronomer with a source under study to ask a computer to sift through the large archived database of sources to find the most similar ones. This is of particular interest if the source under study does not fall into a "known" category (anomalous). Our work uses the trainable COSFIRE (Combination of Shifted Filter Responses) approach for image retrieval. COSFIRE filters are automatically configured to extract the hyperlocal geometric arrangements that uniquely describe the morphological characteristics of patterns of interest in a given image; in this case astronomical sources. This is achieved by automatically examining the shape properties of a given prototype source in an image, which ultimately determines the selectivity of a COSFIRE filter. We further utilize hashing techniques, which are efficient in terms of required computation and storage, enabling scalability in handling large data sets in the image retrieval process. We evaluated the effectiveness of our approach by conducting experiments on a benchmark data set of radio galaxies, containing 1,180 training images and 404 test images. Notably, our approach achieved a mean average precision of 91% for image retrieval, surpassing the performance of the competing DenseNet-based method. Moreover, the COSFIRE filters are significantly more computationally efficient, requiring $\sim\!14\times$ fewer operations than the DenseNet-based method.
△ Less
Submitted 27 September, 2024;
originally announced October 2024.
-
PushPull-Net: Inhibition-driven ResNet robust to image corruptions
Authors:
Guru Swaroop Bennabhaktula,
Enrique Alegre,
Nicola Strisciuglio,
George Azzopardi
Abstract:
We introduce a novel computational unit, termed PushPull-Conv, in the first layer of a ResNet architecture, inspired by the anti-phase inhibition phenomenon observed in the primary visual cortex. This unit redefines the traditional convolutional layer by implementing a pair of complementary filters: a trainable push kernel and its counterpart, the pull kernel. The push kernel (analogous to traditi…
▽ More
We introduce a novel computational unit, termed PushPull-Conv, in the first layer of a ResNet architecture, inspired by the anti-phase inhibition phenomenon observed in the primary visual cortex. This unit redefines the traditional convolutional layer by implementing a pair of complementary filters: a trainable push kernel and its counterpart, the pull kernel. The push kernel (analogous to traditional convolution) learns to respond to specific stimuli, while the pull kernel reacts to the same stimuli but of opposite contrast. This configuration enhances stimulus selectivity and effectively inhibits response in regions lacking preferred stimuli. This effect is attributed to the push and pull kernels, which produce responses of comparable magnitude in such regions, thereby neutralizing each other. The incorporation of the PushPull-Conv into ResNets significantly increases their robustness to image corruption. Our experiments with benchmark corruption datasets show that the PushPull-Conv can be combined with other data augmentation techniques to further improve model robustness. We set a new robustness benchmark on ResNet50 achieving an $mCE$ of 49.95$\%$ on ImageNet-C when combining PRIME augmentation with PushPull inhibition.
△ Less
Submitted 13 September, 2024; v1 submitted 7 August, 2024;
originally announced August 2024.
-
Classification of Radio Galaxies with trainable COSFIRE filters
Authors:
Steven Ndungu,
Trienko Grobler,
Stefan J. Wijnholds Dimka Karastoyanova,
George Azzopardi
Abstract:
Radio galaxies exhibit a rich diversity of characteristics and emit radio emissions through a variety of radiation mechanisms, making their classification into distinct types based on morphology a complex challenge. To address this challenge effectively, we introduce an innovative approach for radio galaxy classification using COSFIRE filters. These filters possess the ability to adapt to both the…
▽ More
Radio galaxies exhibit a rich diversity of characteristics and emit radio emissions through a variety of radiation mechanisms, making their classification into distinct types based on morphology a complex challenge. To address this challenge effectively, we introduce an innovative approach for radio galaxy classification using COSFIRE filters. These filters possess the ability to adapt to both the shape and orientation of prototype patterns within images. The COSFIRE approach is explainable, learning-free, rotation-tolerant, efficient, and does not require a huge training set. To assess the efficacy of our method, we conducted experiments on a benchmark radio galaxy data set comprising of 1180 training samples and 404 test samples. Notably, our approach achieved an average accuracy rate of 93.36\%. This achievement outperforms contemporary deep learning models, and it is the best result ever achieved on this data set. Additionally, COSFIRE filters offer better computational performance, $\sim$20$\times$ fewer operations than the DenseNet-based competing method (when comparing at the same accuracy). Our findings underscore the effectiveness of the COSFIRE filter-based approach in addressing the complexities associated with radio galaxy classification. This research contributes to advancing the field by offering a robust solution that transcends the orientation challenges intrinsic to radio galaxy observations. Our method is versatile in that it is applicable to various image classification approaches.
△ Less
Submitted 19 November, 2023;
originally announced November 2023.
-
Deep supervised hashing for fast retrieval of radio image cubes
Authors:
Steven Ndung'u,
Trienko Grobler,
Stefan J. Wijnholds,
Dimka Karastoyanova,
George Azzopardi
Abstract:
The shear number of sources that will be detected by next-generation radio surveys will be astronomical, which will result in serendipitous discoveries. Data-dependent deep hashing algorithms have been shown to be efficient at image retrieval tasks in the fields of computer vision and multimedia. However, there are limited applications of these methodologies in the field of astronomy. In this work…
▽ More
The shear number of sources that will be detected by next-generation radio surveys will be astronomical, which will result in serendipitous discoveries. Data-dependent deep hashing algorithms have been shown to be efficient at image retrieval tasks in the fields of computer vision and multimedia. However, there are limited applications of these methodologies in the field of astronomy. In this work, we utilize deep hashing to rapidly search for similar images in a large database. The experiment uses a balanced dataset of 2708 samples consisting of four classes: Compact, FRI, FRII, and Bent. The performance of the method was evaluated using the mean average precision (mAP) metric where a precision of 88.5\% was achieved. The experimental results demonstrate the capability to search and retrieve similar radio images efficiently and at scale. The retrieval is based on the Hamming distance between the binary hash of the query image and those of the reference images in the database.
△ Less
Submitted 2 September, 2023;
originally announced September 2023.
-
Advances on the classification of radio image cubes
Authors:
Steven Ndung'u,
Trienko Grobler,
Stefan J. Wijnholds,
Dimka Karastoyanova,
George Azzopardi
Abstract:
Modern radio telescopes will daily generate data sets on the scale of exabytes for systems like the Square Kilometre Array (SKA). Massive data sets are a source of unknown and rare astrophysical phenomena that lead to discoveries. Nonetheless, this is only plausible with the exploitation of intensive machine intelligence to complement human-aided and traditional statistical techniques. Recently, t…
▽ More
Modern radio telescopes will daily generate data sets on the scale of exabytes for systems like the Square Kilometre Array (SKA). Massive data sets are a source of unknown and rare astrophysical phenomena that lead to discoveries. Nonetheless, this is only plausible with the exploitation of intensive machine intelligence to complement human-aided and traditional statistical techniques. Recently, there has been a surge in scientific publications focusing on the use of artificial intelligence in radio astronomy, addressing challenges such as source extraction, morphological classification, and anomaly detection. This study presents a succinct, but comprehensive review of the application of machine intelligence techniques on radio images with emphasis on the morphological classification of radio galaxies. It aims to present a detailed synthesis of the relevant papers summarizing the literature based on data complexity, data pre-processing, and methodological novelty in radio astronomy. The rapid advancement and application of computer intelligence in radio astronomy has resulted in a revolution and a new paradigm shift in the automation of daunting data processes. However, the optimal exploitation of artificial intelligence in radio astronomy, calls for continued collaborative efforts in the creation of annotated data sets. Additionally, in order to quickly locate radio galaxies with similar or dissimilar physical characteristics, it is necessary to index the identified radio sources. Nonetheless, this issue has not been adequately addressed in the literature, making it an open area for further study.
△ Less
Submitted 5 May, 2023;
originally announced May 2023.
-
Segmentation in large-scale cellular electron microscopy with deep learning: A literature survey
Authors:
Anusha Aswath,
Ahmad Alsahaf,
Ben N. G. Giepmans,
George Azzopardi
Abstract:
Automated and semi-automated techniques in biomedical electron microscopy (EM) enable the acquisition of large datasets at a high rate. Segmentation methods are therefore essential to analyze and interpret these large volumes of data, which can no longer completely be labeled manually. In recent years, deep learning algorithms achieved impressive results in both pixel-level labeling (semantic segm…
▽ More
Automated and semi-automated techniques in biomedical electron microscopy (EM) enable the acquisition of large datasets at a high rate. Segmentation methods are therefore essential to analyze and interpret these large volumes of data, which can no longer completely be labeled manually. In recent years, deep learning algorithms achieved impressive results in both pixel-level labeling (semantic segmentation) and the labeling of separate instances of the same class (instance segmentation). In this review, we examine how these algorithms were adapted to the task of segmenting cellular and sub-cellular structures in EM images. The special challenges posed by such images and the network architectures that overcame some of them are described. Moreover, a thorough overview is also provided on the notable datasets that contributed to the proliferation of deep learning in EM. Finally, an outlook of current trends and future prospects of EM segmentation is given, especially in the area of label-free learning.
△ Less
Submitted 30 March, 2023; v1 submitted 14 June, 2022;
originally announced June 2022.
-
To remove or not remove Mobile Apps? A data-driven predictive model approach
Authors:
Fadi Mohsen,
Dimka Karastoyanova,
George Azzopardi
Abstract:
Mobile app stores are the key distributors of mobile applications. They regularly apply vetting processes to the deployed apps. Yet, some of these vetting processes might be inadequate or applied late. The late removal of applications might have unpleasant consequences for developers and users alike. Thus, in this work we propose a data-driven predictive approach that determines whether the respec…
▽ More
Mobile app stores are the key distributors of mobile applications. They regularly apply vetting processes to the deployed apps. Yet, some of these vetting processes might be inadequate or applied late. The late removal of applications might have unpleasant consequences for developers and users alike. Thus, in this work we propose a data-driven predictive approach that determines whether the respective app will be removed or accepted. It also indicates the features' relevance that help the stakeholders in the interpretation. In turn, our approach can support developers in improving their apps and users in downloading the ones that are less likely to be removed. We focus on the Google App store and we compile a new data set of 870,515 applications, 56% of which have actually been removed from the market. Our proposed approach is a bootstrap aggregating of multiple XGBoost machine learning classifiers. We propose two models: user-centered using 47 features, and developer-centered using 37 features, the ones only available before deployment. We achieve the following Areas Under the ROC Curves (AUCs) on the test set: user-centered = 0.792, developer-centered = 0.762.
△ Less
Submitted 8 June, 2022;
originally announced June 2022.
-
Beam Measurements and Machine Learning at the CERN Large Hadron Collider
Authors:
P. Arpaia,
G. Azzopardi,
F. Blanc,
X. Buffat,
L. Coyle,
E. Fol,
F. Giordano,
M. Giovannozzi,
T. Pieloni,
R. Prevete,
S. Redaelli,
B. Salvachua,
B. Salvant,
M. Schenk,
M. Solfaroli Camillocci,
R. Tomás,
G. Valentino,
F. F. Van der Veken,
J. Wenninger
Abstract:
This paper presents a review of the recent Machine Learning activities carried out on beam measurements performed at the CERN Large Hadron Collider. This paper has been accepted for publication in IEEE Instrumentation and Measurement Magazine and in the published version no abstract is provided.
This paper presents a review of the recent Machine Learning activities carried out on beam measurements performed at the CERN Large Hadron Collider. This paper has been accepted for publication in IEEE Instrumentation and Measurement Magazine and in the published version no abstract is provided.
△ Less
Submitted 27 July, 2021;
originally announced July 2021.
-
Video Camera Identification from Sensor Pattern Noise with a Constrained ConvNet
Authors:
Derrick Timmerman,
Swaroop Bennabhaktula,
Enrique Alegre,
George Azzopardi
Abstract:
The identification of source cameras from videos, though it is a highly relevant forensic analysis topic, has been studied much less than its counterpart that uses images. In this work we propose a method to identify the source camera of a video based on camera specific noise patterns that we extract from video frames. For the extraction of noise pattern features, we propose an extended version of…
▽ More
The identification of source cameras from videos, though it is a highly relevant forensic analysis topic, has been studied much less than its counterpart that uses images. In this work we propose a method to identify the source camera of a video based on camera specific noise patterns that we extract from video frames. For the extraction of noise pattern features, we propose an extended version of a constrained convolutional layer capable of processing color inputs. Our system is designed to classify individual video frames which are in turn combined by a majority vote to identify the source camera. We evaluated this approach on the benchmark VISION data set consisting of 1539 videos from 28 different cameras. To the best of our knowledge, this is the first work that addresses the challenge of video camera identification on a device level. The experiments show that our approach is very promising, achieving up to 93.1% accuracy while being robust to the WhatsApp and YouTube compression techniques. This work is part of the EU-funded project 4NSEEK focused on forensics against child sexual abuse.
△ Less
Submitted 11 December, 2020;
originally announced December 2020.
-
Machine learning for beam dynamics studies at the CERN Large Hadron Collider
Authors:
P. Arpaia,
G. Azzopardi,
F. Blanc,
G. Bregliozzi,
X. Buffat,
L. Coyle,
E. Fol,
F. Giordano,
M. Giovannozzi,
T. Pieloni,
R. Prevete,
S. Redaelli,
B. Salvachua,
B. Salvant,
M. Schenk,
M. Solfaroli Camillocci,
R. Tomàs,
G. Valentino,
F. F. Van der Veken,
J. Wenninger
Abstract:
Machine learning entails a broad range of techniques that have been widely used in Science and Engineering since decades. High-energy physics has also profited from the power of these tools for advanced analysis of colliders data. It is only up until recently that Machine Learning has started to be applied successfully in the domain of Accelerator Physics, which is testified by intense efforts dep…
▽ More
Machine learning entails a broad range of techniques that have been widely used in Science and Engineering since decades. High-energy physics has also profited from the power of these tools for advanced analysis of colliders data. It is only up until recently that Machine Learning has started to be applied successfully in the domain of Accelerator Physics, which is testified by intense efforts deployed in this domain by several laboratories worldwide. This is also the case of CERN, where recently focused efforts have been devoted to the application of Machine Learning techniques to beam dynamics studies at the Large Hadron Collider (LHC). This implies a wide spectrum of applications from beam measurements and machine performance optimisation to analysis of numerical data from tracking simulations of non-linear beam dynamics. In this paper, the LHC-related applications that are currently pursued are presented and discussed in detail, paying also attention to future developments.
△ Less
Submitted 17 September, 2020;
originally announced September 2020.
-
Device-based Image Matching with Similarity Learning by Convolutional Neural Networks that Exploit the Underlying Camera Sensor Pattern Noise
Authors:
Guru Swaroop Bennabhaktula,
Enrique Alegre,
Dimka Karastoyanova,
George Azzopardi
Abstract:
One of the challenging problems in digital image forensics is the capability to identify images that are captured by the same camera device. This knowledge can help forensic experts in gathering intelligence about suspects by analyzing digital images. In this paper, we propose a two-part network to quantify the likelihood that a given pair of images have the same source camera, and we evaluated it…
▽ More
One of the challenging problems in digital image forensics is the capability to identify images that are captured by the same camera device. This knowledge can help forensic experts in gathering intelligence about suspects by analyzing digital images. In this paper, we propose a two-part network to quantify the likelihood that a given pair of images have the same source camera, and we evaluated it on the benchmark Dresden data set containing 1851 images from 31 different cameras. To the best of our knowledge, we are the first ones addressing the challenge of device-based image matching. Though the proposed approach is not yet forensics ready, our experiments show that this direction is worth pursuing, achieving at this moment 85 percent accuracy. This ongoing work is part of the EU-funded project 4NSEEK concerned with forensics against child sexual abuse.
△ Less
Submitted 23 April, 2020;
originally announced April 2020.
-
Brain-inspired robust delineation operator
Authors:
Nicola Strisciuglio,
George Azzopardi,
Nicolai Petkov
Abstract:
In this paper we present a novel filter, based on the existing COSFIRE filter, for the delineation of patterns of interest. It includes a mechanism of push-pull inhibition that improves robustness to noise in terms of spurious texture. Push-pull inhibition is a phenomenon that is observed in neurons in area V1 of the visual cortex, which suppresses the response of certain simple cells for stimuli…
▽ More
In this paper we present a novel filter, based on the existing COSFIRE filter, for the delineation of patterns of interest. It includes a mechanism of push-pull inhibition that improves robustness to noise in terms of spurious texture. Push-pull inhibition is a phenomenon that is observed in neurons in area V1 of the visual cortex, which suppresses the response of certain simple cells for stimuli of preferred orientation but of non-preferred contrast. This type of inhibition allows for sharper detection of the patterns of interest and improves the quality of delineation especially in images with spurious texture.
We performed experiments on images from different applications, namely the detection of rose stems for automatic gardening, the delineation of cracks in pavements and road surfaces, and the segmentation of blood vessels in retinal images. Push-pull inhibition helped to improve results considerably in all applications.
△ Less
Submitted 26 November, 2018;
originally announced November 2018.
-
Detection of curved lines with B-COSFIRE filters: A case study on crack delineation
Authors:
Nicola Strisciuglio,
George Azzopardi,
Nicolai Petkov
Abstract:
The detection of curvilinear structures is an important step for various computer vision applications, ranging from medical image analysis for segmentation of blood vessels, to remote sensing for the identification of roads and rivers, and to biometrics and robotics, among others. %The visual system of the brain has remarkable abilities to detect curvilinear structures in noisy images. This is a n…
▽ More
The detection of curvilinear structures is an important step for various computer vision applications, ranging from medical image analysis for segmentation of blood vessels, to remote sensing for the identification of roads and rivers, and to biometrics and robotics, among others. %The visual system of the brain has remarkable abilities to detect curvilinear structures in noisy images. This is a nontrivial task especially for the detection of thin or incomplete curvilinear structures surrounded with noise. We propose a general purpose curvilinear structure detector that uses the brain-inspired trainable B-COSFIRE filters. It consists of four main steps, namely nonlinear filtering with B-COSFIRE, thinning with non-maximum suppression, hysteresis thresholding and morphological closing. We demonstrate its effectiveness on a data set of noisy images with cracked pavements, where we achieve state-of-the-art results (F-measure=0.865). The proposed method can be employed in any computer vision methodology that requires the delineation of curvilinear and elongated structures.
△ Less
Submitted 24 July, 2017;
originally announced July 2017.
