-
Multi-Scale Spectral Attention Module-based Hyperspectral Segmentation in Autonomous Driving Scenarios
Authors:
Imad Ali Shah,
Jiarong Li,
Tim Brophy,
Martin Glavin,
Edward Jones,
Enda Ward,
Brian Deegan
Abstract:
Recent advances in autonomous driving (AD) have highlighted the potential of Hyperspectral Imaging (HSI) for enhanced environmental perception, particularly in challenging weather and lighting conditions. However, efficiently processing its high-dimensional spectral data remains a significant challenge. This paper introduces a Multi-scale Spectral Attention Module (MSAM) that enhances spectral fea…
▽ More
Recent advances in autonomous driving (AD) have highlighted the potential of Hyperspectral Imaging (HSI) for enhanced environmental perception, particularly in challenging weather and lighting conditions. However, efficiently processing its high-dimensional spectral data remains a significant challenge. This paper introduces a Multi-scale Spectral Attention Module (MSAM) that enhances spectral feature extraction through three parallel 1D convolutions with varying kernel sizes between 1 to 11, coupled with an adaptive feature aggregation mechanism. By integrating MSAM into UNet's skip connections (UNet-SC), our proposed UNet-MSAM achieves significant improvements in semantic segmentation performance across multiple HSI datasets: HyKo-VIS v2, HSI-Drive v2, and Hyperspectral City v2. Our comprehensive experiments demonstrate that with minimal computational overhead (on average 0.02% in parameters and 0.82% GFLOPS), UNet-MSAM consistently outperforms UNet-SC, achieving average improvements of 3.61% in mean IoU and 3.80% in mF1 across the three datasets. Through extensive ablation studies, we have established that multi-scale kernel combinations perform better than single-scale configurations. These findings demonstrate the potential of HSI processing for AD and provide valuable insights into designing robust, multi-scale spectral feature extractors for real-world applications.
△ Less
Submitted 23 June, 2025;
originally announced June 2025.
-
Anomalies in Muon-Induced Neutron Emissions from Pb
Authors:
W. H. Trzaska,
A. Barzilov,
T. Enqvist,
K. Jedrzejczak,
M. Kasztelan,
P. Kuusiniemi,
K. K. Loo,
J. Orzechowski,
M. Słupecki,
J. Szabelski,
T. E. Ward
Abstract:
This paper analyses neutron multiplicity spectra from massive targets at depths of 3, 40, 210, 583, 1166, and 4000 m.w.e. The measurements, conducted between 2001 and 2024, utilised three experimental setups with either 14 or 60 He-3 neutron detectors and lead (Pb) targets weighing 306, 565, or 1134 kg. The total acquisition time exceeded six years. When available, the acquired spectra were compar…
▽ More
This paper analyses neutron multiplicity spectra from massive targets at depths of 3, 40, 210, 583, 1166, and 4000 m.w.e. The measurements, conducted between 2001 and 2024, utilised three experimental setups with either 14 or 60 He-3 neutron detectors and lead (Pb) targets weighing 306, 565, or 1134 kg. The total acquisition time exceeded six years. When available, the acquired spectra were compared with Monte Carlo simulations. Our data challenges the practice of approximating the muon-induced neutron multiplicity spectra with one power-law function $k \times m^{-p}$, where m is the multiplicity, k is the depth-related parameter decreasing with overburden, and p is the slope parameter that remains unchanged with depth. Instead, we see the emergence of a second component. It is evident already in the muon-suppressed spectrum collected on the surface and dominates the spectra at 1166 and 4000 m.w.e. In addition, we see indications of a possible structure in the second component that resembles emissions of approximately 74, 106, 143, and 214 neutrons from the target. Since the anomaly varies only slightly with depth, it is not directly correlated with the muon flux. We propose new underground measurements employing low-cost, large-area, position-sensitive neutron counters to verify and investigate the observed anomalies and ascertain their origin.
△ Less
Submitted 23 April, 2025;
originally announced April 2025.
-
Hyperspectral Imaging-Based Perception in Autonomous Driving Scenarios: Benchmarking Baseline Semantic Segmentation Models
Authors:
Imad Ali Shah,
Jiarong Li,
Martin Glavin,
Edward Jones,
Enda Ward,
Brian Deegan
Abstract:
Hyperspectral Imaging (HSI) is known for its advantages over traditional RGB imaging in remote sensing, agriculture, and medicine. Recently, it has gained attention for enhancing Advanced Driving Assistance Systems (ADAS) perception. Several HSI datasets such as HyKo, HSI-Drive, HSI-Road, and Hyperspectral City have been made available. However, a comprehensive evaluation of semantic segmentation…
▽ More
Hyperspectral Imaging (HSI) is known for its advantages over traditional RGB imaging in remote sensing, agriculture, and medicine. Recently, it has gained attention for enhancing Advanced Driving Assistance Systems (ADAS) perception. Several HSI datasets such as HyKo, HSI-Drive, HSI-Road, and Hyperspectral City have been made available. However, a comprehensive evaluation of semantic segmentation models (SSM) using these datasets is lacking. To address this gap, we evaluated the available annotated HSI datasets on four deep learning-based baseline SSMs: DeepLab v3+, HRNet, PSPNet, and U-Net, along with its two variants: Coordinate Attention (UNet-CA) and Convolutional Block-Attention Module (UNet-CBAM). The original model architectures were adapted to handle the varying spatial and spectral dimensions of the datasets. These baseline SSMs were trained using a class-weighted loss function for individual HSI datasets and evaluated using mean-based metrics such as intersection over union (IoU), recall, precision, F1 score, specificity, and accuracy. Our results indicate that UNet-CBAM, which extracts channel-wise features, outperforms other SSMs and shows potential to leverage spectral information for enhanced semantic segmentation. This study establishes a baseline SSM benchmark on available annotated datasets for future evaluation of HSI-based ADAS perception. However, limitations of current HSI datasets, such as limited dataset size, high class imbalance, and lack of fine-grained annotations, remain significant constraints for developing robust SSMs for ADAS applications.
△ Less
Submitted 12 December, 2024; v1 submitted 29 October, 2024;
originally announced October 2024.
-
Tight-Binding Models for Lone Pair, Heteroanionic Solids, and Application to Layered Oxyhalides
Authors:
Emily G. Ward,
Alexandru B. Georgescu
Abstract:
We provide a methodology to understand materials with complex bonding patterns, and apply it to the example of heteroanionic and lone pair materials. We build a tight-binding model based on Wannier functions fitted on density functional theory results, followed by enforcing symmetry on the atomic orbital basis set, and finally connecting and disconnecting sets of orbitals from the tight-binding mo…
▽ More
We provide a methodology to understand materials with complex bonding patterns, and apply it to the example of heteroanionic and lone pair materials. We build a tight-binding model based on Wannier functions fitted on density functional theory results, followed by enforcing symmetry on the atomic orbital basis set, and finally connecting and disconnecting sets of orbitals from the tight-binding model to understand their individual contribution to the resulting materials properties. We apply this methodology to complex materials, namely BiOCl and Bi$_2$YO$_4$Cl - part of a broader class of materials investigated for their applications in photocatalysis and photoluminescence. Our methodology can be generalized and applied to a wide variety of other materials, including halide perovskites, and multiferroic materials. This methodology allows us to isolate the origin of key electronic features in these materials, including the role of the Bi lone pair-anion bonding interaction - key to photoluminescence in many materials. Finally, we investigate the role of the crystal structure, Chlorine and Oxygen orbital energy levels and bonding in determining the photostability of bismuth oxyhalides. Our methodology allows us to understand the functionality of complex materials in an intuitive and qualitative manner.
△ Less
Submitted 24 October, 2024;
originally announced October 2024.
-
cosimmr: an R package for fast fitting of Stable Isotope Mixing Models with covariates
Authors:
Emma Govan,
Andrew L Jackson,
Stuart Bearhop,
Richard Inger,
Brian C Stock,
Brice X Semmens,
Eric J Ward,
Andrew C Parnell
Abstract:
The study of animal diets and the proportional contribution that different foods make to their diets is an important task in ecology. Stable Isotope Mixing Models (SIMMs) are an important tool for studying an animal's diet and understanding how the animal interacts with its environment. We present cosimmr, a new R package designed to include covariates when estimating diet proportions in SIMMs, wi…
▽ More
The study of animal diets and the proportional contribution that different foods make to their diets is an important task in ecology. Stable Isotope Mixing Models (SIMMs) are an important tool for studying an animal's diet and understanding how the animal interacts with its environment. We present cosimmr, a new R package designed to include covariates when estimating diet proportions in SIMMs, with simple functions to produce plots and summary statistics. The inclusion of covariates allows for users to perform a more in-depth analysis of their system and to gain new insights into the diets of the organisms being studied. A common problem with the previous generation of SIMMs is that they are very slow to produce a posterior distribution of dietary estimates, especially for more complex model structures, such as when covariates are included. The widely-used Markov chain Monte Carlo (MCMC) algorithm used by many traditional SIMMs often requires a very large number of iterations to reach convergence. In contrast, cosimmr uses Fixed Form Variational Bayes (FFVB), which we demonstrate gives up to an order of magnitude speed improvement with no discernible loss of accuracy. We provide a full mathematical description of the model, which includes corrections for trophic discrimination and concentration dependence, and evaluate its performance against the state of the art MixSIAR model. Whilst MCMC is guaranteed to converge to the posterior distribution in the long term, FFVB converges to an approximation of the posterior distribution, which may lead to sub-optimal performance. However we show that the package produces equivalent results in a fraction of the time for all the examples on which we test. The package is designed to be user-friendly and is based on the existing simmr framework.
△ Less
Submitted 30 August, 2024;
originally announced August 2024.
-
SS-SFR: Synthetic Scenes Spatial Frequency Response on Virtual KITTI and Degraded Automotive Simulations for Object Detection
Authors:
Daniel Jakab,
Alexander Braun,
Cathaoir Agnew,
Reenu Mohandas,
Brian Michael Deegan,
Dara Molloy,
Enda Ward,
Tony Scanlan,
Ciarán Eising
Abstract:
Automotive simulation can potentially compensate for a lack of training data in computer vision applications. However, there has been little to no image quality evaluation of automotive simulation and the impact of optical degradations on simulation is little explored. In this work, we investigate Virtual KITTI and the impact of applying variations of Gaussian blur on image sharpness. Furthermore,…
▽ More
Automotive simulation can potentially compensate for a lack of training data in computer vision applications. However, there has been little to no image quality evaluation of automotive simulation and the impact of optical degradations on simulation is little explored. In this work, we investigate Virtual KITTI and the impact of applying variations of Gaussian blur on image sharpness. Furthermore, we consider object detection, a common computer vision application on three different state-of-the-art models, thus allowing us to characterize the relationship between object detection and sharpness. It was found that while image sharpness (MTF50) degrades from an average of 0.245cy/px to approximately 0.119cy/px; object detection performance stays largely robust within 0.58\%(Faster RCNN), 1.45\%(YOLOF) and 1.93\%(DETR) across all respective held-out test sets.
△ Less
Submitted 1 October, 2024; v1 submitted 22 July, 2024;
originally announced July 2024.
-
First detection of coherent elastic neutrino-nucleus scattering on germanium
Authors:
S. Adamski,
M. Ahn,
P. S. Barbeau,
V. Belov,
I. Bernardi,
C. Bock,
A. Bolozdynya,
R. Bouabid,
J. Browning,
B. Cabrera-Palmer,
N. Cedarblade-Jones,
J. Colón Rivera,
E. Conley,
V. da Silva,
J. Daughhetee,
J. Detwiler,
K. Ding,
M. R. Durand,
Y. Efremenko,
S. R. Elliott,
A. Erlandson,
L. Fabris,
A. Galindo-Uribarri,
M. P. Green,
J. Hakenmüller
, et al. (62 additional authors not shown)
Abstract:
We report the first detection of coherent elastic neutrino-nucleus scattering (CEvNS) on germanium, measured at the Spallation Neutron Source at Oak Ridge National Laboratory. The Ge-Mini detector of the COHERENT collaboration employs large-mass, low-noise, high-purity germanium spectrometers, enabling excellent energy resolution, and an analysis threshold of 1.5 keV electron-equivalent ionization…
▽ More
We report the first detection of coherent elastic neutrino-nucleus scattering (CEvNS) on germanium, measured at the Spallation Neutron Source at Oak Ridge National Laboratory. The Ge-Mini detector of the COHERENT collaboration employs large-mass, low-noise, high-purity germanium spectrometers, enabling excellent energy resolution, and an analysis threshold of 1.5 keV electron-equivalent ionization energy. We observe a on-beam excess of 20.6$_{+7.1}^{-6.3}$ counts with a total exposure of 10.22 GWhkg and we reject the no-CEvNS hypothesis with 3.9 sigma significance. The result agrees with the predicted standard model of particle physics signal rate within 2 sigma.
△ Less
Submitted 19 June, 2024;
originally announced June 2024.
-
The Canadian VirusSeq Data Portal & Duotang: open resources for SARS-CoV-2 viral sequences and genomic epidemiology
Authors:
Erin E. Gill,
Baofeng Jia,
Carmen Lia Murall,
Raphaël Poujol,
Muhammad Zohaib Anwar,
Nithu Sara John,
Justin Richardsson,
Ashley Hobb,
Abayomi S. Olabode,
Alexandru Lepsa,
Ana T. Duggan,
Andrea D. Tyler,
Arnaud N'Guessan,
Atul Kachru,
Brandon Chan,
Catherine Yoshida,
Christina K. Yung,
David Bujold,
Dusan Andric,
Edmund Su,
Emma J. Griffiths,
Gary Van Domselaar,
Gordon W. Jolly,
Heather K. E. Ward,
Henrich Feher
, et al. (45 additional authors not shown)
Abstract:
The COVID-19 pandemic led to a large global effort to sequence SARS-CoV-2 genomes from patient samples to track viral evolution and inform public health response. Millions of SARS-CoV-2 genome sequences have been deposited in global public repositories. The Canadian COVID-19 Genomics Network (CanCOGeN - VirusSeq), a consortium tasked with coordinating expanded sequencing of SARS-CoV-2 genomes acro…
▽ More
The COVID-19 pandemic led to a large global effort to sequence SARS-CoV-2 genomes from patient samples to track viral evolution and inform public health response. Millions of SARS-CoV-2 genome sequences have been deposited in global public repositories. The Canadian COVID-19 Genomics Network (CanCOGeN - VirusSeq), a consortium tasked with coordinating expanded sequencing of SARS-CoV-2 genomes across Canada early in the pandemic, created the Canadian VirusSeq Data Portal, with associated data pipelines and procedures, to support these efforts. The goal of VirusSeq was to allow open access to Canadian SARS-CoV-2 genomic sequences and enhanced, standardized contextual data that were unavailable in other repositories and that meet FAIR standards (Findable, Accessible, Interoperable and Reusable). The Portal data submission pipeline contains data quality checking procedures and appropriate acknowledgement of data generators that encourages collaboration. Here we also highlight Duotang, a web platform that presents genomic epidemiology and modeling analyses on circulating and emerging SARS-CoV-2 variants in Canada. Duotang presents dynamic changes in variant composition of SARS-CoV-2 in Canada and by province, estimates variant growth, and displays complementary interactive visualizations, with a text overview of the current situation. The VirusSeq Data Portal and Duotang resources, alongside additional analyses and resources computed from the Portal (COVID-MVP, CoVizu), are all open-source and freely available. Together, they provide an updated picture of SARS-CoV-2 evolution to spur scientific discussions, inform public discourse, and support communication with and within public health authorities. They also serve as a framework for other jurisdictions interested in open, collaborative sequence data sharing and analyses.
△ Less
Submitted 7 May, 2024;
originally announced May 2024.
-
Surround-View Fisheye Optics in Computer Vision and Simulation: Survey and Challenges
Authors:
Daniel Jakab,
Brian Michael Deegan,
Sushil Sharma,
Eoin Martino Grua,
Jonathan Horgan,
Enda Ward,
Pepijn Van De Ven,
Anthony Scanlan,
Ciarán Eising
Abstract:
In this paper, we provide a survey on automotive surround-view fisheye optics, with an emphasis on the impact of optical artifacts on computer vision tasks in autonomous driving and ADAS. The automotive industry has advanced in applying state-of-the-art computer vision to enhance road safety and provide automated driving functionality. When using camera systems on vehicles, there is a particular n…
▽ More
In this paper, we provide a survey on automotive surround-view fisheye optics, with an emphasis on the impact of optical artifacts on computer vision tasks in autonomous driving and ADAS. The automotive industry has advanced in applying state-of-the-art computer vision to enhance road safety and provide automated driving functionality. When using camera systems on vehicles, there is a particular need for a wide field of view to capture the entire vehicle's surroundings, in areas such as low-speed maneuvering, automated parking, and cocoon sensing. However, one crucial challenge in surround-view cameras is the strong optical aberrations of the fisheye camera, which is an area that has received little attention in the literature. Additionally, a comprehensive dataset is needed for testing safety-critical scenarios in vehicle automation. The industry has turned to simulation as a cost-effective strategy for creating synthetic datasets with surround-view camera imagery. We examine different simulation methods (such as model-driven and data-driven simulations) and discuss the simulators' ability (or lack thereof) to model real-world optical performance. Overall, this paper highlights the optical aberrations in automotive fisheye datasets, and the limitations of optical reality in simulated fisheye datasets, with a focus on computer vision in surround-view optical systems.
△ Less
Submitted 21 February, 2024; v1 submitted 19 February, 2024;
originally announced February 2024.
-
New Evidence for DM-like Anomalies in Neutron Multiplicity Spectra
Authors:
W. H. Trzaska,
A. Barzilov,
T. Enqvist,
K. Jedrzejczak,
M. Kasztelan,
P. Kuusiniemi,
K. K. Loo,
J. Orzechowski,
M. Slupecki,
J. Szabelski,
T. E. Ward
Abstract:
Subterrestrial neutron spectra show weak but consistent anomalies at multiplicities ~100 and above. The origin of the excess events remains ambiguous, but, in principle, it could be a signature of Dark Matter WIMP annihilation-like interaction with a massive Pb target. However, since the results of the available measurements are below the 5-sigma discovery level, and the observed anomalous structu…
▽ More
Subterrestrial neutron spectra show weak but consistent anomalies at multiplicities ~100 and above. The origin of the excess events remains ambiguous, but, in principle, it could be a signature of Dark Matter WIMP annihilation-like interaction with a massive Pb target. However, since the results of the available measurements are below the 5-sigma discovery level, and the observed anomalous structures are on a significant muon-induced background, an independent verification at even greater depth is needed. For that purpose, we have launched NEMESIS 1.4 - a new dedicated experiment consisting of a 1134 kg Pb target and 14 He-3 detectors with PE moderators and a fully digital readout. NEMESIS 1.4 has been taking data at the deepest level (1.4 km, 4000 m.w.e.) of the Pyhasalmi mine, Finland, since November 2022. We describe the idea behind the new setup, compare the first results with the previous data and Monte Carlo simulations, and give the outlook for further research. If the existence of the anomalies is unambiguously confirmed and the model interpretation positively verified, this will be the first Indirect Detection of Dark Matter in the laboratory.
△ Less
Submitted 27 February, 2024; v1 submitted 24 November, 2023;
originally announced November 2023.
-
Accessing new physics with an undoped, cryogenic CsI CEvNS detector for COHERENT at the SNS
Authors:
P. S. Barbeau,
V. Belov,
I. Bernardi,
C. Bock,
A. Bolozdynya,
R. Bouabid,
J. Browning,
B. Cabrera-Palmer,
E. Conley,
V. da Silva,
J. Daughhetee,
J. Detwiler,
K. Ding,
M. R. Durand,
Y. Efremenko,
S. R. Elliott,
A. Erlandson,
L. Fabris,
M. Febbraro,
A. Galindo-Uribarri,
M. P. Green,
J. Hakenmüller,
M. R. Heath,
S. Hedges,
B. A. Johnson
, et al. (55 additional authors not shown)
Abstract:
We consider the potential for a 10-kg undoped cryogenic CsI detector operating at the Spallation Neutron Source to measure coherent elastic neutrino-nucleus scattering and its sensitivity to discover new physics beyond the standard model. Through a combination of increased event rate, lower threshold, and good timing resolution, such a detector would significantly improve on past measurements. We…
▽ More
We consider the potential for a 10-kg undoped cryogenic CsI detector operating at the Spallation Neutron Source to measure coherent elastic neutrino-nucleus scattering and its sensitivity to discover new physics beyond the standard model. Through a combination of increased event rate, lower threshold, and good timing resolution, such a detector would significantly improve on past measurements. We considered tests of several beyond-the-standard-model scenarios such as neutrino non-standard interactions and accelerator-produced dark matter. This detector's performance was also studied for relevant questions in nuclear physics and neutrino astronomy, namely the weak charge distribution of CsI nuclei and detection of neutrinos from a core-collapse supernova.
△ Less
Submitted 21 November, 2023;
originally announced November 2023.
-
Evolution of the Size-Mass Relation of Star-forming Galaxies Since $z=5.5$ Revealed by CEERS
Authors:
Ethan M. Ward,
Alexander de la Vega,
Bahram Mobasher,
Elizabeth J. McGrath,
Kartheik G. Iyer,
Antonello Calabro,
Luca Costantin,
Mark Dickinson,
Benne W. Holwerda,
Marc Huertas-Company,
Michaela Hirschmann,
Ray A. Lucas,
Viraj Pandya,
Stephen M. Wilkins,
L. Y. Aaron Yung,
Pablo Arrabal Haro,
Micaela B. Bagley,
Steven L. Finkelstein,
Jeyhan S. Kartaltepe,
Anton M. Koekemoer,
Casey Papovich,
Nor Pirzkal
Abstract:
We combine deep imaging data from the CEERS early release JWST survey and HST imaging from CANDELS to examine the size-mass relation of star-forming galaxies and the morphology-quenching relation at stellar masses $\textrm{M}_{\star} \geq 10^{9.5} \ \textrm{M}_{\odot}$ over the redshift range $0.5 < z < 5.5$. In this study with a sample of 2,450 galaxies, we separate star-forming and quiescent gal…
▽ More
We combine deep imaging data from the CEERS early release JWST survey and HST imaging from CANDELS to examine the size-mass relation of star-forming galaxies and the morphology-quenching relation at stellar masses $\textrm{M}_{\star} \geq 10^{9.5} \ \textrm{M}_{\odot}$ over the redshift range $0.5 < z < 5.5$. In this study with a sample of 2,450 galaxies, we separate star-forming and quiescent galaxies based on their star-formation activity and confirm that star-forming and quiescent galaxies have different morphologies out to $z=5.5$, extending the results of earlier studies out to higher redshifts. We find that star-forming and quiescent galaxies have typical Sérsic indices of $n\sim1.3$ and $n\sim4.3$, respectively. Focusing on star-forming galaxies, we find that the slope of the size-mass relation is nearly constant with redshift, as was found previously, but shows a modest increase at $z \sim 4.2$. The intercept in the size-mass relation declines out to $z=5.5$ at rates that are similar to what earlier studies found. The intrinsic scatter in the size-mass relation is relatively constant out to $z=5.5$.
△ Less
Submitted 3 November, 2023;
originally announced November 2023.
-
Fast, multicolour optical sectioning over extended fields of view by combining interferometric SIM with machine learning
Authors:
Edward N. Ward,
Rebecca M. McClelland,
Jacob R. Lamb,
Roger Rubio-Sánchez,
Charles N. Christensen,
Bismoy Mazumder,
Sofia Kapsiani,
Luca Mascheroni,
Lorenzo Di Michele,
Gabriele S. Kaminski Schierle,
Clemens F. Kaminski
Abstract:
Structured illumination can reject out-of-focus signal from a sample, enabling high-speed and high-contrast imaging over large areas with widefield detection optics. Currently, this optical-sectioning technique is limited by image reconstruction artefacts and the need for sequential imaging of multiple colour channels. We combine multicolour interferometric pattern generation with machine-learning…
▽ More
Structured illumination can reject out-of-focus signal from a sample, enabling high-speed and high-contrast imaging over large areas with widefield detection optics. Currently, this optical-sectioning technique is limited by image reconstruction artefacts and the need for sequential imaging of multiple colour channels. We combine multicolour interferometric pattern generation with machine-learning processing, permitting high-contrast, real-time reconstruction of image data. The method is insensitive to background noise and unevenly phase-stepped illumination patterns. We validate the method in silico and demonstrate its application on diverse specimens, ranging from fixed and live biological cells to synthetic biosystems, imaging at up to 37 Hz across a 44 x 44 $μm^2$ field of view.
△ Less
Submitted 31 October, 2023;
originally announced November 2023.
-
Measuring the Quality of Text-to-Video Model Outputs: Metrics and Dataset
Authors:
Iya Chivileva,
Philip Lynch,
Tomas E. Ward,
Alan F. Smeaton
Abstract:
Evaluating the quality of videos generated from text-to-video (T2V) models is important if they are to produce plausible outputs that convince a viewer of their authenticity. We examine some of the metrics used in this area and highlight their limitations. The paper presents a dataset of more than 1,000 generated videos from 5 very recent T2V models on which some of those commonly used quality met…
▽ More
Evaluating the quality of videos generated from text-to-video (T2V) models is important if they are to produce plausible outputs that convince a viewer of their authenticity. We examine some of the metrics used in this area and highlight their limitations. The paper presents a dataset of more than 1,000 generated videos from 5 very recent T2V models on which some of those commonly used quality metrics are applied. We also include extensive human quality evaluations on those videos, allowing the relative strengths and weaknesses of metrics, including human assessment, to be compared. The contribution is an assessment of commonly used quality metrics, and a comparison of their performances and the performance of human evaluations on an open dataset of T2V videos. Our conclusion is that naturalness and semantic matching with the text prompt used to generate the T2V output are important but there is no single measure to capture these subtleties in assessing T2V model output.
△ Less
Submitted 14 September, 2023;
originally announced September 2023.
-
Measurement of the Electron-Neutrino Charged-Current Cross Sections on ${}^{127}$I with the COHERENT NaI$ν$E detector
Authors:
P. An,
C. Awe,
P. S. Barbeau,
B. Becker,
V. Belov,
I. Bernardi,
C. Bock,
A. Bolozdynya,
R. Bouabid,
A. Brown,
J. Browning,
B. Cabrera-Palmer,
M. Cervantes,
E. Conley,
J. Daughhetee,
J. Detwiler,
K. Ding,
M. R. Durand,
Y. Efremenko,
S. R. Elliott,
L. Fabris,
M. Febbraro,
A. Gallo Rosso,
A. Galindo-Uribarri,
A. C. Germer
, et al. (64 additional authors not shown)
Abstract:
Using an 185-kg NaI[Tl] array, COHERENT has measured the inclusive electron-neutrino charged-current cross section on ${}^{127}$I with pion decay-at-rest neutrinos produced by the Spallation Neutron Source at Oak Ridge National Laboratory. Iodine is one the heaviest targets for which low-energy ($\leq$ 50 MeV) inelastic neutrino-nucleus processes have been measured, and this is the first measureme…
▽ More
Using an 185-kg NaI[Tl] array, COHERENT has measured the inclusive electron-neutrino charged-current cross section on ${}^{127}$I with pion decay-at-rest neutrinos produced by the Spallation Neutron Source at Oak Ridge National Laboratory. Iodine is one the heaviest targets for which low-energy ($\leq$ 50 MeV) inelastic neutrino-nucleus processes have been measured, and this is the first measurement of its inclusive cross section. After a five-year detector exposure, COHERENT reports a flux-averaged cross section for electron neutrinos of $9.2^{+2.1}_{-1.8} \times 10^{-40}$ cm$^2$. This corresponds to a value that is $\sim$41% lower than predicted using the MARLEY event generator with a measured Gamow-Teller strength distribution. In addition, the observed visible spectrum from charged-current scattering on $^{127}$I has been measured between 10 and 55 MeV, and the exclusive zero-neutron and one-or-more-neutron emission cross sections are measured to be $5.2^{+3.4}_{-3.1} \times 10^{-40}$ and $2.2^{+3.5}_{-2.2} \times 10^{-40}$ cm$^2$, respectively.
△ Less
Submitted 7 March, 2024; v1 submitted 31 May, 2023;
originally announced May 2023.
-
Measurement of ${}^{nat}$Pb($ν_e$,X$n$) production with a stopped-pion neutrino source
Authors:
COHERENT Collaboration,
P. An,
C. Awe,
P. S. Barbeau,
B. Becker,
S. W. Belling,
V. Belov,
I. Bernardi,
C. Bock,
A. Bolozdynya,
R. Bouabid,
A. Brown,
J. Browning,
B. Cabrera-Palmer,
M. Cervantes,
E. Conley,
J. Daughhetee,
J. Detwiler,
K. Ding,
M. R. Durand,
Y. Efremenko,
S. R. Elliott,
L. Fabris,
M. Febbraro,
A. Gallo Rosso
, et al. (62 additional authors not shown)
Abstract:
Using neutrinos produced at the Spallation Neutron Source (SNS) at Oak Ridge National Laboratory (ORNL), the COHERENT collaboration has studied the Pb($ν_e$,X$n$) process with a lead neutrino-induced-neutron (NIN) detector. Data from this detector are fit jointly with previously collected COHERENT data on this process. A combined analysis of the two datasets yields a cross section that is…
▽ More
Using neutrinos produced at the Spallation Neutron Source (SNS) at Oak Ridge National Laboratory (ORNL), the COHERENT collaboration has studied the Pb($ν_e$,X$n$) process with a lead neutrino-induced-neutron (NIN) detector. Data from this detector are fit jointly with previously collected COHERENT data on this process. A combined analysis of the two datasets yields a cross section that is $0.29^{+0.17}_{-0.16}$ times that predicted by the MARLEY event generator using experimentally-measured Gamow-Teller strength distributions, consistent with no NIN events at 1.8$σ$. This is the first inelastic neutrino-nucleus process COHERENT has studied, among several planned exploiting the high flux of low-energy neutrinos produced at the SNS.
△ Less
Submitted 30 October, 2023; v1 submitted 21 December, 2022;
originally announced December 2022.
-
An open-source software package for on-the-fly deskewing and live viewing of volumetric lightsheet microscopy data
Authors:
Jacob R. Lamb,
Edward N. Ward,
Clemens F. Kaminski
Abstract:
Oblique plane microscopy, OPM, is a form of lightsheet microscopy that permits volumetric imaging of biological samples at high temporal and spatial resolution. However, the imaging geometry of OPM, and related variants of light sheet microscopy, distorts the coordinate frame of the presented image sections with respect to real space coordinate frame in which the sample is moved to navigate to reg…
▽ More
Oblique plane microscopy, OPM, is a form of lightsheet microscopy that permits volumetric imaging of biological samples at high temporal and spatial resolution. However, the imaging geometry of OPM, and related variants of light sheet microscopy, distorts the coordinate frame of the presented image sections with respect to real space coordinate frame in which the sample is moved to navigate to regions of interest. This makes live viewing and practical operation of such microscopes difficult. We present an open-source software package that utilises GPU acceleration and multiprocessing to transform the display of OPM imaging data in real time to produce live views that mimic that produced by standard widefield microscopes. Image stacks can be acquired, processed and plotted at rates of several Hz, making live operation of OPMs, and similar microscopes, more user friendly and intuitive.
△ Less
Submitted 31 October, 2022;
originally announced November 2022.
-
Rupture dynamics of flat colloidal films
Authors:
Phalguni Shah,
Eleanor Ward,
Srishti Arora,
Michelle M. Driscoll
Abstract:
Here, we report experimental results on the rupture of flat colloidal films over a large range of volume fractions, 0.00 $\le φ\le$ 0.47. The films are formed using a constant fluid volume, ruptured with a needle, and recorded using a high-speed camera. We show that colloidal films rupture in a manner quantitatively similar to Newtonian fluids, even well into the shear thinning regime. These resul…
▽ More
Here, we report experimental results on the rupture of flat colloidal films over a large range of volume fractions, 0.00 $\le φ\le$ 0.47. The films are formed using a constant fluid volume, ruptured with a needle, and recorded using a high-speed camera. We show that colloidal films rupture in a manner quantitatively similar to Newtonian fluids, even well into the shear thinning regime. These results are consistent with the well-known mechanism of the rupture of Newtonian films, where the rupture rim rolls outward collecting more fluid and thus film rupture is a shear-free process. However, in the case of spontaneous rupture under controlled humidity conditions, the same dense colloidal films show exotic instabilities reminiscent of a wrinkling fabric on the film surface. These instabilities were absent in manually ruptured films. We hypothesize that these instabilities occur when the film thickness becomes thin enough to compete with the colloidal particle size, due to film drainage before spontaneous rupture. Thus, although non-Newtonian flow properties do not influence film rupture dynamics for thick enough films, the effect of microstructure has dramatic consequences in thinner films.
△ Less
Submitted 3 September, 2022;
originally announced September 2022.
-
Adaptive data collection for intra-individual studies affected by adherence
Authors:
Greta Monacelli,
Lili Zhang,
Winfried Schlee,
Berthold Langguth,
Tomás E. Ward,
Thomas B. Murphy
Abstract:
Recently the use of mobile technologies in Ecological Momentary Assessments (EMA) and Interventions (EMI) has made it easier to collect data suitable for intra-individual variability studies in the medical field. Nevertheless, especially when self-reports are used during the data collection process, there are difficulties in balancing data quality and the burden placed on the subjects. In this pap…
▽ More
Recently the use of mobile technologies in Ecological Momentary Assessments (EMA) and Interventions (EMI) has made it easier to collect data suitable for intra-individual variability studies in the medical field. Nevertheless, especially when self-reports are used during the data collection process, there are difficulties in balancing data quality and the burden placed on the subjects. In this paper, we address this problem for a specific EMA setting which aims to submit a demanding task to subjects at high/low values of a self-reported variable. We adopt a dynamic approach inspired by control chart methods and design optimization techniques to obtain an EMA triggering mechanism for data collection which takes into account both the individual variability of the self-reported variable and of the adherence rate. We test the algorithm in both a simulation setting and with real, large-scale data from a tinnitus longitudinal study. A Wilcoxon-Mann-Whitney Rank Sum Test shows that the algorithm tends to have both a higher F1 score and utility than a random schedule and a rule-based algorithm with static thresholds, which are the current state-of-the-art approaches. In conclusion, the algorithm is proven effective in balancing data quality and the burden placed on the participants, especially, as the analysis performed suggest, in studies where data collection is impacted by adherence.
△ Less
Submitted 25 July, 2022;
originally announced July 2022.
-
MAI-SIM: interferometric multicolor structured illumination microscopy for everybody
Authors:
Edward N. Ward,
Lisa Hecker,
Charles N. Christensen,
Jacob R Lamb,
Meng Lu,
Luca Mascheroni,
Chyi Wei Chung,
Anna Wang,
Christopher J. Rowlands,
Gabriele S. Kaminski Schierle,
Clemens F. Kaminski
Abstract:
Sub-diffraction resolution, gentle sample illumination, and the possibility to image in multiple colors make Structured Illumination Microscopy (SIM) an imaging technique which is particularly well suited for live cell observations. Here, we present Machine learning Assisted Interferometric-SIM (MAI-SIM), an easy-to-implement method for high speed SIM imaging in multiple colors. The instrument is…
▽ More
Sub-diffraction resolution, gentle sample illumination, and the possibility to image in multiple colors make Structured Illumination Microscopy (SIM) an imaging technique which is particularly well suited for live cell observations. Here, we present Machine learning Assisted Interferometric-SIM (MAI-SIM), an easy-to-implement method for high speed SIM imaging in multiple colors. The instrument is based on an interferometer design in which illumination patterns are generated, rotated, and stepped in phase through movement of a single galvanometric mirror element. The design is robust, flexible, and the pattern generation process works for all wavelengths. We complement the unique properties of interferometric SIM with a machine learning toolbox that is simple and efficient to use and is superior to existing methods for the reconstruction of super-resolved images recorded by the instrument. The framework permits real-time SIM reconstructions to be performed in multiple colors, providing the user with instant visualization of the super-resolved images. We demonstrate the capability of MAI-SIM on live biological samples and capture super-resolution images in multiple colors simultaneously over large fields of view. Finally, we embrace a fully open design philosophy to bring the advantages of MAI-SIM to as many users as possible and provide full details on system design and software.
△ Less
Submitted 1 June, 2022;
originally announced June 2022.
-
The COHERENT Experimental Program
Authors:
D. Akimov,
S. Alawabdeh,
P. An,
A. Arteaga,
C. Awe,
P. S. Barbeau,
C. Barry,
B. Becker,
V. Belov,
I. Bernardi,
M. A. Blackston,
L. Blokland,
C. Bock,
B. Bodur,
A. Bolozdynya,
R. Bouabid,
A. Bracho,
J. Browning,
B. Cabrera-Palmer,
N. Chen,
D. Chernyak,
E. Conley,
J. Daughhetee,
J. Daughtry,
E. Day
, et al. (106 additional authors not shown)
Abstract:
The COHERENT experiment located in Neutrino Alley at the Spallation Neutron Source (SNS), Oak Ridge National Laboratory (ORNL), has made the world's first two measurements of coherent elastic neutrino-nucleus scattering (CEvNS), on CsI and argon, using neutrinos produced at the SNS. The COHERENT collaboration continues to pursue CEvNS measurements on various targets as well as additional studies o…
▽ More
The COHERENT experiment located in Neutrino Alley at the Spallation Neutron Source (SNS), Oak Ridge National Laboratory (ORNL), has made the world's first two measurements of coherent elastic neutrino-nucleus scattering (CEvNS), on CsI and argon, using neutrinos produced at the SNS. The COHERENT collaboration continues to pursue CEvNS measurements on various targets as well as additional studies of inelastic neutrino-nucleus interactions, searches for accelerator-produced dark matter (DM) and physics beyond the Standard Model, using the uniquely high-quality and high-intensity neutrino source available at the SNS. This white paper describes primarily COHERENT's ongoing and near-future program at the SNS First Target Station (FTS). Opportunities enabled by the SNS Second Target Station (STS) for the study of neutrino physics and development of novel detector technologies are elaborated in a separate white paper.
△ Less
Submitted 9 April, 2022;
originally announced April 2022.
-
Spatio-temporal Vision Transformer for Super-resolution Microscopy
Authors:
Charles N. Christensen,
Meng Lu,
Edward N. Ward,
Pietro Lio,
Clemens F. Kaminski
Abstract:
Structured illumination microscopy (SIM) is an optical super-resolution technique that enables live-cell imaging beyond the diffraction limit. Reconstruction of SIM data is prone to artefacts, which becomes problematic when imaging highly dynamic samples because previous methods rely on the assumption that samples are static. We propose a new transformer-based reconstruction method, VSR-SIM, that…
▽ More
Structured illumination microscopy (SIM) is an optical super-resolution technique that enables live-cell imaging beyond the diffraction limit. Reconstruction of SIM data is prone to artefacts, which becomes problematic when imaging highly dynamic samples because previous methods rely on the assumption that samples are static. We propose a new transformer-based reconstruction method, VSR-SIM, that uses shifted 3-dimensional window multi-head attention in addition to channel attention mechanism to tackle the problem of video super-resolution (VSR) in SIM. The attention mechanisms are found to capture motion in sequences without the need for common motion estimation techniques such as optical flow. We take an approach to training the network that relies solely on simulated data using videos of natural scenery with a model for SIM image formation. We demonstrate a use case enabled by VSR-SIM referred to as rolling SIM imaging, which increases temporal resolution in SIM by a factor of 9. Our method can be applied to any SIM setup enabling precise recordings of dynamic processes in biomedical research with high temporal resolution.
△ Less
Submitted 28 February, 2022;
originally announced March 2022.
-
A D$_{2}$O detector for flux normalization of a pion decay-at-rest neutrino source
Authors:
COHERENT Collaboration,
D. Akimov,
P. An,
C. Awe,
P. S. Barbeau,
B. Becker,
V. Belov,
I. Bernardi,
M. A. Blackston,
L. Blokland,
A. Bolozdynya,
B. Cabrera-Palmer,
D. Chernyak,
E. Conley,
J. Daughhetee,
E. Day,
J. Detwiler,
K. Ding,
M. R. Durand,
Y. Efremenko,
S. R. Elliott,
L. Fabris,
M. Febbraro,
A. Gallo Rosso,
A. Galindo-Uribarri
, et al. (54 additional authors not shown)
Abstract:
We report on the technical design and expected performance of a 592 kg heavy-water-Cherenkov detector to measure the absolute neutrino flux from the pion-decay-at-rest neutrino source at the Spallation Neutron Source (SNS) at Oak Ridge National Laboratory (ORNL). The detector will be located roughly 20 m from the SNS target and will measure the neutrino flux with better than 5% statistical uncerta…
▽ More
We report on the technical design and expected performance of a 592 kg heavy-water-Cherenkov detector to measure the absolute neutrino flux from the pion-decay-at-rest neutrino source at the Spallation Neutron Source (SNS) at Oak Ridge National Laboratory (ORNL). The detector will be located roughly 20 m from the SNS target and will measure the neutrino flux with better than 5% statistical uncertainty in 2 years. This heavy-water detector will serve as the first module of a two-module detector system to ultimately measure the neutrino flux to 2-3% at both the First Target Station and the planned Second Target Station of the SNS. This detector will significantly reduce a dominant systematic uncertainty for neutrino cross-section measurements at the SNS, increasing the sensitivity of searches for new physics.
△ Less
Submitted 25 August, 2021; v1 submitted 19 April, 2021;
originally announced April 2021.
-
IROS 2019 Lifelong Robotic Vision Challenge -- Lifelong Object Recognition Report
Authors:
Qi She,
Fan Feng,
Qi Liu,
Rosa H. M. Chan,
Xinyue Hao,
Chuanlin Lan,
Qihan Yang,
Vincenzo Lomonaco,
German I. Parisi,
Heechul Bae,
Eoin Brophy,
Baoquan Chen,
Gabriele Graffieti,
Vidit Goel,
Hyonyoung Han,
Sathursan Kanagarajah,
Somesh Kumar,
Siew-Kei Lam,
Tin Lun Lam,
Liang Ma,
Davide Maltoni,
Lorenzo Pellegrini,
Duvindu Piyasena,
Shiliang Pu,
Debdoot Sheet
, et al. (11 additional authors not shown)
Abstract:
This report summarizes IROS 2019-Lifelong Robotic Vision Competition (Lifelong Object Recognition Challenge) with methods and results from the top $8$ finalists (out of over~$150$ teams). The competition dataset (L)ifel(O)ng (R)obotic V(IS)ion (OpenLORIS) - Object Recognition (OpenLORIS-object) is designed for driving lifelong/continual learning research and application in robotic vision domain, w…
▽ More
This report summarizes IROS 2019-Lifelong Robotic Vision Competition (Lifelong Object Recognition Challenge) with methods and results from the top $8$ finalists (out of over~$150$ teams). The competition dataset (L)ifel(O)ng (R)obotic V(IS)ion (OpenLORIS) - Object Recognition (OpenLORIS-object) is designed for driving lifelong/continual learning research and application in robotic vision domain, with everyday objects in home, office, campus, and mall scenarios. The dataset explicitly quantifies the variants of illumination, object occlusion, object size, camera-object distance/angles, and clutter information. Rules are designed to quantify the learning capability of the robotic vision system when faced with the objects appearing in the dynamic environments in the contest. Individual reports, dataset information, rules, and released source code can be found at the project homepage: "https://lifelong-robotic-vision.github.io/competition/".
△ Less
Submitted 26 April, 2020;
originally announced April 2020.
-
Predicting Injectable Medication Adherence via a Smart Sharps Bin and Machine Learning
Authors:
Yingqi Gu,
Akshay Zalkikar,
Lara Kelly,
Kieran Daly,
Tomas E. Ward
Abstract:
Medication non-adherence is a widespread problem affecting over 50% of people who have chronic illness and need chronic treatment. Non-adherence exacerbates health risks and drives significant increases in treatment costs. In order to address these challenges, the importance of predicting patients' adherence has been recognised. In other words, it is important to improve the efficiency of interven…
▽ More
Medication non-adherence is a widespread problem affecting over 50% of people who have chronic illness and need chronic treatment. Non-adherence exacerbates health risks and drives significant increases in treatment costs. In order to address these challenges, the importance of predicting patients' adherence has been recognised. In other words, it is important to improve the efficiency of interventions of the current healthcare system by prioritizing resources to the patients who are most likely to be non-adherent. Our objective in this work is to make predictions regarding individual patients' behaviour in terms of taking their medication on time during their next scheduled medication opportunity. We do this by leveraging a number of machine learning models. In particular, we demonstrate the use of a connected IoT device; a "Smart Sharps Bin", invented by HealthBeacon Ltd.; to monitor and track injection disposal of patients in their home environment. Using extensive data collected from these devices, five machine learning models, namely Extra Trees Classifier, Random Forest, XGBoost, Gradient Boosting and Multilayer Perception were trained and evaluated on a large dataset comprising 165,223 historic injection disposal records collected from 5,915 HealthBeacon units over the course of 3 years. The testing work was conducted on real-time data generated by the smart device over a time period after the model training was complete, i.e. true future data. The proposed machine learning approach demonstrated very good predictive performance exhibiting an Area Under the Receiver Operating Characteristic Curve (ROC AUC) of 0.86.
△ Less
Submitted 2 April, 2020;
originally announced April 2020.
-
Optimised Convolutional Neural Networks for Heart Rate Estimation and Human Activity Recognition in Wrist Worn Sensing Applications
Authors:
Eoin Brophy,
Willie Muehlhausen,
Alan F. Smeaton,
Tomas E. Ward
Abstract:
Wrist-worn smart devices are providing increased insights into human health, behaviour and performance through sophisticated analytics. However, battery life, device cost and sensor performance in the face of movement-related artefact present challenges which must be further addressed to see effective applications and wider adoption through commoditisation of the technology. We address these chall…
▽ More
Wrist-worn smart devices are providing increased insights into human health, behaviour and performance through sophisticated analytics. However, battery life, device cost and sensor performance in the face of movement-related artefact present challenges which must be further addressed to see effective applications and wider adoption through commoditisation of the technology. We address these challenges by demonstrating, through using a simple optical measurement, photoplethysmography (PPG) used conventionally for heart rate detection in wrist-worn sensors, that we can provide improved heart rate and human activity recognition (HAR) simultaneously at low sample rates, without an inertial measurement unit. This simplifies hardware design and reduces costs and power budgets. We apply two deep learning pipelines, one for human activity recognition and one for heart rate estimation. HAR is achieved through the application of a visual classification approach, capable of robust performance at low sample rates. Here, transfer learning is leveraged to retrain a convolutional neural network (CNN) to distinguish characteristics of the PPG during different human activities. For heart rate estimation we use a CNN adopted for regression which maps noisy optical signals to heart rate estimates. In both cases, comparisons are made with leading conventional approaches. Our results demonstrate a low sampling frequency can achieve good performance without significant degradation of accuracy. 5 Hz and 10 Hz were shown to have 80.2% and 83.0% classification accuracy for HAR respectively. These same sampling frequencies also yielded a robust heart rate estimation which was comparative with that achieved at the more energy-intensive rate of 256 Hz.
△ Less
Submitted 30 March, 2020;
originally announced April 2020.
-
ML-SIM: A deep neural network for reconstruction of structured illumination microscopy images
Authors:
Charles N. Christensen,
Edward N. Ward,
Pietro Lio,
Clemens F. Kaminski
Abstract:
Structured illumination microscopy (SIM) has become an important technique for optical super-resolution imaging because it allows a doubling of image resolution at speeds compatible for live-cell imaging. However, the reconstruction of SIM images is often slow and prone to artefacts. Here we propose a versatile reconstruction method, ML-SIM, which makes use of machine learning. The model is an end…
▽ More
Structured illumination microscopy (SIM) has become an important technique for optical super-resolution imaging because it allows a doubling of image resolution at speeds compatible for live-cell imaging. However, the reconstruction of SIM images is often slow and prone to artefacts. Here we propose a versatile reconstruction method, ML-SIM, which makes use of machine learning. The model is an end-to-end deep residual neural network that is trained on a simulated data set to be free of common SIM artefacts. ML-SIM is thus robust to noise and irregularities in the illumination patterns of the raw SIM input frames. The reconstruction method is widely applicable and does not require the acquisition of experimental training data. Since the training data are generated from simulations of the SIM process on images from generic libraries the method can be efficiently adapted to specific experimental SIM implementations. The reconstruction quality enabled by our method is compared with traditional SIM reconstruction methods, and we demonstrate advantages in terms of noise, reconstruction fidelity and contrast for both simulated and experimental inputs. In addition, reconstruction of one SIM frame typically only takes ~100ms to perform on PCs with modern Nvidia graphics cards, making the technique compatible with real-time imaging. The full implementation and the trained networks are available at http://ML-SIM.com.
△ Less
Submitted 24 March, 2020;
originally announced March 2020.
-
A Neuro-AI Interface for Evaluating Generative Adversarial Networks
Authors:
Zhengwei Wang,
Qi She,
Alan F. Smeaton,
Tomas E. Ward,
Graham Healy
Abstract:
Generative adversarial networks (GANs) are increasingly attracting attention in the computer vision, natural language processing, speech synthesis and similar domains. However, evaluating the performance of GANs is still an open and challenging problem. Existing evaluation metrics primarily measure the dissimilarity between real and generated images using automated statistical methods. They often…
▽ More
Generative adversarial networks (GANs) are increasingly attracting attention in the computer vision, natural language processing, speech synthesis and similar domains. However, evaluating the performance of GANs is still an open and challenging problem. Existing evaluation metrics primarily measure the dissimilarity between real and generated images using automated statistical methods. They often require large sample sizes for evaluation and do not directly reflect human perception of image quality. In this work, we introduce an evaluation metric called Neuroscore, for evaluating the performance of GANs, that more directly reflects psychoperceptual image quality through the utilization of brain signals. Our results show that Neuroscore has superior performance to the current evaluation metrics in that: (1) It is more consistent with human judgment; (2) The evaluation process needs much smaller numbers of samples; and (3) It is able to rank the quality of images on a per GAN basis. A convolutional neural network (CNN) based neuro-AI interface is proposed to predict Neuroscore from GAN-generated images directly without the need for neural responses. Importantly, we show that including neural responses during the training phase of the network can significantly improve the prediction capability of the proposed model. Codes and data can be referred at this link: https://github.com/villawang/Neuro-AI-Interface.
△ Less
Submitted 6 April, 2020; v1 submitted 5 March, 2020;
originally announced March 2020.
-
Statistics of VHE gamma-Rays in Temporal Association with Radio Giant Pulses from the Crab Pulsar
Authors:
MAGIC Collaboration,
M. L. Ahnen,
S. Ansoldi,
L. A. Antonelli,
C. Arcaro,
A. Babić,
B. Banerjee,
P. Bangale,
U. Barres de Almeida,
J. A. Barrio,
J. Becerra González,
W. Bednarek,
E. Bernardini,
A. Berti,
W. Bhattacharyya,
B. Biasuzzi,
A. Biland,
O. Blanch,
G. Bonnoli,
R. Carosi,
A. Carosi,
A. Chatterjee,
S. M. Colak,
P. Colin,
E. Colombo
, et al. (124 additional authors not shown)
Abstract:
The aim of this study is to search for evidence of a common emission engine between radio giant pulses (GPs) and very-high-energy (VHE, E>100 GeV) gamma-rays from the Crab pulsar. 16 hours of simultaneous observations of the Crab pulsar at 1.4 GHz with the Effelsberg radio telescope and the Westerbork Synthesis Radio Telescope (WSRT), and at energies above 60 GeV with the Major Atmospheric Gamma-r…
▽ More
The aim of this study is to search for evidence of a common emission engine between radio giant pulses (GPs) and very-high-energy (VHE, E>100 GeV) gamma-rays from the Crab pulsar. 16 hours of simultaneous observations of the Crab pulsar at 1.4 GHz with the Effelsberg radio telescope and the Westerbork Synthesis Radio Telescope (WSRT), and at energies above 60 GeV with the Major Atmospheric Gamma-ray Imaging Cherenkov (MAGIC) telescopes were performed. We searched for a statistical correlation between the radio and VHE gamma-ray emission with search windows of different lengths and different time lags to the arrival times of a radio GP. A dedicated search for an enhancement in the number of VHE gamma-rays correlated with the occurrence of radio GPs was carried out separately for the P1 and P2 phase ranges respectively. 99444 radio GPs have been detected in the radio data sample. We find no significant correlation between the GPs and VHE photons in any of the search windows. Depending on phase cuts and the chosen search windows we find upper limits at 95% confidence level on an increase in VHE gamma-ray events correlated with radio GPs between 7% and 61% of the average Crab pulsar VHE flux for the P1 and P2 phase ranges respectively. This puts upper limits on the flux increase during a radio GP of 12% to 2900% (depending on search window duration and phase cuts) of the pulsed VHE flux. This is the most stringent upper limit on a correlation between gamma-ray emission and radio GPs reported so far.}
△ Less
Submitted 31 January, 2020; v1 submitted 1 November, 2019;
originally announced November 2019.
-
Synthesis of Realistic ECG using Generative Adversarial Networks
Authors:
Anne Marie Delaney,
Eoin Brophy,
Tomas E. Ward
Abstract:
Access to medical data is highly restricted due to its sensitive nature, preventing communities from using this data for research or clinical training. Common methods of de-identification implemented to enable the sharing of data are sometimes inadequate to protect the individuals contained in the data. For our research, we investigate the ability of generative adversarial networks (GANs) to produ…
▽ More
Access to medical data is highly restricted due to its sensitive nature, preventing communities from using this data for research or clinical training. Common methods of de-identification implemented to enable the sharing of data are sometimes inadequate to protect the individuals contained in the data. For our research, we investigate the ability of generative adversarial networks (GANs) to produce realistic medical time series data which can be used without concerns over privacy. The aim is to generate synthetic ECG signals representative of normal ECG waveforms. GANs have been used successfully to generate good quality synthetic time series and have been shown to prevent re-identification of individual records. In this work, a range of GAN architectures are developed to generate synthetic sine waves and synthetic ECG. Two evaluation metrics are then used to quantitatively assess how suitable the synthetic data is for real world applications such as clinical training and data analysis. Finally, we discuss the privacy concerns associated with sharing synthetic data produced by GANs and test their ability to withstand a simple membership inference attack. For the first time we both quantitatively and qualitatively demonstrate that GAN architecture can successfully generate time series signals that are not only structurally similar to the training sets but also diverse in nature across generated samples. We also report on their ability to withstand a simple membership inference attack, protecting the privacy of the training set.
△ Less
Submitted 19 September, 2019;
originally announced September 2019.
-
Lightweight and Scalable Particle Tracking and Motion Clustering of 3D Cell Trajectories
Authors:
Mojtaba S. Fazli,
Rachel V. Stadler,
BahaaEddin Alaila,
Stephen A. Vella,
Silvia N. J. Moreno,
Gary E. Ward,
Shannon Quinn
Abstract:
Tracking cell particles in 3D microscopy videos is a challenging task but is of great significance for modeling the motion of cells. Proper characterization of the cell's shape, evolution, and their movement over time is crucial to understanding and modeling the mechanobiology of cell migration in many diseases. One in particular, toxoplasmosis is the disease caused by the parasite Toxoplasma gond…
▽ More
Tracking cell particles in 3D microscopy videos is a challenging task but is of great significance for modeling the motion of cells. Proper characterization of the cell's shape, evolution, and their movement over time is crucial to understanding and modeling the mechanobiology of cell migration in many diseases. One in particular, toxoplasmosis is the disease caused by the parasite Toxoplasma gondii. Roughly, one-third of the world's population tests positive for T. gondii. Its virulence is linked to its lytic cycle, predicated on its motility and ability to enter and exit nucleated cells; therefore, studies elucidating its motility patterns are critical to the eventual development of therapeutic strategies. Here, we present a computational framework for fast and scalable detection, tracking, and identification of T. gondii motion phenotypes in 3D videos, in a completely unsupervised fashion. Our pipeline consists of several different modules including preprocessing, sparsification, cell detection, cell tracking, trajectories extraction, parametrization of the trajectories; and finally, a clustering step. Additionally, we identified the computational bottlenecks, and developed a lightweight and highly scalable pipeline through a combination of task distribution and parallelism. Our results prove both the accuracy and performance of our method.
△ Less
Submitted 12 January, 2021; v1 submitted 10 August, 2019;
originally announced August 2019.
-
Generative Adversarial Networks in Computer Vision: A Survey and Taxonomy
Authors:
Zhengwei Wang,
Qi She,
Tomas E. Ward
Abstract:
Generative adversarial networks (GANs) have been extensively studied in the past few years. Arguably their most significant impact has been in the area of computer vision where great advances have been made in challenges such as plausible image generation, image-to-image translation, facial attribute manipulation and similar domains. Despite the significant successes achieved to date, applying GAN…
▽ More
Generative adversarial networks (GANs) have been extensively studied in the past few years. Arguably their most significant impact has been in the area of computer vision where great advances have been made in challenges such as plausible image generation, image-to-image translation, facial attribute manipulation and similar domains. Despite the significant successes achieved to date, applying GANs to real-world problems still poses significant challenges, three of which we focus on here. These are: (1) the generation of high quality images, (2) diversity of image generation, and (3) stable training. Focusing on the degree to which popular GAN technologies have made progress against these challenges, we provide a detailed review of the state of the art in GAN-related research in the published scientific literature. We further structure this review through a convenient taxonomy we have adopted based on variations in GAN architectures and loss functions. While several reviews for GANs have been presented to date, none have considered the status of this field based on their progress towards addressing practical challenges relevant to computer vision. Accordingly, we review and critically discuss the most popular architecture-variant, and loss-variant GANs, for tackling these challenges. Our objective is to provide an overview as well as a critical analysis of the status of GAN research in terms of relevant progress towards important computer vision application requirements. As we do this we also discuss the most compelling applications in computer vision in which GANs have demonstrated considerable success along with some suggestions for future research directions. Code related to GAN-variants studied in this work is summarized on https://github.com/sheqi/GAN_Review.
△ Less
Submitted 29 December, 2020; v1 submitted 4 June, 2019;
originally announced June 2019.
-
Synthetic-Neuroscore: Using A Neuro-AI Interface for Evaluating Generative Adversarial Networks
Authors:
Zhengwei Wang,
Qi She,
Alan F. Smeaton,
Tomas E. Ward,
Graham Healy
Abstract:
Generative adversarial networks (GANs) are increasingly attracting attention in the computer vision, natural language processing, speech synthesis and similar domains. Arguably the most striking results have been in the area of image synthesis. However, evaluating the performance of GANs is still an open and challenging problem. Existing evaluation metrics primarily measure the dissimilarity betwe…
▽ More
Generative adversarial networks (GANs) are increasingly attracting attention in the computer vision, natural language processing, speech synthesis and similar domains. Arguably the most striking results have been in the area of image synthesis. However, evaluating the performance of GANs is still an open and challenging problem. Existing evaluation metrics primarily measure the dissimilarity between real and generated images using automated statistical methods. They often require large sample sizes for evaluation and do not directly reflect human perception of image quality. In this work, we describe an evaluation metric we call Neuroscore, for evaluating the performance of GANs, that more directly reflects psychoperceptual image quality through the utilization of brain signals. Our results show that Neuroscore has superior performance to the current evaluation metrics in that: (1) It is more consistent with human judgment; (2) The evaluation process needs much smaller numbers of samples; and (3) It is able to rank the quality of images on a per GAN basis. A convolutional neural network (CNN) based neuro-AI interface is proposed to predict Neuroscore from GAN-generated images directly without the need for neural responses. Importantly, we show that including neural responses during the training phase of the network can significantly improve the prediction capability of the proposed model. Materials related to this work are provided at https://github.com/villawang/Neuro-AI-Interface.
△ Less
Submitted 2 February, 2020; v1 submitted 10 May, 2019;
originally announced May 2019.
-
Quick and Easy Time Series Generation with Established Image-based GANs
Authors:
Eoin Brophy,
Zhengwei Wang,
Tomas E. Ward
Abstract:
In the recent years Generative Adversarial Networks (GANs) have demonstrated significant progress in generating authentic looking data. In this work we introduce our simple method to exploit the advancements in well established image-based GANs to synthesise single channel time series data. We implement Wasserstein GANs (WGANs) with gradient penalty due to their stability in training to synthesise…
▽ More
In the recent years Generative Adversarial Networks (GANs) have demonstrated significant progress in generating authentic looking data. In this work we introduce our simple method to exploit the advancements in well established image-based GANs to synthesise single channel time series data. We implement Wasserstein GANs (WGANs) with gradient penalty due to their stability in training to synthesise three different types of data; sinusoidal data, photoplethysmograph (PPG) data and electrocardiograph (ECG) data. The length of the returned time series data is limited only by the image resolution, we use an image size of 64x64 pixels which yields 4096 data points. We present both visual and quantitative evidence that our novel method can successfully generate time series data using image-based GANs.
△ Less
Submitted 29 October, 2019; v1 submitted 14 February, 2019;
originally announced February 2019.
-
Top SciComm: Communicating ATLAS Top Physics Results to the Public
Authors:
Clara Nellist,
Katarina Anthony,
Steven Goldfarb,
Sascha Mehlhase,
Kate Shaw,
Savannah Jennifer Thais,
Emma Ward
Abstract:
An essential component of the long-term success of scientific research is communicating the methodology and significance of new results to the wider public. Utilising various social media platforms is a vital tool for this endeavour. Over the years, there have been a number of important results on top physics released by the ATLAS Collaboration. These have been communicated through audience-tailor…
▽ More
An essential component of the long-term success of scientific research is communicating the methodology and significance of new results to the wider public. Utilising various social media platforms is a vital tool for this endeavour. Over the years, there have been a number of important results on top physics released by the ATLAS Collaboration. These have been communicated through audience-tailored content, including ATLAS physics briefings, videos, and press statements, amongst others. The ATLAS Collaboration has continued to adapt its communication strategy to match the social media evolution, producing content specifically targeting this emerging audience, the effect of which has been explored.
△ Less
Submitted 31 January, 2019;
originally announced January 2019.
-
The Light-Trap: A novel concept for a large SiPM-based pixel for Very High Energy gamma-ray astronomy and beyond
Authors:
D. Guberman,
J. Cortina,
J. E. Ward,
E. Do Souto Espiñera,
A. Hahn,
D. Mazin
Abstract:
Among the main disadvantages of using silicon photomultipliers (SiPMs) in large experiments are their limited physical area (increasing the cost and the complexity of the readout of a camera) and their sensitivity to unwanted wavelengths. This explains why photomultiplier tubes (PMTs) are still selected for the largest cameras of present and future Very High Energy (VHE) gamma-ray telescopes. Thes…
▽ More
Among the main disadvantages of using silicon photomultipliers (SiPMs) in large experiments are their limited physical area (increasing the cost and the complexity of the readout of a camera) and their sensitivity to unwanted wavelengths. This explains why photomultiplier tubes (PMTs) are still selected for the largest cameras of present and future Very High Energy (VHE) gamma-ray telescopes. These telescopes require photosensors that are sensitive to the fast and dim optical/near-UV Cherenkov radiation emitted due to the interaction of gamma rays with the atmosphere. Here we introduce a low-cost pixel consisting of a SiPM attached to a PMMA disk doped with a wavelength-shifting material, which collects light over a much larger area than standard SiPMs, increases sensitivity to near-UV light and improves background rejection. We also show the measurements performed in the laboratory with a proof-of-concept \textit{Light-Trap} pixel that is equipped with a 3$\times$3~mm$^2$ SiPM collecting light only in the 300-400~nm band, covering an area $\sim$20 times larger than that of the same SiPM itself. We also present results from simulations performed with Geant4 to evaluate its performance. In addition to VHE astronomy, this pixel could have other applications in fields where detection area and cost are critical.
△ Less
Submitted 17 January, 2019;
originally announced January 2019.
-
Spatial Filtering Pipeline Evaluation of Cortically Coupled Computer Vision System for Rapid Serial Visual Presentation
Authors:
Zhengwei Wang,
Graham Healy,
Alan F. Smeaton,
Tomas E. Ward
Abstract:
Rapid Serial Visual Presentation (RSVP) is a paradigm that supports the application of cortically coupled computer vision to rapid image search. In RSVP, images are presented to participants in a rapid serial sequence which can evoke Event-related Potentials (ERPs) detectable in their Electroencephalogram (EEG). The contemporary approach to this problem involves supervised spatial filtering techni…
▽ More
Rapid Serial Visual Presentation (RSVP) is a paradigm that supports the application of cortically coupled computer vision to rapid image search. In RSVP, images are presented to participants in a rapid serial sequence which can evoke Event-related Potentials (ERPs) detectable in their Electroencephalogram (EEG). The contemporary approach to this problem involves supervised spatial filtering techniques which are applied for the purposes of enhancing the discriminative information in the EEG data. In this paper we make two primary contributions to that field: 1) We propose a novel spatial filtering method which we call the Multiple Time Window LDA Beamformer (MTWLB) method; 2) we provide a comprehensive comparison of nine spatial filtering pipelines using three spatial filtering schemes namely, MTWLB, xDAWN, Common Spatial Pattern (CSP) and three linear classification methods Linear Discriminant Analysis (LDA), Bayesian Linear Regression (BLR) and Logistic Regression (LR). Three pipelines without spatial filtering are used as baseline comparison. The Area Under Curve (AUC) is used as an evaluation metric in this paper. The results reveal that MTWLB and xDAWN spatial filtering techniques enhance the classification performance of the pipeline but CSP does not. The results also support the conclusion that LR can be effective for RSVP based BCI if discriminative features are available.
△ Less
Submitted 14 January, 2019;
originally announced January 2019.
-
MAGIC and Fermi-LAT gamma-ray results on unassociated HAWC sources
Authors:
M. L. Ahnen,
S. Ansoldi,
L. A. Antonelli,
C. Arcaro,
D. Baack,
A. Babić,
B. Banerjee,
P. Bangale,
U. Barres de Almeida,
J. A. Barrio,
J. Becerra González,
W. Bednarek,
E. Bernardini,
R. Ch. Berse,
A. Berti,
W. Bhattacharyya,
A. Biland,
O. Blanch,
G. Bonnoli,
R. Carosi,
A. Carosi,
G. Ceribella,
A. Chatterjee,
S. M. Colak,
P. Colin
, et al. (318 additional authors not shown)
Abstract:
The HAWC Collaboration released the 2HWC catalog of TeV sources, in which 19 show no association with any known high-energy (HE; E > 10 GeV) or very-high-energy (VHE; E > 300 GeV) sources. This catalog motivated follow-up studies by both the MAGIC and Fermi-LAT observatories with the aim of investigating gamma-ray emission over a broad energy band. In this paper, we report the results from the fir…
▽ More
The HAWC Collaboration released the 2HWC catalog of TeV sources, in which 19 show no association with any known high-energy (HE; E > 10 GeV) or very-high-energy (VHE; E > 300 GeV) sources. This catalog motivated follow-up studies by both the MAGIC and Fermi-LAT observatories with the aim of investigating gamma-ray emission over a broad energy band. In this paper, we report the results from the first joint work between HAWC, MAGIC and Fermi-LAT on three unassociated HAWC sources: 2HWC J2006+341, 2HWC J1907+084* and 2HWC J1852+013*. Although no significant detection was found in the HE and VHE regimes, this investigation shows that a minimum 1 degree extension (at 95% confidence level) and harder spectrum in the GeV than the one extrapolated from HAWC results are required in the case of 2HWC J1852+013*, while a simply minimum extension of 0.16 degrees (at 95% confidence level) can already explain the scenario proposed by HAWC for the remaining sources. Moreover, the hypothesis that these sources are pulsar wind nebulae is also investigated in detail.
△ Less
Submitted 13 January, 2019;
originally announced January 2019.
-
Discovery of TeV $γ$-ray emission from the neighbourhood of the supernova remnant G24.7+0.6 by MAGIC
Authors:
MAGIC Collaboration,
V. A. Acciari,
S. Ansoldi,
L. A. Antonelli,
A. Arbet Engels,
C. Arcaro,
D. Baack,
A. Babić,
B. Banerjee,
P. Bangale,
U. Barres de Almeida,
J. A. Barrio,
J. Becerra González,
W. Bednarek,
E. Bernardini,
A. Berti,
J. Besenrieder,
W. Bhattacharyya,
C. Bigongiari,
A. Biland,
O. Blanch,
G. Bonnoli,
R. Carosi,
G. Ceribella,
A. Chatterjee
, et al. (129 additional authors not shown)
Abstract:
SNR G24.7+0.6 is a 9.5 kyrs radio and $γ$-ray supernova remnant evolving in a dense medium. In the GeV regime, SNR G24.7+0.6 (3FHL\,J1834.1--0706e/FGES\,J1834.1--0706) shows a hard spectral index ($Γ$$\sim$2) up to $200$\,GeV, which makes it a good candidate to be observed with Cherenkov telescopes such as MAGIC. We observed the field of view of \snr\ with the MAGIC telescopes for a total of 31 ho…
▽ More
SNR G24.7+0.6 is a 9.5 kyrs radio and $γ$-ray supernova remnant evolving in a dense medium. In the GeV regime, SNR G24.7+0.6 (3FHL\,J1834.1--0706e/FGES\,J1834.1--0706) shows a hard spectral index ($Γ$$\sim$2) up to $200$\,GeV, which makes it a good candidate to be observed with Cherenkov telescopes such as MAGIC. We observed the field of view of \snr\ with the MAGIC telescopes for a total of 31 hours. We detect very high energy $γ$-ray emission from an extended source located 0.34\degr\ away from the center of the radio SNR. The new source, named \mgc\ is detected up to 5\,TeV, and its spectrum is well-represented by a power-law function with spectral index of $2.74 \pm 0.08$. The complexity of the region makes the identification of the origin of the very-high energy emission difficult, however the spectral agreement with the LAT source and overlapping position at less than 1.5$σ$ point to a common origin. We analysed 8 years of \fermi-LAT data to extend the spectrum of the source down to 60\,MeV. \fermi-LAT and MAGIC spectra overlap within errors and the global broad band spectrum is described by a power-law with exponential cutoff at $1.9\pm0.5$\,TeV. The detected $γ$-ray emission can be interpreted as the results of proton-proton interaction between the supernova and the CO-rich surrounding.
△ Less
Submitted 12 December, 2018;
originally announced December 2018.
-
An Interpretable Machine Vision Approach to Human Activity Recognition using Photoplethysmograph Sensor Data
Authors:
Eoin Brophy,
José Juan Dominguez Veiga,
Zhengwei Wang,
Alan F. Smeaton,
Tomas E. Ward
Abstract:
The current gold standard for human activity recognition (HAR) is based on the use of cameras. However, the poor scalability of camera systems renders them impractical in pursuit of the goal of wider adoption of HAR in mobile computing contexts. Consequently, researchers instead rely on wearable sensors and in particular inertial sensors. A particularly prevalent wearable is the smart watch which…
▽ More
The current gold standard for human activity recognition (HAR) is based on the use of cameras. However, the poor scalability of camera systems renders them impractical in pursuit of the goal of wider adoption of HAR in mobile computing contexts. Consequently, researchers instead rely on wearable sensors and in particular inertial sensors. A particularly prevalent wearable is the smart watch which due to its integrated inertial and optical sensing capabilities holds great potential for realising better HAR in a non-obtrusive way. This paper seeks to simplify the wearable approach to HAR through determining if the wrist-mounted optical sensor alone typically found in a smartwatch or similar device can be used as a useful source of data for activity recognition. The approach has the potential to eliminate the need for the inertial sensing element which would in turn reduce the cost of and complexity of smartwatches and fitness trackers. This could potentially commoditise the hardware requirements for HAR while retaining the functionality of both heart rate monitoring and activity capture all from a single optical sensor. Our approach relies on the adoption of machine vision for activity recognition based on suitably scaled plots of the optical signals. We take this approach so as to produce classifications that are easily explainable and interpretable by non-technical users. More specifically, images of photoplethysmography signal time series are used to retrain the penultimate layer of a convolutional neural network which has initially been trained on the ImageNet database. We then use the 2048 dimensional features from the penultimate layer as input to a support vector machine. Results from the experiment yielded an average classification accuracy of 92.3%. This result outperforms that of an optical and inertial sensor combined (78%) and illustrates the capability of HAR systems using...
△ Less
Submitted 3 December, 2018;
originally announced December 2018.
-
Use of Neural Signals to Evaluate the Quality of Generative Adversarial Network Performance in Facial Image Generation
Authors:
Zhengwei Wang,
Graham Healy,
Alan F. Smeaton,
Tomas E. Ward
Abstract:
There is a growing interest in using generative adversarial networks (GANs) to produce image content that is indistinguishable from real images as judged by a typical person. A number of GAN variants for this purpose have been proposed, however, evaluating GANs performance is inherently difficult because current methods for measuring the quality of their output are not always consistent with what…
▽ More
There is a growing interest in using generative adversarial networks (GANs) to produce image content that is indistinguishable from real images as judged by a typical person. A number of GAN variants for this purpose have been proposed, however, evaluating GANs performance is inherently difficult because current methods for measuring the quality of their output are not always consistent with what a human perceives. We propose a novel approach that combines a brain-computer interface (BCI) with GANs to generate a measure we call Neuroscore, which closely mirrors the behavioral ground truth measured from participants tasked with discerning real from synthetic images. This technique we call a neuro-AI interface, as it provides an interface between a human's neural systems and an AI process. In this paper, we first compare the three most widely used metrics in the literature for evaluating GANs in terms of visual quality and compare their outputs with human judgments. Secondly we propose and demonstrate a novel approach using neural signals and rapid serial visual presentation (RSVP) that directly measures a human perceptual response to facial production quality, independent of a behavioral response measurement. The correlation between our proposed Neuroscore and human perceptual judgments has Pearson correlation statistics: $\mathrm{r}(48) = -0.767, \mathrm{p} = 2.089e-10$. We also present the bootstrap result for the correlation i.e., $\mathrm{p}\leq 0.0001$. Results show that our Neuroscore is more consistent with human judgment compared to the conventional metrics we evaluated. We conclude that neural signals have potential applications for high quality, rapid evaluation of GANs in the context of visual image synthesis.
△ Less
Submitted 13 September, 2019; v1 submitted 9 November, 2018;
originally announced November 2018.
-
Constraining very-high-energy and optical emission from FRB 121102 with the MAGIC telescopes
Authors:
MAGIC Collaboration,
V. A. Acciari,
S. Ansoldi,
L. A. Antonelli,
A. Arbet Engels,
C. Arcaro,
D. Baack,
A. Babić,
B. Banerjee,
P. Bangale,
U. Barres de Almeida,
J. A. Barrio,
J. Becerra González,
W. Bednarek,
E. Bernardini,
A. Berti,
J. Besenrieder,
W. Bhattacharyya,
C. Bigongiari,
A. Biland,
O. Blanch,
G. Bonnoli,
R. Carosi,
G. Ceribella,
A. Chatterjee
, et al. (133 additional authors not shown)
Abstract:
Fast radio bursts (FRBs) are bright flashes observed typically at GHz frequencies with millisecond duration, whose origin is likely extragalactic. Their nature remains mysterious, motivating searches for counterparts at other wavelengths. FRB 121102 is so far the only source known to repeatedly emit FRBs and is associated with a host galaxy at redshift $z \simeq 0.193$. We conducted simultaneous o…
▽ More
Fast radio bursts (FRBs) are bright flashes observed typically at GHz frequencies with millisecond duration, whose origin is likely extragalactic. Their nature remains mysterious, motivating searches for counterparts at other wavelengths. FRB 121102 is so far the only source known to repeatedly emit FRBs and is associated with a host galaxy at redshift $z \simeq 0.193$. We conducted simultaneous observations of FRB 121102 with the Arecibo and MAGIC telescopes during several epochs in 2016--2017. This allowed searches for millisecond-timescale burst emission in very-high-energy (VHE) gamma rays as well as the optical band. While a total of five FRBs were detected during these observations, no VHE emission was detected, neither of a persistent nature nor burst-like associated with the FRBs. The average integral flux upper limits above 100 GeV at 95% confidence level are $6.6 \times 10^{-12}~\mathrm{photons\ cm^{-2}\ s^{-1}}$ (corresponding to luminosity $L_{\rm VHE} \lesssim 10^{45}~\mathrm{erg\ s^{-1}}$) over the entire observation period, and $1.2 \times 10^{-7}~ \mathrm{photons\ cm^{-2}\ s^{-1}}$ ($L_{\rm VHE} \lesssim 10^{49}~\mathrm{erg\ s^{-1}}$) over the total duration of the five FRBs. We constrain the optical U-band flux to be below 8.6 mJy at 5-$σ$ level for 1-ms intervals around the FRB arrival times. A bright burst with U-band flux $29~\mathrm{mJy}$ and duration $\sim 12$ ms was detected 4.3 s before the arrival of one FRB. However, the probability of spuriously detecting such a signal within the sampled time space is 1.5% (2.2 $σ$, post-trial), i.e. consistent with the expected background. We discuss the implications of the obtained upper limits for constraining FRB models.
△ Less
Submitted 3 September, 2018;
originally announced September 2018.
-
The extreme HBL behaviour of Markarian 501 during 2012
Authors:
M. L. Ahnen,
S. Ansoldi,
L. A. Antonelli,
C. Arcaro,
A. Babić,
B. Banerjee,
P. Bangale,
U. Barres de Almeida,
J. A. Barrio,
J. Becerra González,
W. Bednarek,
E. Bernardini,
A. Berti,
W. Bhattacharyya,
O. Blanch,
G. Bonnoli,
R. Carosi,
A. Carosi,
A. Chatterjee,
S. M. Colak,
P. Colin,
E. Colombo,
J. L. Contreras,
J. Cortina,
S. Covino
, et al. (254 additional authors not shown)
Abstract:
A multiwavelength campaign was organized to take place between March and July of 2012. Excellent temporal coverage was obtained with more than 25 instruments, including the MAGIC, FACT and VERITAS Cherenkov telescopes, the instruments on board the Swift and Fermi spacecraft, and the telescopes operated by the GASP-WEBT collaboration.
Mrk 501 showed a very high energy (VHE) gamma-ray flux above 0…
▽ More
A multiwavelength campaign was organized to take place between March and July of 2012. Excellent temporal coverage was obtained with more than 25 instruments, including the MAGIC, FACT and VERITAS Cherenkov telescopes, the instruments on board the Swift and Fermi spacecraft, and the telescopes operated by the GASP-WEBT collaboration.
Mrk 501 showed a very high energy (VHE) gamma-ray flux above 0.2 TeV of $\sim$0.5 times the Crab Nebula flux (CU) for most of the campaign. The highest activity occurred on 2012 June 9, when the VHE flux was $\sim$3 CU, and the peak of the high-energy spectral component was found to be at $\sim$2 TeV. This study reports very hard X-ray spectra, and the hardest VHE spectra measured to date for Mrk 501. The fractional variability was found to increase with energy, with the highest variability occurring at VHE, and a significant correlation between the X-ray and VHE bands.
The unprecedentedly hard X-ray and VHE spectra measured imply that their low- and high-energy components peaked above 5 keV and 0.5 TeV, respectively, during a large fraction of the observing campaign, and hence that Mrk 501 behaved like an extreme high-frequency- peaked blazar (EHBL) throughout the 2012 observing season. This suggests that being an EHBL may not be a permanent characteristic of a blazar, but rather a state which may change over time. The one-zone synchrotron self-Compton (SSC) scenario can successfully describe the segments of the SED where most energy is emitted, with a significant correlation between the electron energy density and the VHE gamma-ray activity, suggesting that most of the variability may be explained by the injection of high-energy electrons. The one-zone SSC scenario used reproduces the behaviour seen between the measured X-ray and VHE gamma-ray fluxes, and predicts that the correlation becomes stronger with increasing energy of the X-rays.
△ Less
Submitted 14 August, 2018; v1 submitted 13 August, 2018;
originally announced August 2018.
-
The blazar TXS 0506+056 associated with a high-energy neutrino: insights into extragalactic jets and cosmic ray acceleration
Authors:
S. Ansoldi,
L. A. Antonelli,
C. Arcaro,
D. Baack,
A. Babić,
B. Banerjee,
P. Bangale,
U. Barres de Almeida,
J. A. Barrio,
J. Becerra González,
W. Bednarek,
E. Bernardini,
R. Ch. Berse,
A. Berti,
J. Besenrieder,
W. Bhattacharyya,
C. Bigongiari,
A. Biland,
O. Blanch,
G. Bonnoli,
R. Carosi,
G. Ceribella,
A. Chatterjee,
S. M. Colak,
P. Colin
, et al. (124 additional authors not shown)
Abstract:
A neutrino with energy of $\sim$290 TeV, IceCube-170922A, was detected in coincidence with the BL Lac object TXS~0506+056 during enhanced gamma-ray activity, with chance coincidence being rejected at $\sim 3σ$ level. We monitored the object in the very-high-energy (VHE) band with the MAGIC telescopes for $\sim$41 hours from 1.3 to 40.4 days after the neutrino detection. Day-timescale variability i…
▽ More
A neutrino with energy of $\sim$290 TeV, IceCube-170922A, was detected in coincidence with the BL Lac object TXS~0506+056 during enhanced gamma-ray activity, with chance coincidence being rejected at $\sim 3σ$ level. We monitored the object in the very-high-energy (VHE) band with the MAGIC telescopes for $\sim$41 hours from 1.3 to 40.4 days after the neutrino detection. Day-timescale variability is clearly resolved. We interpret the quasi-simultaneous neutrino and broadband electromagnetic observations with a novel one-zone lepto-hadronic model, based on interactions of electrons and protons co-accelerated in the jet with external photons originating from a slow-moving plasma sheath surrounding the faster jet spine. We can reproduce the multiwavelength spectra of TXS 0506+056 with neutrino rate and energy compatible with IceCube-170922A, and with plausible values for the jet power of $\sim 10^{45} - 4 \times 10^{46} {\rm erg \ s^{-1}}$. The steep spectrum observed by MAGIC is concordant with internal $γγ$ absorption above a few tens of GeV entailed by photohadronic production of a $\sim$290 TeV neutrino, corroborating a genuine connection between the multi-messenger signals. In contrast to previous predictions of predominantly hadronic emission from neutrino sources, the gamma-rays can be mostly ascribed to inverse Compton up-scattering of external photons by accelerated electrons. The X-ray and VHE bands provide crucial constraints on the emission from both accelerated electrons and protons. We infer that the maximum energy of protons in the jet co-moving frame can be in the range $\sim 10^{14}$ to $10^{18}$ eV.
△ Less
Submitted 30 July, 2018; v1 submitted 11 July, 2018;
originally announced July 2018.
-
The broad-band properties of the intermediate synchrotron peaked BL Lac S2 0109+22 from radio to VHE gamma rays
Authors:
MAGIC Collaboration,
S. Ansoldi,
L. A. Antonelli,
C. Arcaro,
D. Baack,
A. Babić,
B. Banerjee,
P. Bangale,
U. Barres de Almeida,
J. A. Barrio,
J. Becerra González,
W. Bednarek,
E. Bernardini,
R. Ch. Berse,
A. Berti,
J. Besenrieder,
W. Bhattacharyya,
C. Bigongiari,
A. Biland,
O. Blanch,
G. Bonnoli,
R. Carosi,
G. Ceribella,
A. Chatterjee,
S. M. Colak
, et al. (141 additional authors not shown)
Abstract:
The MAGIC telescopes observed S2 0109+22 in 2015 July during its flaring activity in high energy gamma rays observed by Fermi-LAT. We analyse the MAGIC data to characterise the very high energy (VHE) gamma-ray emission of S2 0109+22, which belongs to the subclass of intermediate synchrotron peak (ISP) BL Lac objects. We study the multi-frequency emission in order to investigate the source classifi…
▽ More
The MAGIC telescopes observed S2 0109+22 in 2015 July during its flaring activity in high energy gamma rays observed by Fermi-LAT. We analyse the MAGIC data to characterise the very high energy (VHE) gamma-ray emission of S2 0109+22, which belongs to the subclass of intermediate synchrotron peak (ISP) BL Lac objects. We study the multi-frequency emission in order to investigate the source classification. Finally, we compare the source long-term behaviour to other VHE gamma-ray emitting (TeV) blazars. We performed a temporal and spectral analysis of the data centred around the MAGIC interval of observation (MJD 57225-57231). Long-term radio and optical data have also been investigated using the discrete correlation function. The redshift of the source is estimated through optical host-galaxy imaging and also using the amount of VHE gamma-ray absorption. The quasi-simultaneous multi-frequency spectral energy distribution (SED) is modelled with the conventional one-zone synchrotron self-Compton (SSC) model. MAGIC observations resulted in the detection of the source at a significance level of $5.3\,σ$. The VHE gamma-ray emission of S2 0109+22 is variable on a daily time scale. VHE gamma-ray luminosity of the source is lower than the average of TeV BL Lacs. The optical polarization, and long-term optical/radio behaviour of the source are different from the general population of TeV blazars. All these findings agree with the classification of the source as an ISP BL Lac object. We estimate the source redshift as $z = 0.36 \pm 0.07$. The SSC parameters describing the SED are rather typical for blazars.
△ Less
Submitted 5 July, 2018;
originally announced July 2018.
-
Multi-wavelength characterization of the blazar S5~0716+714 during an unprecedented outburst phase
Authors:
MAGIC Collaboration,
M. L. Ahnen,
S. Ansoldi,
L. A. Antonelli,
C. Arcaro,
D. Baack,
A. Babić,
B. Banerjee,
P. Bangale,
U. Barres de Almeida,
J. A. Barrio,
J. Becerra González,
W. Bednarek,
E. Bernardini,
R. Ch. Berse,
A. Berti,
W. Bhattacharyya,
A. Biland,
O. Blanch,
G. Bonnoli,
R. Carosi,
A. Carosi,
G. Ceribella,
A. Chatterjee,
S. M. Colak
, et al. (165 additional authors not shown)
Abstract:
The BL Lac object S5~0716+714, a highly variable blazar, underwent an impressive outburst in January 2015 (Phase A), followed by minor activity in February (Phase B). The MAGIC observations were triggered by the optical flux observed in Phase A, corresponding to the brightest ever reported state of the source in the R-band. The comprehensive dataset collected is investigated in order to shed light…
▽ More
The BL Lac object S5~0716+714, a highly variable blazar, underwent an impressive outburst in January 2015 (Phase A), followed by minor activity in February (Phase B). The MAGIC observations were triggered by the optical flux observed in Phase A, corresponding to the brightest ever reported state of the source in the R-band. The comprehensive dataset collected is investigated in order to shed light on the mechanism of the broadband emission. Multi-wavelength light curves have been studied together with the broadband Spectral Energy Distributions (SEDs). The data set collected spans from radio, optical photometry and polarimetry, X-ray, high-energy (HE, 0.1 GeV < E < 100 GeV) with \textit{Fermi}-LAT to the very-high-energy (VHE, E>100 GeV) with MAGIC. The flaring state of Phase A was detected in all the energy bands, providing for the first time a multi-wavelength sample of simultaneous data from the radio band to the VHE. In the constructed SED the \textit{Swift}-XRT+\textit{NuSTAR} data constrain the transition between the synchrotron and inverse Compton components very accurately, while the second peak is constrained from 0.1~GeV to 600~GeV by \textit{Fermi}+MAGIC data. The broadband SED cannot be described with a one-zone synchrotron self-Compton model as it severely underestimates the optical flux in order to reproduce the X-ray to $γ$-ray data. Instead we use a two-zone model. The EVPA shows an unprecedented fast rotation. An estimation of the redshift of the source by combined HE and VHE data provides a value of $z = 0.31 \pm 0.02_{stats} \pm 0.05_{sys}$, confirming the literature value. The data show the VHE emission originating in the entrance and exit of a superluminal knot in and out a recollimation shock in the inner jet. A shock-shock interaction in the jet seems responsible for the observed flares and EVPA swing. This scenario is also consistent with the SED modelling.
△ Less
Submitted 1 July, 2018;
originally announced July 2018.
-
Constraining Dark Matter lifetime with a deep gamma-ray survey of the Perseus Galaxy Cluster with MAGIC
Authors:
MAGIC Collaboration,
V. A. Acciari,
S. Ansoldi,
L. A. Antonelli,
A. Arbet Engels,
D. Baack,
A. Babić,
B. Banerjee,
P. Bangale,
U. Barres de Almeida,
J. A. Barrio,
J. Becerra González,
W. Bednarek,
E. Bernardini,
A. Berti,
J. Besenrieder,
W. Bhattacharyya,
C. Bigongiari,
A. Biland,
O. Blanch,
G. Bonnoli,
R. Carosi,
G. Ceribella,
S. Cikota,
S. M. Colak
, et al. (126 additional authors not shown)
Abstract:
Clusters of galaxies are the largest known gravitationally bound structures in the Universe, with masses around $10^{15}\ M_\odot$, most of it in the form of dark matter. The ground-based Imaging Atmospheric Cherenkov Telescope MAGIC made a deep survey of the Perseus cluster of galaxies using almost 400 h of data recorded between 2009 and 2017. This is the deepest observational campaign so far on…
▽ More
Clusters of galaxies are the largest known gravitationally bound structures in the Universe, with masses around $10^{15}\ M_\odot$, most of it in the form of dark matter. The ground-based Imaging Atmospheric Cherenkov Telescope MAGIC made a deep survey of the Perseus cluster of galaxies using almost 400 h of data recorded between 2009 and 2017. This is the deepest observational campaign so far on a cluster of galaxies in the very high energy range. We search for gamma-ray signals from dark matter particles in the mass range between 200 GeV and 200 TeV decaying into standard model pairs. We apply an analysis optimized for the spectral and morphological features expected from dark matter decays and find no evidence of decaying dark matter. From this, we conclude that dark matter particles have a decay lifetime longer than $\sim10^{26}$~s in all considered channels. Our results improve previous lower limits found by MAGIC and represent the strongest limits on decaying dark matter particles from ground-based gamma-ray instruments.
△ Less
Submitted 28 August, 2018; v1 submitted 28 June, 2018;
originally announced June 2018.
-
Detection of persistent VHE gamma-ray emission from PKS 1510-089 by the MAGIC telescopes during low states between 2012 and 2017
Authors:
MAGIC Collaboration,
V. A. Acciari,
S. Ansoldi,
L. A. Antonelli,
A. Arbet Engels,
C. Arcaro,
D. Baack,
A. Babić,
B. Banerjee,
P. Bangale,
U. Barres de Almeida,
J. A. Barrio,
J. Becerra González,
W. Bednarek,
E. Bernardini,
A. Berti,
J. Besenrieder,
W. Bhattacharyya,
C. Bigongiari,
A. Biland,
O. Blanch,
G. Bonnoli,
R. Carosi,
G. Ceribella,
A. Chatterjee
, et al. (143 additional authors not shown)
Abstract:
PKS 1510-089 is a flat spectrum radio quasar strongly variable in the optical and GeV range. We search for low-state VHE gamma-ray emission from PKS 1510-089. We aim to characterize and model the source in a broad-band context, which would provide a baseline over which high states and flares could be better understood. We use daily binned Fermi-LAT flux measurements of PKS 1510-089 to characterize…
▽ More
PKS 1510-089 is a flat spectrum radio quasar strongly variable in the optical and GeV range. We search for low-state VHE gamma-ray emission from PKS 1510-089. We aim to characterize and model the source in a broad-band context, which would provide a baseline over which high states and flares could be better understood. We use daily binned Fermi-LAT flux measurements of PKS 1510-089 to characterize the GeV emission and select the observation periods of MAGIC during low state of activity. For the selected times we compute the average radio, IR, optical, UV, X-ray and gamma-ray emission to construct a low-state spectral energy distribution of the source. The broadband emission is modelled within an External Compton scenario with a stationary emission region through which plasma and magnetic field are flowing. We perform also the emission-model-independent calculations of the maximum absorption in the broad line region (BLR) using two different models. Results. The MAGIC telescopes collected 75 hrs of data during times when the Fermi-LAT flux measured above 1 GeV was below 3x10-8cm-2s-1, which is the threshold adopted for the definition of a low gamma-ray activity state. The data show a strongly significant (9.5σ) VHE gamma-ray emission at the level of (4.27+-0.61stat)x10-12cm-2s-1 above 150GeV, a factor 80 smaller than the highest flare observed so far from this object. Despite the lower flux, the spectral shape is consistent with earlier detections in the VHE band. The broad-band emission is compatible with the EC scenario assuming a large emission region located beyond the BLR. For the first time the gamma-ray data allow us to place a limit on the location of the emission region during a low gamma-ray state of a FSRQ. For the used model of the BLR, the 95% C.L. on the location of the emission region allows us to place it at the distance >74% of the outer radius of the BLR.
△ Less
Submitted 3 September, 2018; v1 submitted 14 June, 2018;
originally announced June 2018.
-
Gamma-ray flaring activity of NGC 1275 in 2016-2017 measured by MAGIC
Authors:
MAGIC collaboration,
S. Ansoldi,
L. A. Antonelli,
C. Arcaro,
D. Baack,
A. Babić,
B. Banerjee,
P. Bangale,
U. Barres de Almeida,
J. A. Barrio,
J. Becerra González,
W. Bednarek,
E. Bernardini,
R. Ch. Berse,
A. Berti,
W. Bhattacharyya,
C. Bigongiari,
A. Biland,
O. Blanch,
G. Bonnoli,
R. Carosi,
G. Ceribella,
A. Chatterjee,
S. M. Colak,
P. Colin
, et al. (130 additional authors not shown)
Abstract:
We report on the detection of flaring activity from the Fanaroff-Riley I radio galaxy NGC 1275 in very-high-energy (VHE, E $>$ 100 GeV) gamma rays with the MAGIC telescopes. Observations were performed between 2016 September and 2017 February as part of a monitoring program. The brightest outburst with $\sim1.5$ times the Crab Nebula flux above 100 GeV (C.U.) was observed during the night between…
▽ More
We report on the detection of flaring activity from the Fanaroff-Riley I radio galaxy NGC 1275 in very-high-energy (VHE, E $>$ 100 GeV) gamma rays with the MAGIC telescopes. Observations were performed between 2016 September and 2017 February as part of a monitoring program. The brightest outburst with $\sim1.5$ times the Crab Nebula flux above 100 GeV (C.U.) was observed during the night between 2016 December 31 and 2017 January 1 (fifty times higher than the mean previously measured in two observational campaigns between 2009 and 2011). Significant variability of the day-by-day light curve was measured, the shortest flux-doubling time-scales was found to be of $(611\pm101)$ min. The combined spectrum of the MAGIC data during the strongest flare state and simultaneous data from the Fermi-LAT around 2017 January 1 follows a power-law with an exponential cutoff at the energy $(492\pm35)$ GeV. Simultaneous optical flux density measurements in the R-band obtained with the KVA telescope are also presented and the correlation between the optical and gamma-ray emission is investigated. Due to possible internal pair-production, the fast flux variability constrains the Doppler factor to values which are inconsistent with a large viewing angle as observed in the radio band. We investigate different scenarios for the explanation of fast gamma-ray variability, namely emission from: magnetospheric gaps, relativistic blobs propagating in the jet (mini-jets) or external cloud (or star) entering the jet. We find that the only plausible model to account for the luminosities here observed would be the production of gamma rays in a magnetospheric gap around the central black hole only in the eventuality of an enhancement of the magnetic field threading the hole from its equipartition value with the gas pressure in the accretion flow.
△ Less
Submitted 5 June, 2018;
originally announced June 2018.
-
A Very High Energy $γ$-Ray Survey towards the Cygnus Region of the Galaxy
Authors:
The VERITAS Collaboration,
A. U. Abeysekara,
A. Archer,
T. Aune,
W. Benbow,
R. Bird,
R. Brose,
M. Buchovecky,
V. Bugaev,
W. Cui,
M. K. Daniel,
A. Falcone,
Q. Feng,
J. P. Finley,
H. Fleischhack,
A. Flinders,
L. Fortson,
A. Furniss,
E. V. Gotthelf,
J. Grube,
D. Hanna,
O. Hervet,
J. Holder,
K. Huang,
G. Hughes
, et al. (46 additional authors not shown)
Abstract:
We present results from deep observations towards the Cygnus region using 300 hours of very-high-energy (VHE) $γ$-ray data taken with the VERITAS Cherenkov telescope array and over seven years of high-energy $γ$-ray data taken with the
Fermi satellite at an energy above 1 GeV. As the brightest region of diffuse $γ$-ray emission in the northern sky, the Cygnus region provides a promising area to…
▽ More
We present results from deep observations towards the Cygnus region using 300 hours of very-high-energy (VHE) $γ$-ray data taken with the VERITAS Cherenkov telescope array and over seven years of high-energy $γ$-ray data taken with the
Fermi satellite at an energy above 1 GeV. As the brightest region of diffuse $γ$-ray emission in the northern sky, the Cygnus region provides a promising area to probe the origins of cosmic rays. We report the identification of a potential Fermi-LAT counterpart to VER J2031+415 (TeV J2032+4130), and resolve the extended VHE source VER J2019+368 into two source candidates (VER J2018+367* and VER J2020+368*) and characterize their energy spectra. The Fermi-LAT morphology of 3FGL 2021.0+4031e (the Gamma-Cygni supernova remnant) was examined and a region of enhanced emission coincident with VER J2019+407 was identified and jointly fit with the VERITAS data. By modeling 3FGL J2015.6+3709 as two sources, one located at the location of the pulsar wind nebula CTB 87 and one at the quasar QSO J2015+371, a continuous spectrum from 1 GeV to 10 TeV was extracted for VER J2016+371 (CTB 87). An additional 71 locations coincident with Fermi-LAT sources and other potential objects of interest were tested for VHE $γ$-ray emission, with no emission detected and upper limits on the differential flux placed at an average of 2.3% of the Crab Nebula ux. We interpret these observations in a multiwavelength context and present the most detailed $γ$-ray view of the region to date.
△ Less
Submitted 15 May, 2018;
originally announced May 2018.