-
Just Dance with $π$! A Poly-modal Inductor for Weakly-supervised Video Anomaly Detection
Authors:
Snehashis Majhi,
Giacomo D'Amicantonio,
Antitza Dantcheva,
Quan Kong,
Lorenzo Garattoni,
Gianpiero Francesca,
Egor Bondarev,
Francois Bremond
Abstract:
Weakly-supervised methods for video anomaly detection (VAD) are conventionally based merely on RGB spatio-temporal features, which continues to limit their reliability in real-world scenarios. This is due to the fact that RGB-features are not sufficiently distinctive in setting apart categories such as shoplifting from visually similar events. Therefore, towards robust complex real-world VAD, it i…
▽ More
Weakly-supervised methods for video anomaly detection (VAD) are conventionally based merely on RGB spatio-temporal features, which continues to limit their reliability in real-world scenarios. This is due to the fact that RGB-features are not sufficiently distinctive in setting apart categories such as shoplifting from visually similar events. Therefore, towards robust complex real-world VAD, it is essential to augment RGB spatio-temporal features by additional modalities. Motivated by this, we introduce the Poly-modal Induced framework for VAD: "PI-VAD", a novel approach that augments RGB representations by five additional modalities. Specifically, the modalities include sensitivity to fine-grained motion (Pose), three dimensional scene and entity representation (Depth), surrounding objects (Panoptic masks), global motion (optical flow), as well as language cues (VLM). Each modality represents an axis of a polygon, streamlined to add salient cues to RGB. PI-VAD includes two plug-in modules, namely Pseudo-modality Generation module and Cross Modal Induction module, which generate modality-specific prototypical representation and, thereby, induce multi-modal information into RGB cues. These modules operate by performing anomaly-aware auxiliary tasks and necessitate five modality backbones -- only during training. Notably, PI-VAD achieves state-of-the-art accuracy on three prominent VAD datasets encompassing real-world scenarios, without requiring the computational overhead of five modality backbones at inference.
△ Less
Submitted 19 May, 2025;
originally announced May 2025.
-
On calculation of canonical decomposition of Tensor via the grid of local discrepancies
Authors:
A. K. Alekseev,
A. E. Bondarev,
Y. S. Pyatakova
Abstract:
The method for calculation of the canonical decomposition that approximates a tensor of high order is considered, which requires moderate computational resources. It is based on the replacement of the approximation error norm (global discrepancy functional) by the grid of local functionals (discrepancies computed on hyperplanes). The point of the global functional minimum in the space of the canon…
▽ More
The method for calculation of the canonical decomposition that approximates a tensor of high order is considered, which requires moderate computational resources. It is based on the replacement of the approximation error norm (global discrepancy functional) by the grid of local functionals (discrepancies computed on hyperplanes). The point of the global functional minimum in the space of the canonical decomposition cores is determined by the set of the stationary points of local functionals. In result, the estimation of the cores of the canonical decomposition is possible using Newton method applied point-wisely along coordinates and nodes. The discrepancies on the hyperplanes are calculated using Monte-Carlo method. Numerical tests on the approximation of sixth order tensors confirms the efficiency of the proposed approach.
△ Less
Submitted 2 May, 2025;
originally announced May 2025.
-
TeG: Temporal-Granularity Method for Anomaly Detection with Attention in Smart City Surveillance
Authors:
Erkut Akdag,
Egor Bondarev,
Peter H. N. De With
Abstract:
Anomaly detection in video surveillance has recently gained interest from the research community. Temporal duration of anomalies vary within video streams, leading to complications in learning the temporal dynamics of specific events. This paper presents a temporal-granularity method for an anomaly detection model (TeG) in real-world surveillance, combining spatio-temporal features at different ti…
▽ More
Anomaly detection in video surveillance has recently gained interest from the research community. Temporal duration of anomalies vary within video streams, leading to complications in learning the temporal dynamics of specific events. This paper presents a temporal-granularity method for an anomaly detection model (TeG) in real-world surveillance, combining spatio-temporal features at different time-scales. The TeG model employs multi-head cross-attention blocks and multi-head self-attention blocks for this purpose. Additionally, we extend the UCF-Crime dataset with new anomaly types relevant to Smart City research project. The TeG model is deployed and validated in a city surveillance system, achieving successful real-time results in industrial settings.
△ Less
Submitted 17 November, 2024;
originally announced November 2024.
-
Probing the Galactic neutrino flux at neutrino energies above 200 TeV with the Baikal Gigaton Volume Detector
Authors:
V. A. Allakhverdyan,
A. D. Avrorin,
A. V. Avrorin,
V. M. Aynutdinov,
Z. Bardačová,
I. A. Belolaptikov,
E. A. Bondarev,
I. V. Borina,
N. M. Budnev,
V. A. Chadymov,
A. S. Chepurnov,
V. Y. Dik,
G. V. Domogatsky,
A. A. Doroshenko,
R. Dvornický,
A. N. Dyachok,
Zh. -A. M. Dzhilkibaev,
E. Eckerová,
T. V. Elzhov,
V. N. Fomin,
A. R. Gafarov,
K. V. Golubkov,
N. S. Gorshkov,
T. I. Gress,
K. G. Kebkal
, et al. (45 additional authors not shown)
Abstract:
Recent observations of the Galactic component of the high-energy neutrino flux, together with the detection of the diffuse Galactic gamma-ray emission up to sub-PeV energies, open new possibilities to study the acceleration and propagation of cosmic rays in the Milky Way. At the same time, both large non-astrophysical backgrounds at TeV energies and scarcity of neutrino events in the sub-PeV band…
▽ More
Recent observations of the Galactic component of the high-energy neutrino flux, together with the detection of the diffuse Galactic gamma-ray emission up to sub-PeV energies, open new possibilities to study the acceleration and propagation of cosmic rays in the Milky Way. At the same time, both large non-astrophysical backgrounds at TeV energies and scarcity of neutrino events in the sub-PeV band currently limit these analyses. Here we use the sample of cascade events with estimated neutrino energies above 200 TeV, detected by the partially deployed Baikal Gigaton Volume Detector (GVD) in six years of operation, to test the continuation of the Galactic neutrino spectrum to sub-PeV energies. We find that the distribution of the arrival directions of Baikal-GVD cascades above 200 TeV in the sky suggests an excess of neutrinos from low Galactic latitudes with the chance probability of 1.4e-2. We find the excess above 200 TeV also in the most recent IceCube public data sets, both of cascades and tracks. The chance probability of the excess in the combined IceCube and Baikal-GVD analysis is 3.4e-4. The flux of Galactic neutrinos above 200~TeV challenges often-used templates for neutrino search based on cosmic-ray simulations.
△ Less
Submitted 11 February, 2025; v1 submitted 8 November, 2024;
originally announced November 2024.
-
MTFL: Multi-Timescale Feature Learning for Weakly-Supervised Anomaly Detection in Surveillance Videos
Authors:
Yiling Zhang,
Erkut Akdag,
Egor Bondarev,
Peter H. N. De With
Abstract:
Detection of anomaly events is relevant for public safety and requires a combination of fine-grained motion information and contextual events at variable time-scales. To this end, we propose a Multi-Timescale Feature Learning (MTFL) method to enhance the representation of anomaly features. Short, medium, and long temporal tubelets are employed to extract spatio-temporal video features using a Vide…
▽ More
Detection of anomaly events is relevant for public safety and requires a combination of fine-grained motion information and contextual events at variable time-scales. To this end, we propose a Multi-Timescale Feature Learning (MTFL) method to enhance the representation of anomaly features. Short, medium, and long temporal tubelets are employed to extract spatio-temporal video features using a Video Swin Transformer. Experimental results demonstrate that MTFL outperforms state-of-the-art methods on the UCF-Crime dataset, achieving an anomaly detection performance 89.78% AUC. Moreover, it performs complementary to SotA with 95.32% AUC on the ShanghaiTech and 84.57% AP on the XD-Violence dataset. Furthermore, we generate an extended dataset of the UCF-Crime for development and evaluation on a wider range of anomalies, namely Video Anomaly Detection Dataset (VADD), involving 2,591 videos in 18 classes with extensive coverage of realistic anomalies.
△ Less
Submitted 8 October, 2024;
originally announced October 2024.
-
Density-Guided Label Smoothing for Temporal Localization of Driving Actions
Authors:
Tunc Alkanat,
Erkut Akdag,
Egor Bondarev,
Peter H. N. De With
Abstract:
Temporal localization of driving actions plays a crucial role in advanced driver-assistance systems and naturalistic driving studies. However, this is a challenging task due to strict requirements for robustness, reliability and accurate localization. In this work, we focus on improving the overall performance by efficiently utilizing video action recognition networks and adapting these to the pro…
▽ More
Temporal localization of driving actions plays a crucial role in advanced driver-assistance systems and naturalistic driving studies. However, this is a challenging task due to strict requirements for robustness, reliability and accurate localization. In this work, we focus on improving the overall performance by efficiently utilizing video action recognition networks and adapting these to the problem of action localization. To this end, we first develop a density-guided label smoothing technique based on label probability distributions to facilitate better learning from boundary video-segments that typically include multiple labels. Second, we design a post-processing step to efficiently fuse information from video-segments and multiple camera views into scene-level predictions, which facilitates elimination of false positives. Our methodology yields a competitive performance on the A2 test set of the naturalistic driving action recognition track of the 2022 NVIDIA AI City Challenge with an F1 score of 0.271.
△ Less
Submitted 11 March, 2024;
originally announced March 2024.
-
Transformer-based Fusion of 2D-pose and Spatio-temporal Embeddings for Distracted Driver Action Recognition
Authors:
Erkut Akdag,
Zeqi Zhu,
Egor Bondarev,
Peter H. N. De With
Abstract:
Classification and localization of driving actions over time is important for advanced driver-assistance systems and naturalistic driving studies. Temporal localization is challenging because it requires robustness, reliability, and accuracy. In this study, we aim to improve the temporal localization and classification accuracy performance by adapting video action recognition and 2D human-pose est…
▽ More
Classification and localization of driving actions over time is important for advanced driver-assistance systems and naturalistic driving studies. Temporal localization is challenging because it requires robustness, reliability, and accuracy. In this study, we aim to improve the temporal localization and classification accuracy performance by adapting video action recognition and 2D human-pose estimation networks to one model. Therefore, we design a transformer-based fusion architecture to effectively combine 2D-pose features and spatio-temporal features. The model uses 2D-pose features as the positional embedding of the transformer architecture and spatio-temporal features as the main input to the encoder of the transformer. The proposed solution is generic and independent of the camera numbers and positions, giving frame-based class probabilities as output. Finally, the post-processing step combines information from different camera views to obtain final predictions and eliminate false positives. The model performs well on the A2 test set of the 2023 NVIDIA AI City Challenge for naturalistic driving action recognition, achieving the overlap score of the organizer-defined distracted driver behaviour metric of 0.5079.
△ Less
Submitted 11 March, 2024;
originally announced March 2024.
-
Detection of Object Throwing Behavior in Surveillance Videos
Authors:
Ivo P. C. Kersten,
Erkut Akdag,
Egor Bondarev,
Peter H. N. De With
Abstract:
Anomalous behavior detection is a challenging research area within computer vision. Progress in this area enables automated detection of dangerous behavior using surveillance camera feeds. A dangerous behavior that is often overlooked in other research is the throwing action in traffic flow, which is one of the unique requirements of our Smart City project to enhance public safety. This paper prop…
▽ More
Anomalous behavior detection is a challenging research area within computer vision. Progress in this area enables automated detection of dangerous behavior using surveillance camera feeds. A dangerous behavior that is often overlooked in other research is the throwing action in traffic flow, which is one of the unique requirements of our Smart City project to enhance public safety. This paper proposes a solution for throwing action detection in surveillance videos using deep learning. At present, datasets for throwing actions are not publicly available. To address the use-case of our Smart City project, we first generate the novel public 'Throwing Action' dataset, consisting of 271 videos of throwing actions performed by traffic participants, such as pedestrians, bicyclists, and car drivers, and 130 normal videos without throwing actions. Second, we compare the performance of different feature extractors for our anomaly detection method on the UCF-Crime and Throwing-Action datasets. The explored feature extractors are the Convolutional 3D (C3D) network, the Inflated 3D ConvNet (I3D) network, and the Multi-Fiber Network (MFNet). Finally, the performance of the anomaly detection algorithm is improved by applying the Adam optimizer instead of Adadelta, and proposing a mean normal loss function that covers the multitude of normal situations in traffic. Both aspects yield better anomaly detection performance. Besides this, the proposed mean normal loss function lowers the false alarm rate on the combined dataset. The experimental results reach an area under the ROC curve of 86.10 for the Throwing-Action dataset, and 80.13 on the combined dataset, respectively.
△ Less
Submitted 11 March, 2024;
originally announced March 2024.
-
The Numerical Solution in the Sense of Prager&Synge
Authors:
A. K. Alekseev,
A. E. Bondarev
Abstract:
The solution in sense of Prager&Synge is the alternative to the commonly used notion of the numerical solution, which is considered as a limit of grid functions at mesh refinement. Prager&Synge solution is defined as a hypersphere containing the projection of the true solution of the system of partial differentiation equations (PDE) onto the computational grid and does not use any asymptotics. In…
▽ More
The solution in sense of Prager&Synge is the alternative to the commonly used notion of the numerical solution, which is considered as a limit of grid functions at mesh refinement. Prager&Synge solution is defined as a hypersphere containing the projection of the true solution of the system of partial differentiation equations (PDE) onto the computational grid and does not use any asymptotics. In the original variant it is determined using orthogonal properties specific for certain equations. In the proposed variant, the center and radius of the hypersphere is estimated using the ensemble of numerical solutions obtained by independent algorithms. This approach may be easily expanded for solutions of an arbitrary system of partial differentiation equations that significantly expands the domain of its applicability. Several options for the computation of the Prager&Synge solution are considered and compared herein. The first one is based on the search for the orthogonal truncation errors and their transformation. The second is based on the orthogonalization of approximation errors obtained using the defect correction method and applies a superposition of numerical solutions. These options are intrusive. In third option (nonintrusive) the information regarding orthogonality of errors, which is crucial for the Prager&Synge approach method, is replaced by information that stems from the properties of the ensemble of numerical solutions, obtained by independent numerical algorithms. The values of the angle between the truncation errors on such ensemble or the distances between elements of the ensemble may be used to replace the orthogonality. The variant based on the width of the ensemble of independent numerical solutions does not require any additional a priori information and is the approximate nonintrusive version of the method based on the orthogonalization of approximation errors.
△ Less
Submitted 10 March, 2024;
originally announced March 2024.
-
Automated Camera Calibration via Homography Estimation with GNNs
Authors:
Giacomo D'Amicantonio,
Egor Bondarev,
Peter H. N. De With
Abstract:
Over the past few decades, a significant rise of camera-based applications for traffic monitoring has occurred. Governments and local administrations are increasingly relying on the data collected from these cameras to enhance road safety and optimize traffic conditions. However, for effective data utilization, it is imperative to ensure accurate and automated calibration of the involved cameras.…
▽ More
Over the past few decades, a significant rise of camera-based applications for traffic monitoring has occurred. Governments and local administrations are increasingly relying on the data collected from these cameras to enhance road safety and optimize traffic conditions. However, for effective data utilization, it is imperative to ensure accurate and automated calibration of the involved cameras. This paper proposes a novel approach to address this challenge by leveraging the topological structure of intersections. We propose a framework involving the generation of a set of synthetic intersection viewpoint images from a bird's-eye-view image, framed as a graph of virtual cameras to model these images. Using the capabilities of Graph Neural Networks, we effectively learn the relationships within this graph, thereby facilitating the estimation of a homography matrix. This estimation leverages the neighbourhood representation for any real-world camera and is enhanced by exploiting multiple images instead of a single match. In turn, the homography matrix allows the retrieval of extrinsic calibration parameters. As a result, the proposed framework demonstrates superior performance on both synthetic datasets and real-world cameras, setting a new state-of-the-art benchmark.
△ Less
Submitted 5 November, 2023;
originally announced November 2023.
-
Track-Like Event Analysis at the Baikal-GVD Neutrino Telescope
Authors:
V. M. Aynutdinov,
V. A. Allakhverdyan,
A. D. Avrorin,
A. V. Avrorin,
Z. Bardačová,
I. A. Belolaptikov,
E. A. Bondarev,
I. V. Borina,
N. M. Budnev,
V. A. Chadymov,
A. S. Chepurnov,
V. Y. Dik,
G. V. Domogatsky,
A. A. Doroshenko,
R. Dvornický,
A. N. Dyachok,
Zh. -A. M. Dzhilkibaev,
E. Eckerová,
T. V. Elzhov,
L. Fajt,
V. N. Fomin,
A. R. Gafarov,
K. V. Golubkov,
N. S. Gorshkov,
T. I. Gress
, et al. (40 additional authors not shown)
Abstract:
Reconstructed tracks of muons produced in neutrino interactions provide the precise probe for the neutrino direction. Therefore, track-like events are a powerful tool to search for neutrino point sources. Recently, Baikal-GVD has demonstrated the first sample of low-energy neutrino candidate events extracted from the data of the season 2019 in a so-called single-cluster analysis - treating each cl…
▽ More
Reconstructed tracks of muons produced in neutrino interactions provide the precise probe for the neutrino direction. Therefore, track-like events are a powerful tool to search for neutrino point sources. Recently, Baikal-GVD has demonstrated the first sample of low-energy neutrino candidate events extracted from the data of the season 2019 in a so-called single-cluster analysis - treating each cluster as an independent detector. In this paper, the extension of the track-like event analysis to a wider data set is discussed and the first high-energy track-like events are demonstrated. The status of multi-cluster track reconstruction and that of the event analysis are also discussed.
△ Less
Submitted 5 October, 2023;
originally announced October 2023.
-
Double cascade reconstruction in the Baikal-GVD neutrino telescope
Authors:
V. M. Aynutdinov,
V. A. Allakhverdyan,
A. D. Avrorin,
A. V. Avrorin,
Z. Bardačová,
I. A. Belolaptikov,
E. A. Bondarev,
I. V. Borina,
N. M. Budnev,
V. A. Chadymov,
A. S. Chepurnov,
V. Y. Dik,
G. V. Domogatsky,
A. A. Doroshenko,
R. Dvornický,
A. N. Dyachok,
Zh. -A. M. Dzhilkibaev,
E. Eckerová,
T. V. Elzhov,
L. Fajt,
V. N. Fomin,
A. R. Gafarov,
K. V. Golubkov,
N. S. Gorshkov,
T. I. Gress
, et al. (40 additional authors not shown)
Abstract:
Baikal Gigaton Volume Detector is a cubic kilometer scale neutrino telescope under construction in Lake Baikal. As of July 2023, Baikal-GVD consists of 96 fully deployed strings resulting in 3456 optical modules installed. The observation of neutrinos is based on detection of Cherenkov radiation emitted by the products of neutrino interactions. In this contribution, description of the double casca…
▽ More
Baikal Gigaton Volume Detector is a cubic kilometer scale neutrino telescope under construction in Lake Baikal. As of July 2023, Baikal-GVD consists of 96 fully deployed strings resulting in 3456 optical modules installed. The observation of neutrinos is based on detection of Cherenkov radiation emitted by the products of neutrino interactions. In this contribution, description of the double cascade reconstruction technique as well as evaluation of precision of this algorithm is given.
△ Less
Submitted 29 September, 2023;
originally announced September 2023.
-
Atmospheric muon suppression for Baikal-GVD cascade analysis
Authors:
V. M. Aynutdinov,
V. A. Allakhverdyan,
A. D. Avrorin,
A. V. Avrorin,
Z. Bardačová,
I. A. Belolaptikov,
E. A. Bondarev,
I. V. Borina,
N. M. Budnev,
V. A. Chadymov,
A. S. Chepurnov,
V. Y. Dik,
G. V. Domogatsky,
A. A. Doroshenko,
R. Dvornický,
A. N. Dyachok,
Zh. -A. M. Dzhilkibaev,
E. Eckerová,
T. V. Elzhov,
L. Fajt,
V. N. Fomin,
A. R. Gafarov,
K. V. Golubkov,
N. S. Gorshkov,
T. I. Gress
, et al. (40 additional authors not shown)
Abstract:
Baikal-GVD (Gigaton Volume Detector) is a neutrino telescope installed at a depth of 1366 m in Lake Baikal. The expedition of 2023 brought the number of optical modules in the array up to 3492 (including experimental strings). These optical modules detect the Cherenkov radiation from secondary charged particles coming from the neutrino interactions. Neutrinos produce different kinds of topological…
▽ More
Baikal-GVD (Gigaton Volume Detector) is a neutrino telescope installed at a depth of 1366 m in Lake Baikal. The expedition of 2023 brought the number of optical modules in the array up to 3492 (including experimental strings). These optical modules detect the Cherenkov radiation from secondary charged particles coming from the neutrino interactions. Neutrinos produce different kinds of topologically distinct light signatures. Charged current muon neutrino interactions create an elongated track in the water. Charged and neutral current interactions of other neutrino flavors yield hadronic and electromagnetic cascades. The background in the neutrino cascade channel arises mainly due to discrete stochastic energy losses produced along atmospheric muon tracks. In this paper, a developed algorithm for the cascade event selection is presented.
△ Less
Submitted 29 September, 2023;
originally announced September 2023.
-
Diffuse neutrino flux measurements with the Baikal-GVD neutrino telescope
Authors:
V. M. Aynutdinov,
V. A. Allakhverdyan,
A. D. Avrorin,
A. V. Avrorin,
Z. Bardačová,
I. A. Belolaptikov,
E. A. Bondarev,
I. V. Borina,
N. M. Budnev,
V. A. Chadymov,
A. S. Chepurnov,
V. Y. Dik,
G. V. Domogatsky,
A. A. Doroshenko,
R. Dvornický,
A. N. Dyachok,
Zh. -A. M. Dzhilkibaev,
E. Eckerová,
T. V. Elzhov,
L. Fajt,
V. N. Fomin,
A. R. Gafarov,
K. V. Golubkov,
N. S. Gorshkov,
T. I. Gress
, et al. (46 additional authors not shown)
Abstract:
Baikal-GVD is a next generation, kilometer-scale neutrino telescope currently under construction in Lake Baikal. GVD consists of multi-megaton subarrays (clusters) and is designed for the detection of astrophysical neutrino fluxes at energies from a few TeV up to 100 PeV. The large detector volume and modular design of Baikal-GVD allows for the measurements of the astrophysical diffuse neutrino fl…
▽ More
Baikal-GVD is a next generation, kilometer-scale neutrino telescope currently under construction in Lake Baikal. GVD consists of multi-megaton subarrays (clusters) and is designed for the detection of astrophysical neutrino fluxes at energies from a few TeV up to 100 PeV. The large detector volume and modular design of Baikal-GVD allows for the measurements of the astrophysical diffuse neutrino flux to be performed already at early phases of the array construction. We present here recent results of the measurements on the diffuse cosmic neutrino flux obtained with the Baikal-GVD neutrino telescope using cascade-like events.
△ Less
Submitted 29 September, 2023;
originally announced September 2023.
-
Improving the efficiency of cascade detection by the Baikal-GVD neutrino telescope
Authors:
V. M. Aynutdinov,
V. A. Allakhverdyan,
A. D. Avrorin,
A. V. Avrorin,
Z. Bardačová,
I. A. Belolaptikov,
E. A. Bondarev,
I. V. Borina,
N. M. Budnev,
V. A. Chadymov,
A. S. Chepurnov,
V. Y. Dik,
G. V. Domogatsky,
A. A. Doroshenko,
R. Dvornický,
A. N. Dyachok,
Zh. -A. M. Dzhilkibaev,
E. Eckerová,
T. V. Elzhov,
L. Fajt,
V. N. Fomin,
A. R. Gafarov,
K. V. Golubkov,
N. S. Gorshkov,
T. I. Gress
, et al. (40 additional authors not shown)
Abstract:
The deployment of the Baikal-GVD deep underwater neutrino telescope is in progress now. About 3500 deep underwater photodetectors (optical modules) arranged into 12 clusters are operating in Lake Baikal. For increasing the efficiency of cascade-like neutrino event detection, the telescope deployment scheme was slightly changed. Namely, the inter-cluster distance was reduced for the newly deployed…
▽ More
The deployment of the Baikal-GVD deep underwater neutrino telescope is in progress now. About 3500 deep underwater photodetectors (optical modules) arranged into 12 clusters are operating in Lake Baikal. For increasing the efficiency of cascade-like neutrino event detection, the telescope deployment scheme was slightly changed. Namely, the inter-cluster distance was reduced for the newly deployed clusters and additional string of optical modules are added between the clusters. The first inter-cluster string was installed in 2022 and two such strings were installed in 2023. This paper presents a Monte Carlo estimate of the impact of these configuration changes on the cascade detection efficiency as well as technical implementation and results of in-situ tests of the inter-cluster strings.
△ Less
Submitted 29 September, 2023;
originally announced September 2023.
-
Large neutrino telescope Baikal-GVD: recent status
Authors:
V. M. Aynutdinov,
V. A. Allakhverdyan,
A. D. Avrorin,
A. V. Avrorin,
Z. Bardačová,
I. A. Belolaptikov,
E. A. Bondarev,
I. V. Borina,
N. M. Budnev,
V. A. Chadymov,
A. S. Chepurnov,
5 V. Y. Dik,
G. V. Domogatsky,
A. A. Doroshenko,
R. Dvornický,
A. N. Dyachok,
Zh. -A. M. Dzhilkibaev,
E. Eckerová,
T. V. Elzhov,
L. Fajt,
V. N. Fomin,
A. R. Gafarov,
K. V. Golubkov,
N. S. Gorshkov,
T. I. Gress
, et al. (40 additional authors not shown)
Abstract:
The Baikal-GVD is a deep-underwater neutrino telescope being constructed in Lake Baikal. After the winter 2023 deployment campaign the detector consists of 3456 optical modules installed on 96 vertical strings. The status of the detector and progress in data analysis are discussed in present report. The Baikal-GVD data collected in 2018-2022 indicate the presence of cosmic neutrino flux in high-en…
▽ More
The Baikal-GVD is a deep-underwater neutrino telescope being constructed in Lake Baikal. After the winter 2023 deployment campaign the detector consists of 3456 optical modules installed on 96 vertical strings. The status of the detector and progress in data analysis are discussed in present report. The Baikal-GVD data collected in 2018-2022 indicate the presence of cosmic neutrino flux in high-energy cascade events consistent with observations by the IceCube neutrino telescope. Analysis of track-like events results in identification of first high-energy muon neutrino candidates. These and other results from 2018-2022 data samples are reviewed in this report.
△ Less
Submitted 28 September, 2023;
originally announced September 2023.
-
Monitoring of optical properties of deep waters of Lake Baikal in 2021-2022
Authors:
V. M. Aynutdinov,
V. A. Allakhverdyan,
A. D. Avrorin,
A. V. Avrorin,
Z. Bardačová,
I. A. Belolaptikov,
E. A. Bondarev,
I. V. Borina,
N. M. Budnev,
V. A. Chadymov,
A. S. Chepurnov,
5 V. Y. Dik,
G. V. Domogatsky,
A. A. Doroshenko,
0 R. Dvornický,
A. N. Dyachok,
Zh. -A. M. Dzhilkibaev,
E. Eckerová,
T. V. Elzhov,
L. Fajt,
V. N. Fomin,
A. R. Gafarov,
K. V. Golubkov,
N. S. Gorshkov,
T. I. Gress
, et al. (40 additional authors not shown)
Abstract:
We present the results of the two-year (2021-2022) monitoring of absorption and scattering lengths of light with wavelength 400-620 nm within the effective volume of the deep underwater neutrino telescope Baikal-GVD, which were measured by a device Baikal-5D No.2. The Baikal-5D No.2. was installed during the 2021 winter expedition at a depth of 1180 m. The absorption and scattering lengths were me…
▽ More
We present the results of the two-year (2021-2022) monitoring of absorption and scattering lengths of light with wavelength 400-620 nm within the effective volume of the deep underwater neutrino telescope Baikal-GVD, which were measured by a device Baikal-5D No.2. The Baikal-5D No.2. was installed during the 2021 winter expedition at a depth of 1180 m. The absorption and scattering lengths were measured every week in 9 spectral points. The device Baikal-5D No.2 also has the ability to measure detailed scattering and absorption spectra. The data obtained make it possible to estimate the range of changes in the absorption and scattering lengths over a sufficiently long period of time and to investigate the relationship between the processes of changes in absorption and scattering. An analysis was made of changes in absorption and scattering spectra for the period 2021-2022.
△ Less
Submitted 28 September, 2023;
originally announced September 2023.
-
Studies of the ambient light of deep Baikal waters with Baikal-GVD
Authors:
V. M. Aynutdinov,
V. A. Allakhverdyan,
A. D. Avrorin,
A. V. Avrorin,
Z. Bardačová,
I. A. Belolaptikov,
E. A. Bondarev,
I. V. Borina,
N. M. Budnev,
V. A. Chadymov,
A. S. Chepurnov,
5 V. Y. Dik,
G. V. Domogatsky,
A. A. Doroshenko,
0 R. Dvornický,
A. N. Dyachok,
Zh. -A. M. Dzhilkibaev,
E. Eckerová,
T. V. Elzhov,
L. Fajt,
V. N. Fomin,
A. R. Gafarov,
K. V. Golubkov,
N. S. Gorshkov,
T. I. Gress
, et al. (40 additional authors not shown)
Abstract:
The Baikal-GVD neutrino detector is a deep-underwater neutrino telescope under construction and recently after the winter 2023 deployment it consists of 3456 optical modules attached on 96 vertical strings. This 3-dimensional array of photo-sensors allows to observe ambient light in the vicinity of the Baikal-GVD telescope that is associated mostly with water luminescence. Results on time and spac…
▽ More
The Baikal-GVD neutrino detector is a deep-underwater neutrino telescope under construction and recently after the winter 2023 deployment it consists of 3456 optical modules attached on 96 vertical strings. This 3-dimensional array of photo-sensors allows to observe ambient light in the vicinity of the Baikal-GVD telescope that is associated mostly with water luminescence. Results on time and space variations of the luminescent activity are reviewed based on data collected in 2018-2022.
△ Less
Submitted 28 September, 2023;
originally announced September 2023.
-
Time Calibration of the Baikal-GVD Neutrino Telescope with Atmospheric Muons
Authors:
V. M. Aynutdinov,
V. A. Allakhverdyan,
A. D. Avrorin,
A. V. Avrorin,
Z. Bardačová,
I. A. Belolaptikov,
E. A. Bondarev,
I. V. Borina,
N. M. Budnev,
V. A. Chadymov,
A. S. Chepurnov,
V. Y. Dik,
G. V. Domogatsky,
A. A. Doroshenko,
R. Dvornický,
A. N. Dyachok,
Zh. -A. M. Dzhilkibaev,
E. Eckerová,
T. V. Elzhov,
L. Fajt,
V. N. Fomin,
A. R. Gafarov,
K. V. Golubkov,
N. S. Gorshkov,
T. I. Gress
, et al. (40 additional authors not shown)
Abstract:
We present a new procedure for time calibration of the Baikal-GVD neutrino telescope. The track reconstruction quality depends on accurate measurements of arrival times of Cherenkov photons. Therefore, it is crucial to achieve a high precision in time calibration. For that purpose, in addition to other calibration methods, we employ a new procedure using atmospheric muons reconstructed in a single…
▽ More
We present a new procedure for time calibration of the Baikal-GVD neutrino telescope. The track reconstruction quality depends on accurate measurements of arrival times of Cherenkov photons. Therefore, it is crucial to achieve a high precision in time calibration. For that purpose, in addition to other calibration methods, we employ a new procedure using atmospheric muons reconstructed in a single-cluster mode. The method is based on iterative determination of effective time offsets for each optical module. This paper focuses on the results of the iterative reconstruction procedure with time offsets from the previous iteration and the verification of the method developed. The theoretical muon calibration precision is estimated to be around 1.5-1.6ns.
△ Less
Submitted 30 August, 2023;
originally announced August 2023.
-
Baikal-GVD Real-Time Data Processing and Follow-Up Analysis of GCN Notices
Authors:
V. M. Aynutdinov,
V. A. Allakhverdyan,
A. D. Avrorin,
A. V. Avrorin,
Z. Bardačová,
I. A. Belolaptikov,
E. A. Bondarev,
I. V. Borina,
N. M. Budnev,
V. A. Chadymov,
A. S. Chepurnov,
V. Y. Dik,
G. V. Domogatsky,
A. A. Doroshenko,
R. Dvornický,
A. N. Dyachok,
Zh. -A. M. Dzhilkibaev,
E. Eckerová,
T. V. Elzhov,
L. Fajt,
V. N. Fomin,
A. R. Gafarov,
K. V. Golubkov,
N. S. Gorshkov,
T. I. Gress
, et al. (40 additional authors not shown)
Abstract:
The Baikal-GVD alert system was launched at the beginning of 2021. There are alerts for muon neutrinos (long upward-going track-like events) and all-flavour neutrinos (high-energy cascades). The system is able to get a preliminary response to external alerts with a temporal delay of about 3-10 minutes. The Baikal-GVD data processing and the results of the follow-up procedure are described. We repo…
▽ More
The Baikal-GVD alert system was launched at the beginning of 2021. There are alerts for muon neutrinos (long upward-going track-like events) and all-flavour neutrinos (high-energy cascades). The system is able to get a preliminary response to external alerts with a temporal delay of about 3-10 minutes. The Baikal-GVD data processing and the results of the follow-up procedure are described. We report on the analysis of the coincidence in time and direction between the Baikal-GVD cascade GVD20211208CA with an estimated energy of 43 TeV and the announced alert IceCube211208A possibly associated with a flaring state of the blazar PKS 0735+178.
△ Less
Submitted 26 August, 2023;
originally announced August 2023.
-
Baikal-GVD Astrophysical Neutrino Candidate near the Blazar TXS~0506+056
Authors:
V. M. Aynutdinov,
V. A. Allakhverdyan,
A. D. Avrorin,
A. V. Avrorin,
Z. Bardačová,
I. A. Belolaptikov,
E. A. Bondarev,
I. V. Borina,
N. M. Budnev,
V. A. Chadymov,
A. S. Chepurnov,
V. Y. Dik,
G. V. Domogatsky,
A. A. Doroshenko,
R. Dvornický,
A. N. Dyachok,
Zh. -A. M. Dzhilkibaev,
E. Eckerová,
T. V. Elzhov,
L. Fajt,
V. N. Fomin,
A. R. Gafarov,
K. V. Golubkov,
N. S. Gorshkov,
T. I. Gress
, et al. (49 additional authors not shown)
Abstract:
We report on the observation of a rare neutrino event detected by Baikal-GVD in April 2021. The event GVD210418CA is the highest-energy cascade observed by Baikal-GVD so far from the direction below the horizon. The estimated cascade energy is $224\pm75$~TeV. The evaluated signalness parameter of GVD210418CA is 97.1\% using an assumption of the E$^{-2.46}$ spectrum of astrophysical neutrinos. The…
▽ More
We report on the observation of a rare neutrino event detected by Baikal-GVD in April 2021. The event GVD210418CA is the highest-energy cascade observed by Baikal-GVD so far from the direction below the horizon. The estimated cascade energy is $224\pm75$~TeV. The evaluated signalness parameter of GVD210418CA is 97.1\% using an assumption of the E$^{-2.46}$ spectrum of astrophysical neutrinos. The arrival direction of GVD210418CA is near the position of the well-known radio blazar TXS~0506+056, with the angular distance being within a 90\% directional uncertainty region of the Baikal-GVD measurement. The event was followed by a radio flare observed by the RATAN-600 radio telescope, further strengthening the case for the neutrino-blazar association.
△ Less
Submitted 25 August, 2023;
originally announced August 2023.
-
Search for directional associations between Baikal Gigaton Volume Detector neutrino-induced cascades and high-energy astrophysical sources
Authors:
V. A. Allakhverdyan,
A. D. Avrorin,
A. V. Avrorin,
V. M. Aynutdinov,
Z. Bardacová,
I. A. Belolaptikov,
E. A. Bondarev,
I. V. Borina,
N. M. Budnev,
A. S. Chepurnov,
V. Y. Dik,
G. V. Domogatsky,
A. A. Doroshenko,
R. Dvornický,
A. N. Dyachok,
Zh. -A. M. Dzhilkibaev,
E. Eckerová,
T. V. Elzhov,
L. Fajt,
A. R. Gafarov,
K. V. Golubkov,
N. S. Gorshkov,
T. I. Gress,
K. G. Kebkal,
I. Kharuk
, et al. (43 additional authors not shown)
Abstract:
Baikal-GVD has recently published its first measurement of the diffuse astrophysical neutrino flux, performed using high-energy cascade-like events. We further explore the Baikal-GVD cascade dataset collected in 2018-2022, with the aim to identify possible associations between the Baikal-GVD neutrinos and known astrophysical sources. We leverage the relatively high angular resolution of the Baikal…
▽ More
Baikal-GVD has recently published its first measurement of the diffuse astrophysical neutrino flux, performed using high-energy cascade-like events. We further explore the Baikal-GVD cascade dataset collected in 2018-2022, with the aim to identify possible associations between the Baikal-GVD neutrinos and known astrophysical sources. We leverage the relatively high angular resolution of the Baikal-GVD neutrino telescope (2-3 deg.), made possible by the use of liquid water as the detection medium, enabling the study of astrophysical point sources even with cascade events. We estimate the telescope's sensitivity in the cascade channel for high-energy astrophysical sources and refine our analysis prescriptions using Monte-Carlo simulations. We primarily focus on cascades with energies exceeding 100 TeV, which we employ to search for correlation with radio-bright blazars. Although the currently limited neutrino sample size provides no statistically significant effects, our analysis suggests a number of possible associations with both extragalactic and Galactic sources. Specifically, we present an analysis of an observed triplet of neutrino candidate events in the Galactic plane, focusing on its potential connection with certain Galactic sources, and discuss the coincidence of cascades with several bright and flaring blazars.
△ Less
Submitted 26 August, 2023; v1 submitted 12 July, 2023;
originally announced July 2023.
-
Triboelectric Backgrounds to radio-based UHE Neutrino Exeperiments
Authors:
J. A. Aguilar,
A. Anker,
P. Allison,
S. Archambault,
P. Baldi,
S. W. Barwick,
J. J. Beatty,
J. Beise,
D. Besson,
A. Bishop,
E. Bondarev,
O. Botner,
S. Bouma,
S. Buitink,
M. Cataldo,
C. C. Chen,
C. H. Chen,
P. Chen,
Y. C. Chen,
B. A. Clark,
W. Clay,
Z. Curtis-Ginsberg,
A. Connolly,
P. Dasgupta,
S. de Kockere
, et al. (92 additional authors not shown)
Abstract:
The proposed IceCube-Gen2 (ICG2) seeks to instrument ~500 sq. km of Antarctic ice near the geographic South Pole with radio antennas, in order to observe the highest energy (E>1 EeV) neutrinos in the Universe. To this end, ICG2 will use the impulsive radio-frequency (RF) signal produced by neutrino interactions in polar ice caps. In such experiments, rare single event candidates must be unambiguou…
▽ More
The proposed IceCube-Gen2 (ICG2) seeks to instrument ~500 sq. km of Antarctic ice near the geographic South Pole with radio antennas, in order to observe the highest energy (E>1 EeV) neutrinos in the Universe. To this end, ICG2 will use the impulsive radio-frequency (RF) signal produced by neutrino interactions in polar ice caps. In such experiments, rare single event candidates must be unambiguously separated from background; to date, signal identification strategies primarily reject thermal noise and anthropogenic backgrounds. Here, we consider the possibility that fake neutrino signals may also be naturally generated via the 'triboelectric effect'. This broadly includes any process in which force applied at a boundary layer results in displacement of surface charge, generating a potential difference ΔV. Wind blowing over granular surfaces such as snow can induce such a ΔV, with subsequent discharge. Discharges over nanosecond-timescales can then lead to RF emissions at characteristic MHz-GHz frequencies. We find that such backgrounds are evident in the several neutrino experiments considered, and are generally characterized by: a) a threshold wind velocity which likely depends on the experimental signal trigger threshold and layout; for the experiments considered herein, this value is typically O(10 m/s), b) frequency spectra generally shifted to the low-end of the frequency regime to which current radio experiments are typically sensitive (100-200 MHz), c) for the strongest background signals, an apparent preference for discharges from above-surface structures, although the presence of more isotropic, lower amplitude triboelectric discharges cannot be excluded.
△ Less
Submitted 10 August, 2022; v1 submitted 10 March, 2021;
originally announced March 2021.
-
On the relation of truncation and approximation errors for the set of solutions obtained by different numerical methods
Authors:
A. K. Alekseev,
A. E. Bondarev
Abstract:
The truncation and approximation errors for the set of numerical solutions computed by methods based on the algorithms of different structure are calculated and analyzed for the case of the two-dimensional steady inviscid compressible flow. The truncation errors are calculated using a special postprocessor, while the approximation errors are obtained by the comparison of the numerical solution and…
▽ More
The truncation and approximation errors for the set of numerical solutions computed by methods based on the algorithms of different structure are calculated and analyzed for the case of the two-dimensional steady inviscid compressible flow. The truncation errors are calculated using a special postprocessor, while the approximation errors are obtained by the comparison of the numerical solution and the analytic one. The extent of the independence of errors for the numerical solutions may be estimated via the Pearson correlation coefficient that may be geometrically expressed by the angle between errors. Due to this reason, the angles between the approximation errors are computed and related with the corresponding angles between the truncation errors. The angles between the approximation errors are found to be far from zero that enables a posteriori estimation of the error norm. The analysis of the distances between these solutions provides another approach to the estimation of the error. The comparison of the error norms, obtained by these two procedures, is provided that demonstrates the acceptable values of their effectivity indices. The results of the approximation error norm estimation for the supersonic flows, containing shock waves, are presented. The measure concentration phenomenon and the algorithmic randomness give some insights into these results.
△ Less
Submitted 12 May, 2020;
originally announced May 2020.
-
Dual Embedding Expansion for Vehicle Re-identification
Authors:
Clint Sebastian,
Raffaele Imbriaco,
Egor Bondarev,
Peter H. N. de With
Abstract:
Vehicle re-identification plays a crucial role in the management of transportation infrastructure and traffic flow. However, this is a challenging task due to the large view-point variations in appearance, environmental and instance-related factors. Modern systems deploy CNNs to produce unique representations from the images of each vehicle instance. Most work focuses on leveraging new losses and…
▽ More
Vehicle re-identification plays a crucial role in the management of transportation infrastructure and traffic flow. However, this is a challenging task due to the large view-point variations in appearance, environmental and instance-related factors. Modern systems deploy CNNs to produce unique representations from the images of each vehicle instance. Most work focuses on leveraging new losses and network architectures to improve the descriptiveness of these representations. In contrast, our work concentrates on re-ranking and embedding expansion techniques. We propose an efficient approach for combining the outputs of multiple models at various scales while exploiting tracklet and neighbor information, called dual embedding expansion (DEx). Additionally, a comparative study of several common image retrieval techniques is presented in the context of vehicle re-ID. Our system yields competitive performance in the 2020 NVIDIA AI City Challenge with promising results. We demonstrate that DEx when combined with other re-ranking techniques, can produce an even larger gain without any additional attribute labels or manual supervision.
△ Less
Submitted 18 April, 2020;
originally announced April 2020.
-
Contextual Pyramid Attention Network for Building Segmentation in Aerial Imagery
Authors:
Clint Sebastian,
Raffaele Imbriaco,
Egor Bondarev,
Peter H. N. de With
Abstract:
Building extraction from aerial images has several applications in problems such as urban planning, change detection, and disaster management. With the increasing availability of data, Convolutional Neural Networks (CNNs) for semantic segmentation of remote sensing imagery has improved significantly in recent years. However, convolutions operate in local neighborhoods and fail to capture non-local…
▽ More
Building extraction from aerial images has several applications in problems such as urban planning, change detection, and disaster management. With the increasing availability of data, Convolutional Neural Networks (CNNs) for semantic segmentation of remote sensing imagery has improved significantly in recent years. However, convolutions operate in local neighborhoods and fail to capture non-local features that are essential in semantic understanding of aerial images. In this work, we propose to improve building segmentation of different sizes by capturing long-range dependencies using contextual pyramid attention (CPA). The pathways process the input at multiple scales efficiently and combine them in a weighted manner, similar to an ensemble model. The proposed method obtains state-of-the-art performance on the Inria Aerial Image Labelling Dataset with minimal computation costs. Our method improves 1.8 points over current state-of-the-art methods and 12.6 points higher than existing baselines on the Intersection over Union (IoU) metric without any post-processing. Code and models will be made publicly available.
△ Less
Submitted 15 April, 2020;
originally announced April 2020.
-
Adversarial Loss for Semantic Segmentation of Aerial Imagery
Authors:
Clint Sebastian,
Raffaele Imbriaco,
Egor Bondarev,
Peter H. N. de With
Abstract:
Automatic building extraction from aerial imagery has several applications in urban planning, disaster management, and change detection. In recent years, several works have adopted deep convolutional neural networks (CNNs) for building extraction, since they produce rich features that are invariant against lighting conditions, shadows, etc. Although several advances have been made, building extrac…
▽ More
Automatic building extraction from aerial imagery has several applications in urban planning, disaster management, and change detection. In recent years, several works have adopted deep convolutional neural networks (CNNs) for building extraction, since they produce rich features that are invariant against lighting conditions, shadows, etc. Although several advances have been made, building extraction from aerial imagery still presents multiple challenges. Most of the deep learning segmentation methods optimize the per-pixel loss with respect to the ground truth without knowledge of the context. This often leads to imperfect outputs that may lead to missing or unrefined regions. In this work, we propose a novel loss function combining both adversarial and cross-entropy losses that learn to understand both local and global contexts for semantic segmentation. The newly proposed loss function deployed on the DeepLab v3+ network obtains state-of-the-art results on the Massachusetts buildings dataset. The loss function improves the structure and refines the edges of buildings without requiring any of the commonly used post-processing methods, such as Conditional Random Fields. We also perform ablation studies to understand the impact of the adversarial loss. Finally, the proposed method achieves a relaxed F1 score of 95.59% on the Massachusetts buildings dataset compared to the previous best F1 of 94.88%.
△ Less
Submitted 18 January, 2020; v1 submitted 13 January, 2020;
originally announced January 2020.
-
Aggregated Deep Local Features for Remote Sensing Image Retrieval
Authors:
Raffaele Imbriaco,
Clint Sebastian,
Egor Bondarev,
Peter H. N. de With
Abstract:
Remote Sensing Image Retrieval remains a challenging topic due to the special nature of Remote Sensing Imagery. Such images contain various different semantic objects, which clearly complicates the retrieval task. In this paper, we present an image retrieval pipeline that uses attentive, local convolutional features and aggregates them using the Vector of Locally Aggregated Descriptors (VLAD) to p…
▽ More
Remote Sensing Image Retrieval remains a challenging topic due to the special nature of Remote Sensing Imagery. Such images contain various different semantic objects, which clearly complicates the retrieval task. In this paper, we present an image retrieval pipeline that uses attentive, local convolutional features and aggregates them using the Vector of Locally Aggregated Descriptors (VLAD) to produce a global descriptor. We study various system parameters such as the multiplicative and additive attention mechanisms and descriptor dimensionality. We propose a query expansion method that requires no external inputs. Experiments demonstrate that even without training, the local convolutional features and global representation outperform other systems. After system tuning, we can achieve state-of-the-art or competitive results. Furthermore, we observe that our query expansion method increases overall system performance by about 3%, using only the top-three retrieved images. Finally, we show how dimensionality reduction produces compact descriptors with increased retrieval performance and fast retrieval computation times, e.g. 50% faster than the current systems.
△ Less
Submitted 22 March, 2019;
originally announced March 2019.
-
LiDAR-assisted Large-scale Privacy Protection in Street-view Cycloramas
Authors:
Clint Sebastian,
Bas Boom,
Egor Bondarev,
Peter H. N. de With
Abstract:
Recently, privacy has a growing importance in several domains, especially in street-view images. The conventional way to achieve this is to automatically detect and blur sensitive information from these images. However, the processing cost of blurring increases with the ever-growing resolution of images. We propose a system that is cost-effective even after increasing the resolution by a factor of…
▽ More
Recently, privacy has a growing importance in several domains, especially in street-view images. The conventional way to achieve this is to automatically detect and blur sensitive information from these images. However, the processing cost of blurring increases with the ever-growing resolution of images. We propose a system that is cost-effective even after increasing the resolution by a factor of 2.5. The new system utilizes depth data obtained from LiDAR to significantly reduce the search space for detection, thereby reducing the processing cost. Besides this, we test several detectors after reducing the detection space and provide an alternative solution based on state-of-the-art deep learning detectors to the existing HoG-SVM-Deep system that is faster and has a higher performance.
△ Less
Submitted 13 March, 2019;
originally announced March 2019.
-
Towards Accurate Camera Geopositioning by Image Matching
Authors:
Raffaele Imbriaco,
Clint Sebastian,
Egor Bondarev,
Peter de With
Abstract:
In this work, we present a camera geopositioning system based on matching a query image against a database with panoramic images. For matching, our system uses memory vectors aggregated from global image descriptors based on convolutional features to facilitate fast searching in the database. To speed up searching, a clustering algorithm is used to balance geographical positioning and computation…
▽ More
In this work, we present a camera geopositioning system based on matching a query image against a database with panoramic images. For matching, our system uses memory vectors aggregated from global image descriptors based on convolutional features to facilitate fast searching in the database. To speed up searching, a clustering algorithm is used to balance geographical positioning and computation time. We refine the obtained position from the query image using a new outlier removal algorithm. The matching of the query image is obtained with a recall@5 larger than 90% for panorama-to-panorama matching. We cluster available panoramas from geographically adjacent locations into a single compact representation and observe computational gains of approximately 50% at the cost of only a small (approximately 3%) recall loss. Finally, we present a coordinate estimation algorithm that reduces the median geopositioning error by up to 20%.
△ Less
Submitted 13 March, 2019;
originally announced March 2019.
-
Bootstrapped CNNs for Building Segmentation on RGB-D Aerial Imagery
Authors:
Clint Sebastian,
Bas Boom,
Thijs van Lankveld,
Egor Bondarev,
Peter H. N. De With
Abstract:
Detection of buildings and other objects from aerial images has various applications in urban planning and map making. Automated building detection from aerial imagery is a challenging task, as it is prone to varying lighting conditions, shadows and occlusions. Convolutional Neural Networks (CNNs) are robust against some of these variations, although they fail to distinguish easy and difficult exa…
▽ More
Detection of buildings and other objects from aerial images has various applications in urban planning and map making. Automated building detection from aerial imagery is a challenging task, as it is prone to varying lighting conditions, shadows and occlusions. Convolutional Neural Networks (CNNs) are robust against some of these variations, although they fail to distinguish easy and difficult examples. We train a detection algorithm from RGB-D images to obtain a segmented mask by using the CNN architecture DenseNet.First, we improve the performance of the model by applying a statistical re-sampling technique called Bootstrapping and demonstrate that more informative examples are retained. Second, the proposed method outperforms the non-bootstrapped version by utilizing only one-sixth of the original training data and it obtains a precision-recall break-even of 95.10% on our aerial imagery dataset.
△ Less
Submitted 8 October, 2018;
originally announced October 2018.
-
On Triangle Inequality Based Approximation Error Estimation
Authors:
A. K. Alekseev,
A. E. Bondarev,
I. M. Navon
Abstract:
The distance between the true and numerical solutions in some metric is considered as the discretization error magnitude. If error magnitude ranging is known, the triangle inequality enables the estimation of the vicinity of the approximate solution that contains the exact one (exact solution enclosure). The analysis of distances between the numerical solutions enables discretization error ranging…
▽ More
The distance between the true and numerical solutions in some metric is considered as the discretization error magnitude. If error magnitude ranging is known, the triangle inequality enables the estimation of the vicinity of the approximate solution that contains the exact one (exact solution enclosure). The analysis of distances between the numerical solutions enables discretization error ranging, if solutions errors are significantly different. Numerical tests conducted using the steady supersonic flows, governed by the two dimensional Euler equations, demonstrate the properties of the exact solution enclosure. The set of solutions generated by solvers of different orders of approximation is used. The success of this approach depends on the choice of metric.
△ Less
Submitted 10 May, 2018; v1 submitted 15 August, 2017;
originally announced August 2017.
-
On Estimation of Discretization Error Norm via Ensemble of Approximate Solutions
Authors:
A. K. Alekseev,
A. E. Bondarev,
I. M. Navon
Abstract:
The issue of single-grid discretization error estimator, operating in the postprocessor mode, is addressed in the paper. An ensemble of numerical solutions, obtained using solvers of different accuracy, is shown to provide an upper estimate for the norm of the discretization error. Numerical tests for the supersonic flows, governed by two dimensional Euler equations, confirm the feasibility for th…
▽ More
The issue of single-grid discretization error estimator, operating in the postprocessor mode, is addressed in the paper. An ensemble of numerical solutions, obtained using solvers of different accuracy, is shown to provide an upper estimate for the norm of the discretization error. Numerical tests for the supersonic flows, governed by two dimensional Euler equations, confirm the feasibility for the norm estimation, if the ensemble of numerical solutions is separated into clusters of accurate and inaccurate solutions.
△ Less
Submitted 10 May, 2018; v1 submitted 17 April, 2017;
originally announced April 2017.