-
A Deep Learning Architecture for Land Cover Mapping Using Spatio-Temporal Sentinel-1 Features
Authors:
Luigi Russo,
Antonietta Sorriso,
Silvia Liberata Ullo,
Paolo Gamba
Abstract:
Land Cover (LC) mapping using satellite imagery is critical for environmental monitoring and management. Deep Learning (DL), particularly Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs), have revolutionized this field by enhancing the accuracy of classification tasks. In this work, a novel approach combining a transformer-based Swin-Unet architecture with seasonal synthesized s…
▽ More
Land Cover (LC) mapping using satellite imagery is critical for environmental monitoring and management. Deep Learning (DL), particularly Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs), have revolutionized this field by enhancing the accuracy of classification tasks. In this work, a novel approach combining a transformer-based Swin-Unet architecture with seasonal synthesized spatio-temporal images has been employed to classify LC types using spatio-temporal features extracted from Sentinel-1 (S1) Synthetic Aperture Radar (SAR) data, organized into seasonal clusters. The study focuses on three distinct regions - Amazonia, Africa, and Siberia - and evaluates the model performance across diverse ecoregions within these areas. By utilizing seasonal feature sequences instead of dense temporal sequences, notable performance improvements have been achieved, especially in regions with temporal data gaps like Siberia, where S1 data distribution is uneven and non-uniform. The results demonstrate the effectiveness and the generalization capabilities of the proposed methodology in achieving high overall accuracy (O.A.) values, even in regions with limited training data.
△ Less
Submitted 10 March, 2025;
originally announced March 2025.
-
DiffFormer: a Differential Spatial-Spectral Transformer for Hyperspectral Image Classification
Authors:
Muhammad Ahmad,
Manuel Mazzara,
Salvatore Distefano,
Adil Mehmood Khan,
Silvia Liberata Ullo
Abstract:
Hyperspectral image classification (HSIC) has gained significant attention because of its potential in analyzing high-dimensional data with rich spectral and spatial information. In this work, we propose the Differential Spatial-Spectral Transformer (DiffFormer), a novel framework designed to address the inherent challenges of HSIC, such as spectral redundancy and spatial discontinuity. The DiffFo…
▽ More
Hyperspectral image classification (HSIC) has gained significant attention because of its potential in analyzing high-dimensional data with rich spectral and spatial information. In this work, we propose the Differential Spatial-Spectral Transformer (DiffFormer), a novel framework designed to address the inherent challenges of HSIC, such as spectral redundancy and spatial discontinuity. The DiffFormer leverages a Differential Multi-Head Self-Attention (DMHSA) mechanism, which enhances local feature discrimination by introducing differential attention to accentuate subtle variations across neighboring spectral-spatial patches. The architecture integrates Spectral-Spatial Tokenization through three-dimensional (3D) convolution-based patch embeddings, positional encoding, and a stack of transformer layers equipped with the SWiGLU activation function for efficient feature extraction (SwiGLU is a variant of the Gated Linear Unit (GLU) activation function). A token-based classification head further ensures robust representation learning, enabling precise labeling of hyperspectral pixels. Extensive experiments on benchmark hyperspectral datasets demonstrate the superiority of DiffFormer in terms of classification accuracy, computational efficiency, and generalizability, compared to existing state-of-the-art (SOTA) methods. In addition, this work provides a detailed analysis of computational complexity, showcasing the scalability of the model for large-scale remote sensing applications. The source code will be made available at \url{https://github.com/mahmad000/DiffFormer} after the first round of revision.
△ Less
Submitted 23 December, 2024;
originally announced December 2024.
-
Benchmarking of a new data splitting method on volcanic eruption data
Authors:
Simona Reale,
Pietro Di Stasio,
Francesco Mauro,
Alessandro Sebastianelli,
Paolo Gamba,
Silvia Liberata Ullo
Abstract:
In this paper, a novel method for data splitting is presented: an iterative procedure divides the input dataset of volcanic eruption, chosen as the proposed use case, into two parts using a dissimilarity index calculated on the cumulative histograms of these two parts. The Cumulative Histogram Dissimilarity (CHD) index is introduced as part of the design. Based on the obtained results the proposed…
▽ More
In this paper, a novel method for data splitting is presented: an iterative procedure divides the input dataset of volcanic eruption, chosen as the proposed use case, into two parts using a dissimilarity index calculated on the cumulative histograms of these two parts. The Cumulative Histogram Dissimilarity (CHD) index is introduced as part of the design. Based on the obtained results the proposed model in this case, compared to both Random splitting and K-means implemented over different configurations, achieves the best performance, with a slightly higher number of epochs. However, this demonstrates that the model can learn more deeply from the input dataset, which is attributable to the quality of the splitting. In fact, each model was trained with early stopping, suitable in case of overfitting, and the higher number of epochs in the proposed method demonstrates that early stopping did not detect overfitting, and consequently, the learning was optimal.
△ Less
Submitted 8 October, 2024;
originally announced October 2024.
-
SEN12-WATER: A New Dataset for Hydrological Applications and its Benchmarking
Authors:
Luigi Russo,
Francesco Mauro,
Alessandro Sebastianelli,
Paolo Gamba,
Silvia Liberata Ullo
Abstract:
Climate change and increasing droughts pose significant challenges to water resource management around the world. These problems lead to severe water shortages that threaten ecosystems, agriculture, and human communities. To advance the fight against these challenges, we present a new dataset, SEN12-WATER, along with a benchmark using a novel end-to-end Deep Learning (DL) framework for proactive d…
▽ More
Climate change and increasing droughts pose significant challenges to water resource management around the world. These problems lead to severe water shortages that threaten ecosystems, agriculture, and human communities. To advance the fight against these challenges, we present a new dataset, SEN12-WATER, along with a benchmark using a novel end-to-end Deep Learning (DL) framework for proactive drought-related analysis. The dataset, identified as a spatiotemporal datacube, integrates SAR polarization, elevation, slope, and multispectral optical bands. Our DL framework enables the analysis and estimation of water losses over time in reservoirs of interest, revealing significant insights into water dynamics for drought analysis by examining temporal changes in physical quantities such as water volume. Our methodology takes advantage of the multitemporal and multimodal characteristics of the proposed dataset, enabling robust generalization and advancing understanding of drought, contributing to climate change resilience and sustainable water resource management. The proposed framework involves, among the several components, speckle noise removal from SAR data, a water body segmentation through a U-Net architecture, the time series analysis, and the predictive capability of a Time-Distributed-Convolutional Neural Network (TD-CNN). Results are validated through ground truth data acquired on-ground via dedicated sensors and (tailored) metrics, such as Precision, Recall, Intersection over Union, Mean Squared Error, Structural Similarity Index Measure and Peak Signal-to-Noise Ratio.
△ Less
Submitted 25 September, 2024;
originally announced September 2024.
-
From Graphs to Qubits: A Critical Review of Quantum Graph Neural Networks
Authors:
Andrea Ceschini,
Francesco Mauro,
Francesca De Falco,
Alessandro Sebastianelli,
Alessio Verdone,
Antonello Rosato,
Bertrand Le Saux,
Massimo Panella,
Paolo Gamba,
Silvia L. Ullo
Abstract:
Quantum Graph Neural Networks (QGNNs) represent a novel fusion of quantum computing and Graph Neural Networks (GNNs), aimed at overcoming the computational and scalability challenges inherent in classical GNNs that are powerful tools for analyzing data with complex relational structures but suffer from limitations such as high computational complexity and over-smoothing in large-scale applications…
▽ More
Quantum Graph Neural Networks (QGNNs) represent a novel fusion of quantum computing and Graph Neural Networks (GNNs), aimed at overcoming the computational and scalability challenges inherent in classical GNNs that are powerful tools for analyzing data with complex relational structures but suffer from limitations such as high computational complexity and over-smoothing in large-scale applications. Quantum computing, leveraging principles like superposition and entanglement, offers a pathway to enhanced computational capabilities. This paper critically reviews the state-of-the-art in QGNNs, exploring various architectures. We discuss their applications across diverse fields such as high-energy physics, molecular chemistry, finance and earth sciences, highlighting the potential for quantum advantage. Additionally, we address the significant challenges faced by QGNNs, including noise, decoherence, and scalability issues, proposing potential strategies to mitigate these problems. This comprehensive review aims to provide a foundational understanding of QGNNs, fostering further research and development in this promising interdisciplinary field.
△ Less
Submitted 12 August, 2024;
originally announced August 2024.
-
AI techniques for near real-time monitoring of contaminants in coastal waters on board future Phisat-2 mission
Authors:
Francesca Razzano,
Pietro Di Stasio,
Francesco Mauro,
Gabriele Meoni,
Marco Esposito,
Gilda Schirinzi,
Silvia L. Ullo
Abstract:
Differently from conventional procedures, the proposed solution advocates for a groundbreaking paradigm in water quality monitoring through the integration of satellite Remote Sensing (RS) data, Artificial Intelligence (AI) techniques, and onboard processing. The objective is to offer nearly real-time detection of contaminants in coastal waters addressing a significant gap in the existing literatu…
▽ More
Differently from conventional procedures, the proposed solution advocates for a groundbreaking paradigm in water quality monitoring through the integration of satellite Remote Sensing (RS) data, Artificial Intelligence (AI) techniques, and onboard processing. The objective is to offer nearly real-time detection of contaminants in coastal waters addressing a significant gap in the existing literature. Moreover, the expected outcomes include substantial advancements in environmental monitoring, public health protection, and resource conservation. The specific focus of our study is on the estimation of Turbidity and pH parameters, for their implications on human and aquatic health. Nevertheless, the designed framework can be extended to include other parameters of interest in the water environment and beyond. Originating from our participation in the European Space Agency (ESA) OrbitalAI Challenge, this article describes the distinctive opportunities and issues for the contaminants monitoring on the Phisat-2 mission. The specific characteristics of this mission, with the tools made available, will be presented, with the methodology proposed by the authors for the onboard monitoring of water contaminants in near real-time. Preliminary promising results are discussed and in progress and future work introduced.
△ Less
Submitted 30 April, 2024;
originally announced April 2024.
-
QSpeckleFilter: a Quantum Machine Learning approach for SAR speckle filtering
Authors:
Francesco Mauro,
Alessandro Sebastianelli,
Maria Pia Del Rosso,
Paolo Gamba,
Silvia Liberata Ullo
Abstract:
The use of Synthetic Aperture Radar (SAR) has greatly advanced our capacity for comprehensive Earth monitoring, providing detailed insights into terrestrial surface use and cover regardless of weather conditions, and at any time of day or night. However, SAR imagery quality is often compromised by speckle, a granular disturbance that poses challenges in producing accurate results without suitable…
▽ More
The use of Synthetic Aperture Radar (SAR) has greatly advanced our capacity for comprehensive Earth monitoring, providing detailed insights into terrestrial surface use and cover regardless of weather conditions, and at any time of day or night. However, SAR imagery quality is often compromised by speckle, a granular disturbance that poses challenges in producing accurate results without suitable data processing. In this context, the present paper explores the cutting-edge application of Quantum Machine Learning (QML) in speckle filtering, harnessing quantum algorithms to address computational complexities. We introduce here QSpeckleFilter, a novel QML model for SAR speckle filtering. The proposed method compared to a previous work from the same authors showcases its superior performance in terms of Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) on a testing dataset, and it opens new avenues for Earth Observation (EO) applications.
△ Less
Submitted 2 February, 2024;
originally announced February 2024.
-
Using Multi-Temporal Sentinel-1 and Sentinel-2 data for water bodies mapping
Authors:
Luigi Russo,
Francesco Mauro,
Babak Memar,
Alessandro Sebastianelli,
Paolo Gamba,
Silvia Liberata Ullo
Abstract:
Climate change is intensifying extreme weather events, causing both water scarcity and severe rainfall unpredictability, and posing threats to sustainable development, biodiversity, and access to water and sanitation. This paper aims to provide valuable insights for comprehensive water resource monitoring under diverse meteorological conditions. An extension of the SEN2DWATER dataset is proposed t…
▽ More
Climate change is intensifying extreme weather events, causing both water scarcity and severe rainfall unpredictability, and posing threats to sustainable development, biodiversity, and access to water and sanitation. This paper aims to provide valuable insights for comprehensive water resource monitoring under diverse meteorological conditions. An extension of the SEN2DWATER dataset is proposed to enhance its capabilities for water basin segmentation. Through the integration of temporally and spatially aligned radar information from Sentinel-1 data with the existing multispectral Sentinel-2 data, a novel multisource and multitemporal dataset is generated. Benchmarking the enhanced dataset involves the application of indices such as the Soil Water Index (SWI) and Normalized Difference Water Index (NDWI), along with an unsupervised Machine Learning (ML) classifier (k-means clustering). Promising results are obtained and potential future developments and applications arising from this research are also explored.
△ Less
Submitted 5 January, 2024;
originally announced February 2024.
-
A Hybrid MLP-Quantum approach in Graph Convolutional Neural Networks for Oceanic Nino Index (ONI) prediction
Authors:
Francesco Mauro,
Alessandro Sebastianelli,
Bertrand Le Saux,
Paolo Gamba,
Silvia Liberata Ullo
Abstract:
This paper explores an innovative fusion of Quantum Computing (QC) and Artificial Intelligence (AI) through the development of a Hybrid Quantum Graph Convolutional Neural Network (HQGCNN), combining a Graph Convolutional Neural Network (GCNN) with a Quantum Multilayer Perceptron (MLP). The study highlights the potentialities of GCNNs in handling global-scale dependencies and proposes the HQGCNN fo…
▽ More
This paper explores an innovative fusion of Quantum Computing (QC) and Artificial Intelligence (AI) through the development of a Hybrid Quantum Graph Convolutional Neural Network (HQGCNN), combining a Graph Convolutional Neural Network (GCNN) with a Quantum Multilayer Perceptron (MLP). The study highlights the potentialities of GCNNs in handling global-scale dependencies and proposes the HQGCNN for predicting complex phenomena such as the Oceanic Nino Index (ONI). Preliminary results suggest the model potential to surpass state-of-the-art (SOTA). The code will be made available with the paper publication.
△ Less
Submitted 29 January, 2024;
originally announced January 2024.
-
Monitoring water contaminants in coastal areas through ML algorithms leveraging atmospherically corrected Sentinel-2 data
Authors:
Francesca Razzano,
Francesco Mauro,
Pietro Di Stasio,
Gabriele Meoni,
Marco Esposito,
Gilda Schirinzi,
Silvia Liberata Ullo
Abstract:
Monitoring water contaminants is of paramount importance, ensuring public health and environmental well-being. Turbidity, a key parameter, poses a significant problem, affecting water quality. Its accurate assessment is crucial for safeguarding ecosystems and human consumption, demanding meticulous attention and action. For this, our study pioneers a novel approach to monitor the Turbidity contami…
▽ More
Monitoring water contaminants is of paramount importance, ensuring public health and environmental well-being. Turbidity, a key parameter, poses a significant problem, affecting water quality. Its accurate assessment is crucial for safeguarding ecosystems and human consumption, demanding meticulous attention and action. For this, our study pioneers a novel approach to monitor the Turbidity contaminant, integrating CatBoost Machine Learning (ML) with high-resolution data from Sentinel-2 Level-2A. Traditional methods are labor-intensive while CatBoost offers an efficient solution, excelling in predictive accuracy. Leveraging atmospherically corrected Sentinel-2 data through the Google Earth Engine (GEE), our study contributes to scalable and precise Turbidity monitoring. A specific tabular dataset derived from Hong Kong contaminants monitoring stations enriches our study, providing region-specific insights. Results showcase the viability of this integrated approach, laying the foundation for adopting advanced techniques in global water quality management.
△ Less
Submitted 8 January, 2024;
originally announced January 2024.
-
Multitemporal analysis in Google Earth Engine for detecting urban changes using optical data and machine learning algorithms
Authors:
Mariapia Rita Iandolo,
Francesca Razzano,
Chiara Zarro,
G. S. Yogesh,
Silvia Liberata Ullo
Abstract:
The aim of this work is to perform a multitemporal analysis using the Google Earth Engine (GEE) platform for the detection of changes in urban areas using optical data and specific machine learning (ML) algorithms. As a case study, Cairo City has been identified, in Egypt country, as one of the five most populous megacities of the last decade in the world. Classification and change detection analy…
▽ More
The aim of this work is to perform a multitemporal analysis using the Google Earth Engine (GEE) platform for the detection of changes in urban areas using optical data and specific machine learning (ML) algorithms. As a case study, Cairo City has been identified, in Egypt country, as one of the five most populous megacities of the last decade in the world. Classification and change detection analysis of the region of interest (ROI) have been carried out from July 2013 to July 2021. Results demonstrate the validity of the proposed method in identifying changed and unchanged urban areas over the selected period. Furthermore, this work aims to evidence the growing significance of GEE as an efficient cloud-based solution for managing large quantities of satellite data.
△ Less
Submitted 22 August, 2023;
originally announced August 2023.
-
Integration of Sentinel-1 and Sentinel-2 data for Earth surface classification using Machine Learning algorithms implemented on Google Earth Engine
Authors:
Francesca Razzano,
Mariapia Rita Iandolo,
Chiara Zarro,
G. S. Yogesh,
Silvia Liberata Ullo
Abstract:
In this study, Synthetic Aperture Radar (SAR) and optical data are both considered for Earth surface classification. Specifically, the integration of Sentinel-1 (S-1) and Sentinel-2 (S-2) data is carried out through supervised Machine Learning (ML) algorithms implemented on the Google Earth Engine (GEE) platform for the classification of a particular region of interest. Achieved results demonstrat…
▽ More
In this study, Synthetic Aperture Radar (SAR) and optical data are both considered for Earth surface classification. Specifically, the integration of Sentinel-1 (S-1) and Sentinel-2 (S-2) data is carried out through supervised Machine Learning (ML) algorithms implemented on the Google Earth Engine (GEE) platform for the classification of a particular region of interest. Achieved results demonstrate how in this case radar and optical remote detection provide complementary information, benefiting surface cover classification and generally leading to increased mapping accuracy. In addition, this paper works in the direction of proving the emerging role of GEE as an effective cloud-based tool for handling large amounts of satellite data.
△ Less
Submitted 22 August, 2023;
originally announced August 2023.
-
Estimation of Ground NO2 Measurements from Sentinel-5P Tropospheric Data through Categorical Boosting
Authors:
Francesco Mauro,
Luigi Russo,
Fjoralba Janku,
Alessandro Sebastianelli,
Silvia Liberata Ullo
Abstract:
This study aims to analyse the Nitrogen Dioxide (NO2) pollution in the Emilia Romagna Region (Northern Italy) during 2019, with the help of satellite retrievals from the Sentinel-5P mission of the European Copernicus Programme and ground-based measurements, obtained from the ARPA site (Regional Agency for the Protection of the Environment). The final goal is the estimation of ground NO2 measuremen…
▽ More
This study aims to analyse the Nitrogen Dioxide (NO2) pollution in the Emilia Romagna Region (Northern Italy) during 2019, with the help of satellite retrievals from the Sentinel-5P mission of the European Copernicus Programme and ground-based measurements, obtained from the ARPA site (Regional Agency for the Protection of the Environment). The final goal is the estimation of ground NO2 measurements when only satellite data are available. For this task, we used a Machine Learning (ML) model, Categorical Boosting, which was demonstrated to work quite well and allowed us to achieve a Root-Mean-Square Error (RM SE) of 0.0242 over the 43 stations utilised to get the Ground Truth values. This procedure represents the starting point to understand which other actions must be taken to improve the final performance of the model and extend its validity.
△ Less
Submitted 26 August, 2023; v1 submitted 8 April, 2023;
originally announced April 2023.
-
Analysis of COVID-19 first wave in the US based on demographic, mobility, and environmental variables
Authors:
Dario Spiller,
Gabriele Santin,
Alessandro Sebastianelli,
Lorenzo Lucchini,
Riccardo Gallotti,
Brennan Lake,
Silvia Liberata Ullo,
Bertrand Le Saux,
Bruno Lepri
Abstract:
COVID-19 had a strong and disruptive impact on our society, and yet further analyses on most relevant factors explaining the spread of the pandemic are needed. Interdisciplinary studies linking epidemiological, mobility, environmental, and socio-demographic data analysis can help understanding how historical conditions, concurrent social policies and environmental factors impacted on the evolution…
▽ More
COVID-19 had a strong and disruptive impact on our society, and yet further analyses on most relevant factors explaining the spread of the pandemic are needed. Interdisciplinary studies linking epidemiological, mobility, environmental, and socio-demographic data analysis can help understanding how historical conditions, concurrent social policies and environmental factors impacted on the evolution of the pandemic crisis. This work deals with a regression analysis linking COVID-19 mortality to socio-demographic, mobility, and environmental data in the US during the first half of 2020, i.e., during the COVID-19 pandemic first wave. This study can provide very useful insights about risk factors enhancing mortality rates before non-pharmaceutical interventions or vaccination campaigns took place. Our cross-sectional ecological regression analysis demonstrates that, when considering the entire US area, the socio-demographic variables globally play the most important role with respect to environmental and mobility variables in describing COVID-19 mortality. Compared to the complete generalized linear model considering all socio-demographic, mobility, and environmental data, the regression based only on socio-demographic data provides a better approximation and proves to be a better explanatory model when compared to the mobility-based and environmental-based models. However, when looking at single entries within each of the three groups, we see that the mobility data can become relevant descriptive predictors at local scale, as in New Jersey where the time spent at work is one of the most relevant explanatory variables, while environmental data play contradictory roles.
△ Less
Submitted 22 February, 2023;
originally announced February 2023.
-
Classification Schemes for the Radar Reference Window: Design and Comparisons
Authors:
Chaoran Yin,
Linjie Yan,
Chengpeng Hao,
Silvia Liberata Ullo,
Gaetano Giunta,
Alfonso Farina,
Danilo Orlando
Abstract:
In this paper, we address the problem of classifying data within the radar reference window in terms of statistical properties. Specifically, we partition these data into statistically homogeneous subsets by identifying possible clutter power variations with respect to the cells under test (accounting for possible range-spread targets) and/or clutter edges. To this end, we consider different situa…
▽ More
In this paper, we address the problem of classifying data within the radar reference window in terms of statistical properties. Specifically, we partition these data into statistically homogeneous subsets by identifying possible clutter power variations with respect to the cells under test (accounting for possible range-spread targets) and/or clutter edges. To this end, we consider different situations of practical interest and formulate the classification problem as multiple hypothesis tests comprising several models for the operating scenario. Then, we solve the hypothesis testing problems by resorting to suitable approximations of the model order selection rules due to the intractable mathematics associated with the maximum likelihood estimation of some parameters. Remarkably, the classification results provided by the proposed architectures represent an advanced clutter map since, besides the estimation of the clutter parameters, they contain a clustering of the range bins in terms of homogeneous subsets. In fact, such information can drive the conventional detectors towards more reliable estimates of the clutter covariance matrix according to the position of the cells under test. The performance analysis confirms that the conceived architectures represent a viable means to recognize the scenario wherein the radar is operating at least for the considered simulation parameters.
△ Less
Submitted 16 February, 2023;
originally announced February 2023.
-
A Machine Learning Approach to Long-Term Drought Prediction using Normalized Difference Indices Computed on a Spatiotemporal Dataset
Authors:
Veronica Wairimu Muriga,
Benjamin Rich,
Francesco Mauro,
Alessandro Sebastianelli,
Silvia Liberata Ullo
Abstract:
Climate change and increases in drought conditions affect the lives of many and are closely tied to global agricultural output and livestock production. This research presents a novel approach utilizing machine learning frameworks for drought prediction around water basins. Our method focuses on the next-frame prediction of the Normalized Difference Drought Index (NDDI) by leveraging the recently…
▽ More
Climate change and increases in drought conditions affect the lives of many and are closely tied to global agricultural output and livestock production. This research presents a novel approach utilizing machine learning frameworks for drought prediction around water basins. Our method focuses on the next-frame prediction of the Normalized Difference Drought Index (NDDI) by leveraging the recently developed SEN2DWATER database. We propose and compare two prediction methods for estimating NDDI values over a specific land area. Our work makes possible proactive measures that can ensure adequate water access for drought-affected communities and sustainable agriculture practices by implementing a proof-of-concept of short and long-term drought prediction of changes in water resources.
△ Less
Submitted 1 June, 2023; v1 submitted 5 February, 2023;
originally announced February 2023.
-
SEN2DWATER: A Novel Multispectral and Multitemporal Dataset and Deep Learning Benchmark for Water Resources Analysis
Authors:
Francesco Mauro,
Benjamin Rich,
Veronica Wairimu Muriga,
Alessandro Sebastianelli,
Silvia Liberata Ullo
Abstract:
Climate change has caused disruption in certain weather patterns, leading to extreme weather events like flooding and drought in different parts of the world. In this paper, we propose machine learning methods for analyzing changes in water resources over a time period of six years, by focusing on lakes and rivers in Italy and Spain. Additionally, we release open-access code to enable the expansio…
▽ More
Climate change has caused disruption in certain weather patterns, leading to extreme weather events like flooding and drought in different parts of the world. In this paper, we propose machine learning methods for analyzing changes in water resources over a time period of six years, by focusing on lakes and rivers in Italy and Spain. Additionally, we release open-access code to enable the expansion of the study to any region of the world.
We create a novel multispectral and multitemporal dataset, SEN2DWATER, which is freely accessible on GitHub. We introduce suitable indices to monitor changes in water resources, and benchmark the new dataset on three different deep learning frameworks: Convolutional Long Short Term Memory (ConvLSTM), Bidirectional ConvLSTM, and Time Distributed Convolutional Neural Networks (TD-CNNs). Future work exploring the many potential applications of this research is also discussed.
△ Less
Submitted 18 January, 2023;
originally announced January 2023.
-
Multiple Sub-Pixel Target Detection for Hyperspectral Imaging Systems
Authors:
Pia Addabbo,
Nicomino Fiscante,
Gaetano Giunta,
Danilo Orlando,
Giuseppe Ricci,
Silvia Liberata Ullo
Abstract:
Hyperspectral target detection is a task of primary importance in remote sensing since it allows identification, location, and discrimination of target features. To this end, the reflectance maps, which contain the spectral signatures and related abundances of the materials in the observed scene, are often used. However, due to the low spatial resolution of most hyperspectral sensors, targets occu…
▽ More
Hyperspectral target detection is a task of primary importance in remote sensing since it allows identification, location, and discrimination of target features. To this end, the reflectance maps, which contain the spectral signatures and related abundances of the materials in the observed scene, are often used. However, due to the low spatial resolution of most hyperspectral sensors, targets occupy a fraction of the pixel and, hence, the spectra of different sub-pixel targets (including the background spectrum) are mixed together within the same pixel. To solve this issue, in this paper, we adopt a generalized replacement model accounting for multiple sub-pixel target spectra and formulate the detection problem at hand as a binary hypothesis test where under the alternative hypothesis the target is modeled in terms of a linear combination of endmembers whose coefficients also account for the presence of the background. Then, we devise detection architectures based upon the generalized likelihood ratio test where the unknown parameters are suitably estimated through procedures inspired by the maximum likelihood approach. The performances of the proposed decision schemes are evaluated by means of both synthetic as well as real data and compared with an analogous counterpart by showing the effectiveness of the proposed procedure.
△ Less
Submitted 16 January, 2023;
originally announced January 2023.
-
On Circuit-based Hybrid Quantum Neural Networks for Remote Sensing Imagery Classification
Authors:
Alessandro Sebastianelli,
Daniela A. Zaidenberg,
Dario Spiller,
Bertrand Le Saux,
Silvia Liberata Ullo
Abstract:
This article aims to investigate how circuit-based hybrid Quantum Convolutional Neural Networks (QCNNs) can be successfully employed as image classifiers in the context of remote sensing. The hybrid QCNNs enrich the classical architecture of CNNs by introducing a quantum layer within a standard neural network. The novel QCNN proposed in this work is applied to the Land Use and Land Cover (LULC) cl…
▽ More
This article aims to investigate how circuit-based hybrid Quantum Convolutional Neural Networks (QCNNs) can be successfully employed as image classifiers in the context of remote sensing. The hybrid QCNNs enrich the classical architecture of CNNs by introducing a quantum layer within a standard neural network. The novel QCNN proposed in this work is applied to the Land Use and Land Cover (LULC) classification, chosen as an Earth Observation (EO) use case, and tested on the EuroSAT dataset used as reference benchmark. The results of the multiclass classification prove the effectiveness of the presented approach, by demonstrating that the QCNN performances are higher than the classical counterparts. Moreover, investigation of various quantum circuits shows that the ones exploiting quantum entanglement achieve the best classification scores. This study underlines the potentialities of applying quantum computing to an EO case study and provides the theoretical and experimental background for futures investigations.
△ Less
Submitted 1 December, 2021; v1 submitted 20 September, 2021;
originally announced September 2021.
-
On Board Volcanic Eruption Detection through CNNs and Satellite Multispectral Imagery
Authors:
Maria Pia Del Rosso,
Alessandro Sebastianelli,
Dario Spiller,
Pierre Philippe Mathieu,
Silvia Liberata Ullo
Abstract:
In recent years, the growth of Machine Learning (ML) algorithms has raised the number of studies including their applicability in a variety of different scenarios. Among all, one of the hardest ones is the aerospace, due to its peculiar physical requirements. In this context, a feasibility study and a first prototype for an Artificial Intelligence (AI) model to be deployed on board satellites are…
▽ More
In recent years, the growth of Machine Learning (ML) algorithms has raised the number of studies including their applicability in a variety of different scenarios. Among all, one of the hardest ones is the aerospace, due to its peculiar physical requirements. In this context, a feasibility study and a first prototype for an Artificial Intelligence (AI) model to be deployed on board satellites are presented in this work. As a case study, the detection of volcanic eruptions has been investigated as a method to swiftly produce alerts and allow immediate interventions. Two Convolutional Neural Networks (CNNs) have been proposed and designed, showing how to efficiently implement them for identifying the eruptions and at the same time adapting their complexity in order to fit on board requirements.
△ Less
Submitted 28 July, 2021; v1 submitted 29 June, 2021;
originally announced June 2021.
-
Spatio-Temporal SAR-Optical Data Fusion for Cloud Removal via a Deep Hierarchical Model
Authors:
Alessandro Sebastianelli,
Artur Nowakowski,
Erika Puglisi,
Maria Pia Del Rosso,
Jamila Mifdal,
Fiora Pirri,
Pierre Philippe Mathieu,
Silvia Liberata Ullo
Abstract:
Cloud removal is a relevant topic in Remote Sensing as it fosters the usability of high-resolution optical images for Earth monitoring and study. Related techniques have been analyzed for years with a progressively clearer view of the appropriate methods to adopt, from multi-spectral to inpainting methods. Recent applications of deep generative models and sequence-to-sequence-based models have pro…
▽ More
Cloud removal is a relevant topic in Remote Sensing as it fosters the usability of high-resolution optical images for Earth monitoring and study. Related techniques have been analyzed for years with a progressively clearer view of the appropriate methods to adopt, from multi-spectral to inpainting methods. Recent applications of deep generative models and sequence-to-sequence-based models have proved their capability to advance the field significantly. Nevertheless, there are still some gaps, mostly related to the amount of cloud coverage, the density and thickness of clouds, and the occurred temporal landscape changes. In this work, we fill some of these gaps by introducing a novel multi-modal method that uses different sources of information, both spatial and temporal, to restore the whole optical scene of interest. The proposed method introduces an innovative deep model, using the outcomes of both temporal-sequence blending and direct translation from Synthetic Aperture Radar (SAR) to optical images to obtain a pixel-wise restoration of the whole scene. The advantage of our approach is demonstrated across a variety of atmospheric conditions tested on a dataset we have generated and made available. Quantitative and qualitative results prove that the proposed method obtains cloud-free images, preserving scene details without resorting to a huge portion of a clean image and coping with landscape changes.
△ Less
Submitted 28 March, 2022; v1 submitted 23 June, 2021;
originally announced June 2021.
-
Paradigm selection for Data Fusion of SAR and Multispectral Sentinel data applied to Land-Cover Classification
Authors:
Alessandro Sebastianelli,
Maria Pia Del Rosso,
Pierre Philippe Mathieu,
Silvia Liberata Ullo
Abstract:
Data fusion is a well-known technique, becoming more and more popular in the Artificial Intelligence for Earth Observation (AI4EO) domain mainly due to its ability of reinforcing AI4EO applications by combining multiple data sources and thus bringing better results. On the other hand, like other methods for satellite data analysis, data fusion itself is also benefiting and evolving thanks to the i…
▽ More
Data fusion is a well-known technique, becoming more and more popular in the Artificial Intelligence for Earth Observation (AI4EO) domain mainly due to its ability of reinforcing AI4EO applications by combining multiple data sources and thus bringing better results. On the other hand, like other methods for satellite data analysis, data fusion itself is also benefiting and evolving thanks to the integration of Artificial Intelligence (AI). In this letter, four data fusion paradigms, based on Convolutional Neural Networks (CNNs), are analyzed and implemented. The goals are to provide a systematic procedure for choosing the best data fusion framework, resulting in the best classification results, once the basic structure for the CNN has been defined, and to help interested researchers in their work when data fusion applied to remote sensing is involved. The procedure has been validated for land-cover classification but it can be transferred to other cases.
△ Less
Submitted 18 June, 2021;
originally announced June 2021.
-
A speckle filter for Sentinel-1 SAR Ground Range Detected data based on Residual Convolutional Neural Networks
Authors:
Alessandro Sebastianelli,
Maria Pia Del Rosso,
Silvia Liberata Ullo,
Paolo Gamba
Abstract:
In recent years, machine learning (ML) algorithms have become widespread in all the fields of remote sensing (RS) and earth observation (EO). This has allowed the rapid development of new procedures to solve problems affecting these sectors. In this context, this work aims at presenting a novel method for filtering speckle noise from Sentinel-1 ground range detected (GRD) data by applying deep lea…
▽ More
In recent years, machine learning (ML) algorithms have become widespread in all the fields of remote sensing (RS) and earth observation (EO). This has allowed the rapid development of new procedures to solve problems affecting these sectors. In this context, this work aims at presenting a novel method for filtering speckle noise from Sentinel-1 ground range detected (GRD) data by applying deep learning (DL) algorithms, based on convolutional neural networks (CNNs). The paper provides an easy yet very effective approach to extract the large amount of training data needed for DL approaches in this challenging case. The experimental results on simulated speckled images and an actual SAR dataset show a clear improvement with respect to the state of the art in terms of peak signal-to-noise ratio (PSNR), structural similarity index (SSIM), equivalent number of looks (ENL), proving the effectiveness of the proposed architecture.
△ Less
Submitted 17 May, 2022; v1 submitted 19 April, 2021;
originally announced April 2021.
-
Advantages and Bottlenecks of Quantum Machine Learning for Remote Sensing
Authors:
Daniela A. Zaidenberg,
Alessandro Sebastianelli,
Dario Spiller,
Bertrand Le Saux,
Silvia Liberata Ullo
Abstract:
This concept paper aims to provide a brief outline of quantum computers, explore existing methods of quantum image classification techniques, so focusing on remote sensing applications, and discuss the bottlenecks of performing these algorithms on currently available open source platforms. Initial results demonstrate feasibility. Next steps include expanding the size of the quantum hidden layer an…
▽ More
This concept paper aims to provide a brief outline of quantum computers, explore existing methods of quantum image classification techniques, so focusing on remote sensing applications, and discuss the bottlenecks of performing these algorithms on currently available open source platforms. Initial results demonstrate feasibility. Next steps include expanding the size of the quantum hidden layer and increasing the variety of output image options.
△ Less
Submitted 30 June, 2021; v1 submitted 26 January, 2021;
originally announced January 2021.
-
AIRSENSE-TO-ACT: A Concept Paper for COVID-19 Countermeasures based on Artificial Intelligence algorithms and multi-sources Data Processing
Authors:
A. Sebastianelli,
F. Mauro,
G. Di Cosmo,
F. Passarini,
M. Carminati,
S. L. Ullo
Abstract:
Aim of this paper is the description of a new tool to support institutions in the implementation of targeted countermeasures, based on quantitative and multi-scale elements, for the fight and prevention of emergencies, such as the current COVID-19 pandemic. The tool is a centralized system (web application), single multi-user platform, which relies on Artificial Intelligence (AI) algorithms for th…
▽ More
Aim of this paper is the description of a new tool to support institutions in the implementation of targeted countermeasures, based on quantitative and multi-scale elements, for the fight and prevention of emergencies, such as the current COVID-19 pandemic. The tool is a centralized system (web application), single multi-user platform, which relies on Artificial Intelligence (AI) algorithms for the processing of heterogeneous data, and which can produce an output level of risk. The model includes a specific neural network which will be first trained to learn the correlation between selected inputs, related to the case of interest: environmental variables (chemical-physical, such as meteorological), human activity (such as traffic and crowding), level of pollution (in particular the concentration of particulate matter), and epidemiological variables related to the evolution of the contagion. The tool realized in the first phase of the project will serve later both as a decision support system (DSS) with predictive capacity, when fed by the actual measured data, and as a simulation bench performing the tuning of certain input values, to identify which of them lead to a decrease in the degree of risk. In this way, the authors aim to design different scenarios to compare different restrictive strategies and the actual expected benefits, to adopt measures sized to the actual need, and adapted to the specific areas of analysis, useful to safeguard human health, but also the economic and social impact of the choices.
△ Less
Submitted 7 November, 2020;
originally announced November 2020.
-
A New Mask R-CNN Based Method for Improved Landslide Detection
Authors:
Silvia Liberata Ullo,
Amrita Mohan,
Alessandro Sebastianelli,
Shaik Ejaz Ahamed,
Basant Kumar,
Ramji Dwivedi,
G. R. Sinha
Abstract:
This paper presents a novel method of landslide detection by exploiting the Mask R-CNN capability of identifying an object layout by using a pixel-based segmentation, along with transfer learning used to train the proposed model. A data set of 160 elements is created containing landslide and non-landslide images. The proposed method consists of three steps: (i) augmenting training image samples to…
▽ More
This paper presents a novel method of landslide detection by exploiting the Mask R-CNN capability of identifying an object layout by using a pixel-based segmentation, along with transfer learning used to train the proposed model. A data set of 160 elements is created containing landslide and non-landslide images. The proposed method consists of three steps: (i) augmenting training image samples to increase the volume of the training data, (ii) fine tuning with limited image samples, and (iii) performance evaluation of the algorithm in terms of precision, recall and F1 measure, on the considered landslide images, by adopting ResNet-50 and 101 as backbone models. The experimental results are quite encouraging as the proposed method achieves Precision equals to 1.00, Recall 0.93 and F1 measure 0.97, when ResNet-101 is used as backbone model, and with a low number of landslide photographs used as training samples. The proposed algorithm can be potentially useful for land use planners and policy makers of hilly areas where intermittent slope deformations necessitate landslide detection as prerequisite before planning.
△ Less
Submitted 4 October, 2020;
originally announced October 2020.
-
Land Use and Land Cover Classification using a Human Group based Particle Swarm Optimization Algorithm with a LSTM classifier on hybrid-pre-processing Remote Sensing Images
Authors:
R. Ganesh Babu,
K. Uma Maheswari,
C. Zarro,
B. D. Parameshachari,
S. L. Ullo
Abstract:
Land use and land cover (LULC) classification using remote sensing imagery plays a vital role in many environment modeling and land use inventories. In this study, a hybrid feature optimization algorithm along with a deep learning classifier is proposed to improve the performance of LULC classification, helping to predict wildlife habitat, deteriorating environmental quality, haphazard, etc. LULC…
▽ More
Land use and land cover (LULC) classification using remote sensing imagery plays a vital role in many environment modeling and land use inventories. In this study, a hybrid feature optimization algorithm along with a deep learning classifier is proposed to improve the performance of LULC classification, helping to predict wildlife habitat, deteriorating environmental quality, haphazard, etc. LULC classification is assessed using Sat 4, Sat 6 and Eurosat datasets. After the selection of remote sensing images, normalization and histogram equalization methods are used to improve the quality of the images. Then, a hybrid optimization is accomplished by using the Local Gabor Binary Pattern Histogram Sequence (LGBPHS), the Histogram of Oriented Gradient (HOG) and Haralick texture features, for the feature extraction from the selected images. The benefits of this hybrid optimization are a high discriminative power and invariance to color and grayscale images. Next, a Human Group based Particle Swarm Optimization (PSO) algorithm is applied to select the optimal features, whose benefits are fast convergence rate and easy to implement. After selecting the optimal feature values, a Long Short Term Memory (LSTM) network is utilized to classify the LULC classes. Experimental results showed that the Human Group based PSO algorithm with a LSTM classifier effectively well differentiates the land use and land cover classes in terms of classification accuracy, recall and precision. An improvement of 2.56% in accuracy is achieved compared to the existing models GoogleNet, VGG, AlexNet, ConvNet, when the proposed method is applied.
△ Less
Submitted 7 November, 2020; v1 submitted 4 August, 2020;
originally announced August 2020.
-
Automatic Dataset Builder for Machine Learning Applications to Satellite Imagery
Authors:
Alessandro Sebastianelli,
Maria Pia Del Rosso,
Silvia Liberata Ullo
Abstract:
Nowadays the use of Machine Learning (ML) algorithms is spreading in the field of Remote Sensing, with applications ranging from detection and classification of land use and monitoring to the prediction of many natural or anthropic phenomena of interest. One main limit of their employment is related to the need for a huge amount of data for training the neural network, chosen for the specific appl…
▽ More
Nowadays the use of Machine Learning (ML) algorithms is spreading in the field of Remote Sensing, with applications ranging from detection and classification of land use and monitoring to the prediction of many natural or anthropic phenomena of interest. One main limit of their employment is related to the need for a huge amount of data for training the neural network, chosen for the specific application, and the resulting computational weight and time required to collect the necessary data. In this letter the architecture of an innovative tool, enabling researchers to create in an automatic way suitable datasets for AI (Artificial Intelligence) applications in the EO (Earth Observation) context, is presented. Two versions of the architecture have been implemented and made available on Git-Hub, with a specific Graphical User Interface (GUI) for non-expert users.
△ Less
Submitted 4 August, 2020;
originally announced August 2020.
-
Monitoring of Critical Infrastructures by Micro-Motion Estimation: the Mosul Dam Destabilization
Authors:
Filippo Biondi,
Pia Addabbo,
Carmine Clemente,
Silvia Liberata Ullo,
Danilo Orlando
Abstract:
In this paper, authors propose a new procedure to provide a tool for monitoring critical infrastructures. Particularly, through the analysis of COSMO-SkyMed satellite data, a detailed and updated survey is provided, for monitoring the accelerating destabilization process of the Mosul dam, that represents the largest hydraulic facility of Iraq and is located on the Tigris river. The destructive pot…
▽ More
In this paper, authors propose a new procedure to provide a tool for monitoring critical infrastructures. Particularly, through the analysis of COSMO-SkyMed satellite data, a detailed and updated survey is provided, for monitoring the accelerating destabilization process of the Mosul dam, that represents the largest hydraulic facility of Iraq and is located on the Tigris river. The destructive potential of the wave that would be generated, in the event of the dam destruction, could have serious consequences. If the concern for human lives comes first, the concern for cultural heritage protection is not negligible, since several archaeological sites are located around the Mosul dam. The proposed procedure is an in-depth modal assessment based on the micro-motion estimation, through a Doppler sub-apertures tracking and a Multi-Chromatic Analysis (MCA). The method is based initially on the Persistent Scatterers Interferometry (PSI) that is also discussed for completeness and validation. The modal analysis has detected the presence of several areas of resonance that could mean the presence of cracks, and the results have shown that the dam is still in a strong destabilization. Moreover, the dam appears to be divided into two parts: the northern part is accelerating rapidly while the southern part is decelerating and a main crack in this north-south junction is found. The estimated velocities through the PS-InSAR technique show a good agreement with the GNSS in-situ measurements, resulting in a very high correlation coefficient and showing how the proposed procedure works efficiently.
△ Less
Submitted 10 July, 2020;
originally announced July 2020.
-
Landslide Geohazard Assessment With Convolutional Neural Networks Using Sentinel-2 Imagery Data
Authors:
Silvia L. Ullo,
Maximillian S. Langenkamp,
Tuomas P. Oikarinen,
Maria P. Del Rosso,
Alessandro Sebastianelli,
Federica Piccirillo,
Stefania Sica
Abstract:
In this paper, the authors aim to combine the latest state of the art models in image recognition with the best publicly available satellite images to create a system for landslide risk mitigation. We focus first on landslide detection and further propose a similar system to be used for prediction. Such models are valuable as they could easily be scaled up to provide data for hazard evaluation, as…
▽ More
In this paper, the authors aim to combine the latest state of the art models in image recognition with the best publicly available satellite images to create a system for landslide risk mitigation. We focus first on landslide detection and further propose a similar system to be used for prediction. Such models are valuable as they could easily be scaled up to provide data for hazard evaluation, as satellite imagery becomes increasingly available. The goal is to use satellite images and correlated data to enrich the public repository of data and guide disaster relief efforts for locating precise areas where landslides have occurred. Different image augmentation methods are used to increase diversity in the chosen dataset and create more robust classification. The resulting outputs are then fed into variants of 3-D convolutional neural networks. A review of the current literature indicates there is no research using CNNs (Convolutional Neural Networks) and freely available satellite imagery for classifying landslide risk. The model has shown to be ultimately able to achieve a significantly better than baseline accuracy.
△ Less
Submitted 10 June, 2019;
originally announced June 2019.
