-
A Semantic-Loss Function Modeling Framework With Task-Oriented Machine Learning Perspectives
Authors:
Ti Ti Nguyen,
Thanh-Dung Le,
Vu Nguyen Ha,
Hong-fu Chou,
Geoffrey Eappen,
Duc-Dung Tran,
Hung Nguyen-Kha,
Prabhu Thiruvasagam,
Luis M. Garces-Socarras,
Jorge L. Gonzalez-Rios,
Juan C. Merlano-Duncan,
Symeon Chatzinotas
Abstract:
The integration of machine learning (ML) has significantly enhanced the capabilities of Earth Observation (EO) systems by enabling the extraction of actionable insights from complex datasets. However, the performance of data-driven EO applications is heavily influenced by the data collection and transmission processes, where limited satellite bandwidth and latency constraints can hinder the full t…
▽ More
The integration of machine learning (ML) has significantly enhanced the capabilities of Earth Observation (EO) systems by enabling the extraction of actionable insights from complex datasets. However, the performance of data-driven EO applications is heavily influenced by the data collection and transmission processes, where limited satellite bandwidth and latency constraints can hinder the full transmission of original data to the receivers. To address this issue, adopting the concepts of Semantic Communication (SC) offers a promising solution by prioritizing the transmission of essential data semantics over raw information. Implementing SC for EO systems requires a thorough understanding of the impact of data processing and communication channel conditions on semantic loss at the processing center. This work proposes a novel data-fitting framework to empirically model the semantic loss using real-world EO datasets and domain-specific insights. The framework quantifies two primary types of semantic loss: (1) source coding loss, assessed via a data quality indicator measuring the impact of processing on raw source data, and (2) transmission loss, evaluated by comparing practical transmission performance against the Shannon limit. Semantic losses are estimated by evaluating the accuracy of EO applications using four task-oriented ML models, EfficientViT, MobileViT, ResNet50-DINO, and ResNet8-KD, on lossy image datasets under varying channel conditions and compression ratios. These results underpin a framework for efficient semantic-loss modeling in bandwidth-constrained EO scenarios, enabling more reliable and effective operations.
△ Less
Submitted 12 March, 2025;
originally announced March 2025.
-
Semantic Knowledge Distillation for Onboard Satellite Earth Observation Image Classification
Authors:
Thanh-Dung Le,
Vu Nguyen Ha,
Ti Ti Nguyen,
Geoffrey Eappen,
Prabhu Thiruvasagam,
Hong-fu Chou,
Duc-Dung Tran,
Luis M. Garces-Socarras,
Jorge L. Gonzalez-Rios,
Juan Carlos Merlano-Duncan,
Symeon Chatzinotas
Abstract:
This study presents an innovative dynamic weighting knowledge distillation (KD) framework tailored for efficient Earth observation (EO) image classification (IC) in resource-constrained settings. Utilizing EfficientViT and MobileViT as teacher models, this framework enables lightweight student models, particularly ResNet8 and ResNet16, to surpass 90% in accuracy, precision, and recall, adhering to…
▽ More
This study presents an innovative dynamic weighting knowledge distillation (KD) framework tailored for efficient Earth observation (EO) image classification (IC) in resource-constrained settings. Utilizing EfficientViT and MobileViT as teacher models, this framework enables lightweight student models, particularly ResNet8 and ResNet16, to surpass 90% in accuracy, precision, and recall, adhering to the stringent confidence thresholds necessary for reliable classification tasks. Unlike conventional KD methods that rely on static weight distribution, our adaptive weighting mechanism responds to each teacher model's confidence, allowing student models to prioritize more credible sources of knowledge dynamically. Remarkably, ResNet8 delivers substantial efficiency gains, achieving a 97.5% reduction in parameters, a 96.7% decrease in FLOPs, an 86.2% cut in power consumption, and a 63.5% increase in inference speed over MobileViT. This significant optimization of complexity and resource demands establishes ResNet8 as an optimal candidate for EO tasks, combining robust performance with feasibility in deployment. The confidence-based, adaptable KD approach underscores the potential of dynamic distillation strategies to yield high-performing, resource-efficient models tailored for satellite-based EO applications. The reproducible code is accessible on our GitHub repository.
△ Less
Submitted 31 October, 2024;
originally announced November 2024.
-
On-Air Deep Learning Integrated Semantic Inference Models for Enhanced Earth Observation Satellite Networks
Authors:
Hong-fu Chou,
Vu Nguyen Ha,
Prabhu Thiruvasagam,
Thanh-Dung Le,
Geoffrey Eappen,
Ti Ti Nguyen,
Luis M. Garces-Socarras,
Jorge L. Gonzalez-Rios,
Juan Carlos Merlano-Duncan,
Symeon Chatzinotas
Abstract:
Earth Observation (EO) systems are crucial for cartography, disaster surveillance, and resource administration. Nonetheless, they encounter considerable obstacles in the processing and transmission of extensive data, especially in specialized domains such as precision agriculture and real-time disaster response. Earth observation satellites, outfitted with remote sensing technology, gather data fr…
▽ More
Earth Observation (EO) systems are crucial for cartography, disaster surveillance, and resource administration. Nonetheless, they encounter considerable obstacles in the processing and transmission of extensive data, especially in specialized domains such as precision agriculture and real-time disaster response. Earth observation satellites, outfitted with remote sensing technology, gather data from onboard sensors and IoT-enabled terrestrial objects, delivering important information remotely. Domain-adapted Large Language Models (LLMs) provide a solution by enabling the integration of raw and processed EO data. Through domain adaptation, LLMs improve the assimilation and analysis of many data sources, tackling the intricacies of specialized datasets in agriculture and disaster response. This data synthesis, directed by LLMs, enhances the precision and pertinence of conveyed information. This study provides a thorough examination of using semantic inference and deep learning for sophisticated EO systems. It presents an innovative architecture for semantic communication in EO satellite networks, designed to improve data transmission efficiency using semantic processing methodologies. Recent advancements in onboard processing technologies enable dependable, adaptable, and energy-efficient data management in orbit. These improvements guarantee reliable performance in adverse space circumstances using radiation-hardened and reconfigurable technology. Collectively, these advancements enable next-generation satellite missions with improved processing capabilities, crucial for operational flexibility and real-time decision-making in 6G satellite communication.
△ Less
Submitted 1 November, 2024; v1 submitted 23 September, 2024;
originally announced September 2024.
-
Onboard Satellite Image Classification for Earth Observation: A Comparative Study of ViT Models
Authors:
Thanh-Dung Le,
Vu Nguyen Ha,
Ti Ti Nguyen,
Geoffrey Eappen,
Prabhu Thiruvasagam,
Hong-fu Chou,
Duc-Dung Tran,
Hung Nguyen-Kha,
Luis M. Garces-Socarras,
Jorge L. Gonzalez-Rios,
Juan Carlos Merlano-Duncan,
Symeon Chatzinotas
Abstract:
This study focuses on identifying the most effective pre-trained model for land use classification in onboard satellite processing, emphasizing achieving high accuracy, computational efficiency, and robustness against noisy data conditions commonly encountered during satellite-based inference. Through extensive experimentation, we compare the performance of traditional CNN-based, ResNet-based, and…
▽ More
This study focuses on identifying the most effective pre-trained model for land use classification in onboard satellite processing, emphasizing achieving high accuracy, computational efficiency, and robustness against noisy data conditions commonly encountered during satellite-based inference. Through extensive experimentation, we compare the performance of traditional CNN-based, ResNet-based, and various pre-trained vision Transformer models. Our findings demonstrate that pre-trained Vision Transformer (ViT) models, particularly MobileViTV2 and EfficientViT-M2, outperform models trained from scratch in terms of accuracy and efficiency. These models achieve high performance with reduced computational requirements and exhibit greater resilience during inference under noisy conditions. While MobileViTV2 has excelled on clean validation data, EfficientViT-M2 has proved more robust when handling noise, making it the most suitable model for onboard satellite EO tasks. Our experimental results demonstrate that EfficientViT-M2 is the optimal choice for reliable and efficient RS-IC in satellite operations, achieving 98.76 % of accuracy, precision, and recall. Precisely, EfficientViT-M2 delivers the highest performance across all metrics, excels in training efficiency (1,000s) and inference time (10s), and demonstrates greater robustness (overall robustness score of 0.79). Consequently, EfficientViT-M2 consumes 63.93 % less power than MobileViTV2 (79.23 W) and 73.26 % less power than SwinTransformer (108.90 W). This highlights its significant advantage in energy efficiency.
△ Less
Submitted 22 April, 2025; v1 submitted 5 September, 2024;
originally announced September 2024.
-
Satellite-based Quantum Network: Security and Challenges over Atmospheric Channel
Authors:
Hong-fu Chou,
Vu Nguyen Ha,
Hayder Al-Hraishawi,
Luis Manuel Garces-Socarras,
Jorge Luis Gonzalez-Rios,
Juan Carlos Merlano-Duncan,
Symeon Chatzinotas
Abstract:
The ultra-secure quantum network leverages quantum cryptography to deliver unsurpassed data transfer security. In principle, the well-known quantum key distribution (QKD) achieves unconditional security, which raises concerns about the trustworthiness of 6G wireless systems in order to mitigate the gap between practice and theory. The long-distance satellite-to-ground evolving quantum network dist…
▽ More
The ultra-secure quantum network leverages quantum cryptography to deliver unsurpassed data transfer security. In principle, the well-known quantum key distribution (QKD) achieves unconditional security, which raises concerns about the trustworthiness of 6G wireless systems in order to mitigate the gap between practice and theory. The long-distance satellite-to-ground evolving quantum network distributes keys that are ubiquitous to the node on the ground through low-orbit satellites. As the secret key sequence is encoded into quantum states, it is sent through the atmosphere via a quantum channel. It still requires more effort in the physical layer design of deployment ranges, transmission, and security to achieve high-quality quantum communication. In this paper, we first review the quantum states and channel properties for satellite-based quantum networks and long-range quantum state transfer (QST). Moreover, we highlight some challenges, such as transmissivity statistics, estimation of channel parameters and attack resilience, quantum state transfer for satellite-based quantum networks, and wavepacket shaping techniques over atmospheric channels. We underline two research directions that consider the QST and wavepacket shaping techniques for atmospheric transmission in order to encourage further research toward the next generation of satellite-based quantum networks.
△ Less
Submitted 17 September, 2023; v1 submitted 29 July, 2023;
originally announced August 2023.
