-
Explainable AI for UAV Mobility Management: A Deep Q-Network Approach for Handover Minimization
Authors:
Irshad A. Meer,
Bruno Hörmann,
Mustafa Ozger,
Fabien Geyer,
Alberto Viseras,
Dominic Schupke,
Cicek Cavdar
Abstract:
The integration of unmanned aerial vehicles (UAVs) into cellular networks presents significant mobility management challenges, primarily due to frequent handovers caused by probabilistic line-of-sight conditions with multiple ground base stations (BSs). To tackle these challenges, reinforcement learning (RL)-based methods, particularly deep Q-networks (DQN), have been employed to optimize handover…
▽ More
The integration of unmanned aerial vehicles (UAVs) into cellular networks presents significant mobility management challenges, primarily due to frequent handovers caused by probabilistic line-of-sight conditions with multiple ground base stations (BSs). To tackle these challenges, reinforcement learning (RL)-based methods, particularly deep Q-networks (DQN), have been employed to optimize handover decisions dynamically. However, a major drawback of these learning-based approaches is their black-box nature, which limits interpretability in the decision-making process. This paper introduces an explainable AI (XAI) framework that incorporates Shapley Additive Explanations (SHAP) to provide deeper insights into how various state parameters influence handover decisions in a DQN-based mobility management system. By quantifying the impact of key features such as reference signal received power (RSRP), reference signal received quality (RSRQ), buffer status, and UAV position, our approach enhances the interpretability and reliability of RL-based handover solutions. To validate and compare our framework, we utilize real-world network performance data collected from UAV flight trials. Simulation results show that our method provides intuitive explanations for policy decisions, effectively bridging the gap between AI-driven models and human decision-makers.
△ Less
Submitted 25 April, 2025;
originally announced April 2025.
-
Hierarchical Multi-Agent DRL Based Dynamic Cluster Reconfiguration for UAV Mobility Management
Authors:
Irshad A. Meer,
Karl-Ludwig Besser,
Mustafa Ozger,
Dominic Schupke,
H. Vincent Poor,
Cicek Cavdar
Abstract:
Multi-connectivity involves dynamic cluster formation among distributed access points (APs) and coordinated resource allocation from these APs, highlighting the need for efficient mobility management strategies for users with multi-connectivity. In this paper, we propose a novel mobility management scheme for unmanned aerial vehicles (UAVs) that uses dynamic cluster reconfiguration with energy-eff…
▽ More
Multi-connectivity involves dynamic cluster formation among distributed access points (APs) and coordinated resource allocation from these APs, highlighting the need for efficient mobility management strategies for users with multi-connectivity. In this paper, we propose a novel mobility management scheme for unmanned aerial vehicles (UAVs) that uses dynamic cluster reconfiguration with energy-efficient power allocation in a wireless interference network. Our objective encompasses meeting stringent reliability demands, minimizing joint power consumption, and reducing the frequency of cluster reconfiguration. To achieve these objectives, we propose a hierarchical multi-agent deep reinforcement learning (H-MADRL) framework, specifically tailored for dynamic clustering and power allocation. The edge cloud connected with a set of APs through low latency optical back-haul links hosts the high-level agent responsible for the optimal clustering policy, while low-level agents reside in the APs and are responsible for the power allocation policy. To further improve the learning efficiency, we propose a novel action-observation transition-driven learning algorithm that allows the low-level agents to use the action space from the high-level agent as part of the local observation space. This allows the lower-level agents to share partial information about the clustering policy and allocate the power more efficiently. The simulation results demonstrate that our proposed distributed algorithm achieves comparable performance to the centralized algorithm. Additionally, it offers better scalability, as the decision time for clustering and power allocation increases by only 10% when doubling the number of APs, compared to a 90% increase observed with the centralized approach.
△ Less
Submitted 5 December, 2024;
originally announced December 2024.
-
Learning Based Dynamic Cluster Reconfiguration for UAV Mobility Management with 3D Beamforming
Authors:
Irshad A. Meer,
Karl-Ludwig Besser,
Mustafa Ozger,
Dominic Schupke,
H. Vincent Poor,
Cicek Cavdar
Abstract:
In modern cell-less wireless networks, mobility management is undergoing a significant transformation, transitioning from single-link handover management to a more adaptable multi-connectivity cluster reconfiguration approach, including often conflicting objectives like energy-efficient power allocation and satisfying varying reliability requirements. In this work, we address the challenge of dyna…
▽ More
In modern cell-less wireless networks, mobility management is undergoing a significant transformation, transitioning from single-link handover management to a more adaptable multi-connectivity cluster reconfiguration approach, including often conflicting objectives like energy-efficient power allocation and satisfying varying reliability requirements. In this work, we address the challenge of dynamic clustering and power allocation for unmanned aerial vehicle (UAV) communication in wireless interference networks. Our objective encompasses meeting varying reliability demands, minimizing power consumption, and reducing the frequency of cluster reconfiguration. To achieve these objectives, we introduce a novel approach based on reinforcement learning using a masked soft actor-critic algorithm, specifically tailored for dynamic clustering and power allocation.
△ Less
Submitted 31 January, 2024;
originally announced February 2024.
-
Passive Sensing and Localization in an Aircraft Cabin Using a Wireless Communication Network
Authors:
Fabien Geyer,
Thomas Multerer,
Paulo Mendes,
Dominic Schupke
Abstract:
Advances in wireless localization techniques aiming to exploit context-dependent data has been leading to a growing interest in services able of localizing or tracking targets inside buildings with high accuracy and precision. Hence, the demand for indoor localization services has become a key prerequisite in some markets, such as in the aviation sector. In this context, we propose a system to pas…
▽ More
Advances in wireless localization techniques aiming to exploit context-dependent data has been leading to a growing interest in services able of localizing or tracking targets inside buildings with high accuracy and precision. Hence, the demand for indoor localization services has become a key prerequisite in some markets, such as in the aviation sector. In this context, we propose a system to passively localize and track passenger movements inside the cabin of an aircraft in a privacy preserving way using existing communication networks such as Wi-Fi or 5G. The estimated passenger positions can be used for various automation tasks such as measurement of passenger behavior during boarding. The paper describes a novel wireless localization system, based on Artificial Neural Networks, which passively senses the location of passengers. The position estimation is based on the observation of wireless communication signals that are already present in the environment. In this context, "passive" means that no additional devices are needed for the passengers. Experimental results show that the proposed system is able to achieve an average accuracy of 12 cm in a challenging environment like an aircraft cabin. This accuracy seems sufficient to control passenger separation.
△ Less
Submitted 18 December, 2023;
originally announced December 2023.
-
Physical Layer Security in a Private 5G Network for Industrial and Mobility Application
Authors:
Shivraj Hanumant Gonde,
Christoph Frisch,
Svetoslav Duhovnikov,
Martin Kubisch,
Thomas Meyerhoff,
Dominic Schupke
Abstract:
Cellular communication technologies such as 5G are deployed on a large scale around the world. Compared to other communication technologies such as WiFi, Bluetooth, or Ultra Wideband, the 5G communication standard describes support for a large variety of use cases, e.g., Internet of Things, vehicular, industrial, and campus-wide communications. An organization can operate a Private 5G network to p…
▽ More
Cellular communication technologies such as 5G are deployed on a large scale around the world. Compared to other communication technologies such as WiFi, Bluetooth, or Ultra Wideband, the 5G communication standard describes support for a large variety of use cases, e.g., Internet of Things, vehicular, industrial, and campus-wide communications. An organization can operate a Private 5G network to provide connectivity to devices in their manufacturing environment. Physical Layer Key Generation (PLKG) is a method to generate a symmetric secret on two nodes despite the presence of a potential passive eavesdropper. To the best of our knowledge, this work is one of the first to implement PLKG in a real Private 5G network. Therefore, it highlights the possibility of integrating PLKG in the communication technology highly relevant for industrial applications. This paper exemplifies the establishment of a long-term symmetric key between an aerial vehicle and IT infrastructure both located in a manufacturing environment and communicating via the radio interface of the Private 5G network.
△ Less
Submitted 9 October, 2023;
originally announced October 2023.
-
6G for Connected Sky: A Vision for Integrating Terrestrial and Non-Terrestrial Networks
Authors:
Mustafa Ozger,
Istvan Godor,
Anders Nordlow,
Thomas Heyn,
Sreekrishna Pandi,
Ian Peterson,
Alberto Viseras,
Jaroslav Holis,
Christian Raffelsberger,
Andreas Kercek,
Bengt Mölleryd,
Laszlo Toka,
Gergely Biczok,
Robby de Candido,
Felix Laimer,
Udo Tarmann,
Dominic Schupke,
Cicek Cavdar
Abstract:
In this paper, we present the vision of our project 6G for Connected Sky (6G-SKY) to integrate terrestrial networks (TNs) and non-terrestrial networks (NTNs) and outline the current research activities in 6G research projects in comparison with our project. From the perspectives of industry and academia, we identify key use case segments connecting both aerial and ground users with our 6G-SKY mult…
▽ More
In this paper, we present the vision of our project 6G for Connected Sky (6G-SKY) to integrate terrestrial networks (TNs) and non-terrestrial networks (NTNs) and outline the current research activities in 6G research projects in comparison with our project. From the perspectives of industry and academia, we identify key use case segments connecting both aerial and ground users with our 6G-SKY multi-layer network architecture. We explain functional views of our holistic 6G-SKY architecture addressing the heterogeneity of aerial and space platforms. Architecture elements and communication links are identified. We discuss 6G-SKY network design and management functionalities by considering a set of inherent challenges posed by the multi-layer 3-dimensional networks, which we termed as combined airspace and NTN (combined ASN). Finally, we investigate additional research challenges for 6G-SKY project targets.
△ Less
Submitted 7 May, 2023;
originally announced May 2023.
-
Precise Onboard Aircraft Cabin Localization using UWB and ML
Authors:
Fabien Geyer,
Dominic Schupke
Abstract:
Precise indoor positioning systems (IPSs) are key to perform a set of tasks more efficiently during aircraft production, operation and maintenance. For instance, IPSs can overcome the tedious task of configuring (wireless) sensor nodes in an aircraft cabin. Although various solutions based on technologies of established consumer goods, e.g., Bluetooth or WiFi, have been proposed and tested, the pu…
▽ More
Precise indoor positioning systems (IPSs) are key to perform a set of tasks more efficiently during aircraft production, operation and maintenance. For instance, IPSs can overcome the tedious task of configuring (wireless) sensor nodes in an aircraft cabin. Although various solutions based on technologies of established consumer goods, e.g., Bluetooth or WiFi, have been proposed and tested, the published accuracy results fail to make these technologies relevant for practical use cases. This stems from the challenging environments for positioning, especially in aircraft cabins, which is mainly due to the geometries, many obstacles, and highly reflective materials. To address these issues, we propose to evaluate in this work an Ultra-Wideband (UWB)-based IPS via a measurement campaign performed in a real aircraft cabin. We first illustrate the difficulties that an IPS faces in an aircraft cabin, by studying the signal propagation effects which were measured. We then investigate the ranging and localization accuracies of our IPS. Finally, we also introduce various methods based on machine learning (ML) for correcting the ranging measurements and demonstrate that we are able to localize a node with respect to an aircraft seat with a measured likelihood of 97%.
△ Less
Submitted 6 April, 2022; v1 submitted 16 March, 2022;
originally announced March 2022.
-
mmWave Communications for Indoor Dense Spaces: Ray-Tracing Based Channel Characterization and Performance Comparison
Authors:
Ozan Alp Topal,
Mustafa Ozger,
Dominic Schupke,
Emil Björnson,
Cicek Cavdar
Abstract:
In this paper, the indoor dense space (IDS) channel at 28 GHz is characterized through extensive Ray-Tracing (RT) simulations. We consider IDS as a specific type of indoor environment with confined geometry and packed with humans, such as aircraft cabins and train wagons. Based on RT simulations, we characterize path loss, shadow fading, root-mean-square delay spread, Rician K-factor, azimuth/elev…
▽ More
In this paper, the indoor dense space (IDS) channel at 28 GHz is characterized through extensive Ray-Tracing (RT) simulations. We consider IDS as a specific type of indoor environment with confined geometry and packed with humans, such as aircraft cabins and train wagons. Based on RT simulations, we characterize path loss, shadow fading, root-mean-square delay spread, Rician K-factor, azimuth/elevation angular spread of arrival/departure considering different RT simulation scenarios of the fuselage geometry, material, and human presence. While the large-scale fading parameters are similar to the state-of-the-art channel models, the small-scale fading parameters demonstrate richer multipath scattering in IDS, resulting in poorer bit error rate performance in comparison to the 3GPP indoor channel model.
△ Less
Submitted 17 February, 2022;
originally announced February 2022.
-
A Survey of Wireless Networks for Future Aerial COMmunications (FACOM)
Authors:
Aygün Baltaci,
Ergin Dinc,
Mustafa Ozger,
Abdulrahman Alabbasi,
Cicek Cavdar,
Dominic Schupke
Abstract:
Electrification turned over a new leaf in aviation by introducing new types of aerial vehicles along with new means of transportation. Addressing a plethora of use cases, drones are gaining attention and increasingly appear in the sky. Emerging concepts of flying taxi enable passengers to be transported over several tens of kilometers. Therefore, unmanned traffic management systems are under devel…
▽ More
Electrification turned over a new leaf in aviation by introducing new types of aerial vehicles along with new means of transportation. Addressing a plethora of use cases, drones are gaining attention and increasingly appear in the sky. Emerging concepts of flying taxi enable passengers to be transported over several tens of kilometers. Therefore, unmanned traffic management systems are under development to cope with the complexity of future airspace, thereby resulting in unprecedented communication needs. Moreover, the increase in the number of commercial airplanes pushes the limits of voice-oriented communications, and future options such as single-pilot operations demand robust connectivity. In this survey, we provide a comprehensive review and vision for enabling the connectivity applications of aerial vehicles utilizing current and future communication technologies. We begin by categorizing the connectivity use cases per aerial vehicle and analyzing their connectivity requirements. By reviewing more than 500 related studies, we aim for a comprehensive approach to cover wireless communication technologies, and provide an overview of recent findings from the literature toward the possibilities and challenges of employing the wireless communication standards. After analyzing the network architectures, we list the open-source testbed platforms to facilitate future investigations. This study helped us observe that while numerous works focused on cellular technologies for aerial platforms, a single wireless technology is not sufficient to meet the stringent connectivity demands of the aerial use cases. We identified the need of further investigations on multi-technology network architectures to enable robust connectivity in the sky. Future works should consider suitable technology combinations to develop unified aerial networks that can meet the diverse quality of service demands.
△ Less
Submitted 7 November, 2021;
originally announced November 2021.
-
Evaluation of RF Wireless Power Transfer for Low-Power Aircraft Sensors
Authors:
Jan Tepper,
Aygün Baltaci,
Bernd Schleicher,
Andreas Drexler,
Svetoslav Duhovnikov,
Mustafa Ozger,
Morteza Tavana,
Cicek Cavdar,
Dominic Schupke
Abstract:
Low-power sensors can be integrated into an aircraft for numerous use cases. Conventionally, these sensors are powered via cables, which introduces various disadvantages to the overall efficiency of the aircraft. Alternatively, batteries may be used. However, this implies the necessity of additional maintenance for battery replacement. Another option to remove power cables is to use Radio Frequenc…
▽ More
Low-power sensors can be integrated into an aircraft for numerous use cases. Conventionally, these sensors are powered via cables, which introduces various disadvantages to the overall efficiency of the aircraft. Alternatively, batteries may be used. However, this implies the necessity of additional maintenance for battery replacement. Another option to remove power cables is to use Radio Frequency (RF) Wireless Power Transfer (WPT) systems. Although general RF WPT technology has been studied in the literature, its feasibility for aviation use cases is not fully investigated. In this paper, we study the feasibility of RF WPT to wirelessly power low-power in-cabin sensors. In a cabin mock-up we show that RF WPT techonology is capable of almost fully covering an area of 20 seats and quantitatively assess this using Received Signal Strength Indicators (up to $28$ mW) and packet interval rate (up to $5.5$ Hz). Furthermore, we perform multi-tone sinusoidal wave experiments for power transmission scheme in a lab environment and thereby present potential ways to improve receiver sensitivity and consequently increase the WPT coverage in the cabin without changing the average transmission power. The overall results show that certain low-power cabin use cases can be supported by already existing commercial RF WPT systems.
△ Less
Submitted 13 August, 2020;
originally announced August 2020.
-
Quality of Service Aware Traffic Management for Aircraft Communications
Authors:
David Tomic,
Sandra Hofmann,
Mustafa Ozger,
Dominic Schupke,
Cicek Cavdar
Abstract:
In-flight Internet connectivity is a necessity for aircraft passengers as well as aircraft systems. It is challenging to satisfy required quality of service (QoS) levels for flows within aircraft due to the large number of users and the highly varying air to ground (A2G) link capacities composed of satellite and direct air to ground communication (DA2GC). To represent service quality variations, w…
▽ More
In-flight Internet connectivity is a necessity for aircraft passengers as well as aircraft systems. It is challenging to satisfy required quality of service (QoS) levels for flows within aircraft due to the large number of users and the highly varying air to ground (A2G) link capacities composed of satellite and direct air to ground communication (DA2GC). To represent service quality variations, we propose models for the generated traffic flows from aircraft and variations in A2G links. We present three different forwarding schemes based on priority, delay requirements and history of the dropped flows metrics. Forwarding schemes schedule the flows in real time by choosing either satellite or direct air to ground link depending on the delay and capacity requirements of flows to maximize the number of accepted flows with required QoS guarantees in terms of dropped packets and delay. Also, the effect of local caching is studied to fully satisfy the QoS requirement of flows in simulated flights. We implement the forwarding procedures and caching in ns-3 and test their performance in a current connectivity scenario of 100 Mbps capacity for both the satellite spot and ground base station in a one-hour flight. Our study shows that although the forwarding procedure based on a combination of priority and delay requirement has relatively better performance than the other schemes, which are based on priority only and weighted average of all metrics, in dropped packet percentage and delay, the current connectivity setup is not able to satisfy all QoS requirements. Furthermore, at least 0.9 cache hit rate is required to satisfy all flows for at least 50% of simulated flights.
△ Less
Submitted 1 April, 2020;
originally announced April 2020.
-
Mobility-Aware Joint Service Placement and Routing in Space-Air-Ground Integrated Networks
Authors:
Amir Varasteh,
Sandra Hofmann,
Nemanja Deric,
Mu He,
Dominic Schupke,
Wolfgang Kellerer,
Carmen Mas Machuca
Abstract:
People desire to be connected, no matter where they are. Recently, providing Internet access to on-board passengers has received a lot of attention from both industry and academia. However, in order to guarantee an acceptable Quality of Service (QoS) for the passenger services with low incurred cost, the path to route the services, as well as the datacenter (DC) to deploy the services should be ca…
▽ More
People desire to be connected, no matter where they are. Recently, providing Internet access to on-board passengers has received a lot of attention from both industry and academia. However, in order to guarantee an acceptable Quality of Service (QoS) for the passenger services with low incurred cost, the path to route the services, as well as the datacenter (DC) to deploy the services should be carefully determined. This problem is challenging, due to different types of Air-to-Ground (A2G) connections, i.e., satellites and Direct-Air-to-Ground (DA2G) links. These A2G connection types differ in terms of cost, bandwidth, and latency. Furthermore, due to the flights' movements, it is important to consider adapting the service location accordingly. In this work, we formulate two Mixed Integer Linear Programs (MILPs) for the problem of Joint Service Placement and Routing (JSPR): i) Static (S-JSPR), and ii) Mobility-Aware~(MA-JSPR) in Space-Air-Ground Integrated Networks (SAGIN), with the objective of minimizing the total cost. We compare S-JSPR and MA-JSPR using comprehensive evaluations in a realistic European-based SAGIN. The obtained results show that the MA-JSPR model, by considering the future flight positions and using a service migration control, reduces the long-term total cost notably. Also, we show S-JSPR benefits from a low time-complexity and it achieves lower end-to-end delays comparing to MA-JSPR model.
△ Less
Submitted 4 May, 2019; v1 submitted 5 February, 2019;
originally announced February 2019.
