-
Real-Time Sounding in ISAC networks: Design and Implementation of a Multi-Node Testbed with Synchronized Airborne and Ground-Based Sensors
Authors:
Julia Beuster,
Carsten Andrich,
Sebastian Giehl,
Marc Miranda,
Lorenz Mohr,
Dieter Novotny,
Tom Kaufmann,
Christian Schneider,
Reiner S. Thomä
Abstract:
As integrated sensing and communication (ISAC) capabilities become more prevalent in the mobile 6G radio landscape, there is a substantial opportunity to enhance situational awareness across diverse applications through multi-static radar sensing within meshed ISAC networks. To facilitate the development and testing of detection and localization algorithms across diverse scenarios, this paper intr…
▽ More
As integrated sensing and communication (ISAC) capabilities become more prevalent in the mobile 6G radio landscape, there is a substantial opportunity to enhance situational awareness across diverse applications through multi-static radar sensing within meshed ISAC networks. To facilitate the development and testing of detection and localization algorithms across diverse scenarios, this paper introduces a synchronized distributed channel sounding testbed with airborne and ground-based multi-channel transceiver nodes with centimeter-level positioning accuracy enabled by real-time kinematic (RTK) and inertial navigation system (INS) data. Our modular experimental measurement system is designed to include stationary sensor nodes and light-weight to medium-weight mobile nodes deployable on unmanned aerial vehicles (UAVs), cars, pedestrians, and cyclists. Utilizing commercial off-the-shelf (COTS) hardware, specifically software defined radios (SDRs), the testbed encourages reproducibility in academic research laboratories. We detail the individual modules and integration steps required to achieve the specified performance. The testbed's capabilities are validated through a real-world measurement campaign, including stationary and flying sensor nodes, aimed at detecting radar targets such as vertical take-off and landing (VTOL) aircrafts, small hexacopters, cars and vulnerable road users (VRUs) in air-to-air (A2A) and air-to-ground (A2G) scenarios.
△ Less
Submitted 31 May, 2025;
originally announced June 2025.
-
Modeling Micro-Doppler Signature of Multi-Propeller Drones in Distributed ISAC
Authors:
Heraldo Cesar Alves Costa,
Saw J. Myint,
Carsten Andrich,
Sebastian W. Giehl,
Maximilian Engelhardt,
Christian Schneider,
Reiner S. Thomä
Abstract:
Integrated Sensing and Communication (ISAC) will be one key feature of future 6G networks, enabling simultaneous communication and radar sensing. The radar sensing geometry of ISAC will be multistatic since that corresponds to the common distributed structure of a mobile communication network. Within this framework, micro-Doppler analysis plays a vital role in classifying targets based on their mi…
▽ More
Integrated Sensing and Communication (ISAC) will be one key feature of future 6G networks, enabling simultaneous communication and radar sensing. The radar sensing geometry of ISAC will be multistatic since that corresponds to the common distributed structure of a mobile communication network. Within this framework, micro-Doppler analysis plays a vital role in classifying targets based on their micromotions, such as rotating propellers, vibration, or moving limbs. However, research on bistatic micro-Doppler effects, particularly in ISAC systems utilizing OFDM waveforms, remains limited. Existing methods, including electromagnetic simulations often lack scalability for generating the large datasets required to train machine learning algorithms. To address this gap, this work introduces an OFDM-based bistatic micro-Doppler model for multi-propeller drones. The proposed model adapts the classic thin-wire model to include bistatic sensing configuration with an OFDM-like signal. Then, it extends further by incorporating multiple propellers and integrating the reflectivity of the drone's static parts. Measurements were performed to collect ground truth data for verification of the proposed model. Validation results show that the model generates micro-Doppler signatures closely resembling those obtained from measurements, demonstrating its potential as a tool for data generation. In addition, it offers a comprehensive approach to analyzing bistatic micro-Doppler effects.
△ Less
Submitted 7 April, 2025;
originally announced April 2025.
-
Bistatic Micro-Doppler Analysis of a Vertical Takeoff and Landing (VTOL) Drone in ICAS Framework
Authors:
Heraldo Cesar Alves Costa,
Saw James Myint,
Carsten Andrich,
Sebastian W. Giehl,
Dieter Novotny,
Julia Beuster,
Christian Schneider,
Reiner S. Thomä
Abstract:
Integrated Communication and Sensing (ICAS) is a key technology that enables sensing functionalities within the next-generation mobile communication (6G). Joint design and optimization of both functionalities could allow coexistence, therefore it advances toward joint signal processing and using the same hardware platform and common spectrum. Contributing to ICAS sensing, this paper presents the m…
▽ More
Integrated Communication and Sensing (ICAS) is a key technology that enables sensing functionalities within the next-generation mobile communication (6G). Joint design and optimization of both functionalities could allow coexistence, therefore it advances toward joint signal processing and using the same hardware platform and common spectrum. Contributing to ICAS sensing, this paper presents the measurement and analysis of the micro-Doppler signature of Vertical Takeoff and Landing (VTOL) drones. Measurement is performed with an OFDM-like communication signal and bistatic constellation, which is a typical case in ICAS scenarios. This work shows that micro-Doppler signatures can be used to precisely distinguish flight modes, such as take-off, landing, hovering, transition, and cruising.
△ Less
Submitted 12 February, 2025;
originally announced February 2025.
-
CodeSCAN: ScreenCast ANalysis for Video Programming Tutorials
Authors:
Alexander Naumann,
Felix Hertlein,
Jacqueline Höllig,
Lucas Cazzonelli,
Steffen Thoma
Abstract:
Programming tutorials in the form of coding screencasts play a crucial role in programming education, serving both novices and experienced developers. However, the video format of these tutorials presents a challenge due to the difficulty of searching for and within videos. Addressing the absence of large-scale and diverse datasets for screencast analysis, we introduce the CodeSCAN dataset. It com…
▽ More
Programming tutorials in the form of coding screencasts play a crucial role in programming education, serving both novices and experienced developers. However, the video format of these tutorials presents a challenge due to the difficulty of searching for and within videos. Addressing the absence of large-scale and diverse datasets for screencast analysis, we introduce the CodeSCAN dataset. It comprises 12,000 screenshots captured from the Visual Studio Code environment during development, featuring 24 programming languages, 25 fonts, and over 90 distinct themes, in addition to diverse layout changes and realistic user interactions. Moreover, we conduct detailed quantitative and qualitative evaluations to benchmark the performance of Integrated Development Environment (IDE) element detection, color-to-black-and-white conversion, and Optical Character Recognition (OCR). We hope that our contributions facilitate more research in coding screencast analysis, and we make the source code for creating the dataset and the benchmark publicly available on this website.
△ Less
Submitted 27 September, 2024;
originally announced September 2024.
-
A Note on Piecewise Affine Decision Rules for Robust, Stochastic, and Data-Driven Optimization
Authors:
Simon Thomä,
Maximilian Schiffer,
Wolfram Wiesemann
Abstract:
Multi-stage decision-making under uncertainty, where decisions are taken under sequentially revealing uncertain problem parameters, is often essential to faithfully model managerial problems. Given the significant computational challenges involved, these problems are typically solved approximately. This short note introduces an algorithmic framework that revisits a popular approximation scheme for…
▽ More
Multi-stage decision-making under uncertainty, where decisions are taken under sequentially revealing uncertain problem parameters, is often essential to faithfully model managerial problems. Given the significant computational challenges involved, these problems are typically solved approximately. This short note introduces an algorithmic framework that revisits a popular approximation scheme for multi-stage stochastic programs by Georghiou et al. (2015) and improves upon it to deliver superior policies in the stochastic setting, as well as extend its applicability to robust optimization and a contemporary Wasserstein-based data-driven setting. We demonstrate how the policies of our framework can be computed efficiently, and we present numerical experiments that highlight the benefits of our method.
△ Less
Submitted 16 September, 2024;
originally announced September 2024.
-
BIRA: A Spherical Bistatic Reflectivity Measurement System
Authors:
Carsten Andrich,
Tobias F. Nowack,
Alexander Ihlow,
Sebastian Giehl,
Maximilian Engelhardt,
Gerd Sommerkorn,
Andreas Schwind,
Willi Hofmann,
Christian Bornkessel,
Reiner S. Thomä,
Matthias A. Hein
Abstract:
The upcoming 6G mobile communication standard will offer a revolutionary new feature: Integrated sensing and communication (ISAC) reuses mobile communication signals to realize multi-static radar for various applications including localization. Consequently, applied ISAC propagation research necessitates to evolve from classical monostatic radar cross section (RCS) measurement of static targets on…
▽ More
The upcoming 6G mobile communication standard will offer a revolutionary new feature: Integrated sensing and communication (ISAC) reuses mobile communication signals to realize multi-static radar for various applications including localization. Consequently, applied ISAC propagation research necessitates to evolve from classical monostatic radar cross section (RCS) measurement of static targets on to bistatic radar reflectivity characterization of dynamic objects. Here, we introduce our "Bistatic Radar" (BIRA) and antenna measurement facility for bistatic spherical positioning with sub-millimeter accuracy on a diameter of up to 7 m and with almost continuous frequency coverage from 0.7 up to 260 GHz. Currently, BIRA is the only bistatic measurement facility capable of unrestricted ISAC research: In addition to vector network analysis, BIRA employs advanced wideband transceiver technology with an instantaneous bandwidth of up to 4 GHz. These transceivers grant BIRA the unique ability to characterize dynamic targets in both Doppler and range, while also significantly accelerating RCS measurements of static objects.
△ Less
Submitted 18 July, 2024;
originally announced July 2024.
-
FZI-WIM at SemEval-2024 Task 2: Self-Consistent CoT for Complex NLI in Biomedical Domain
Authors:
Jin Liu,
Steffen Thoma
Abstract:
This paper describes the inference system of FZI-WIM at the SemEval-2024 Task 2: Safe Biomedical Natural Language Inference for Clinical Trials. Our system utilizes the chain of thought (CoT) paradigm to tackle this complex reasoning problem and further improves the CoT performance with self-consistency. Instead of greedy decoding, we sample multiple reasoning chains with the same prompt and make…
▽ More
This paper describes the inference system of FZI-WIM at the SemEval-2024 Task 2: Safe Biomedical Natural Language Inference for Clinical Trials. Our system utilizes the chain of thought (CoT) paradigm to tackle this complex reasoning problem and further improves the CoT performance with self-consistency. Instead of greedy decoding, we sample multiple reasoning chains with the same prompt and make the final verification with majority voting. The self-consistent CoT system achieves a baseline F1 score of 0.80 (1st), faithfulness score of 0.90 (3rd), and consistency score of 0.73 (12th). We release the code and data publicly https://github.com/jens5588/FZI-WIM-NLI4CT.
△ Less
Submitted 14 June, 2024;
originally announced June 2024.
-
Transfer Learning for CSI-based Positioning with Multi-environment Meta-learning
Authors:
Anastasios Foliadis,
Mario H. Castañeda,
Richard A. Stirling-Gallacher,
Reiner S. Thomä
Abstract:
Utilizing deep learning (DL) techniques for radio-based positioning of user equipment (UE) through channel state information (CSI) fingerprints has demonstrated significant potential. DL models can extract complex characteristics from the CSI fingerprints of a particular environment and accurately predict the position of a UE. Nonetheless, the effectiveness of the DL model trained on CSI fingerpri…
▽ More
Utilizing deep learning (DL) techniques for radio-based positioning of user equipment (UE) through channel state information (CSI) fingerprints has demonstrated significant potential. DL models can extract complex characteristics from the CSI fingerprints of a particular environment and accurately predict the position of a UE. Nonetheless, the effectiveness of the DL model trained on CSI fingerprints is highly dependent on the particular training environment, limiting the trained model's applicability across different environments. This paper proposes a novel DL model structure consisting of two parts, where the first part aims at identifying features that are independent from any specific environment, while the second part combines those features in an environment specific way with the goal of positioning. To train such a two-part model, we propose the multi-environment meta-learning (MEML) approach for the first part to facilitate training across various environments, while the second part of the model is trained solely on data from a specific environment. Our findings indicate that employing the MEML approach for initializing the weights of the DL model for a new unseen environment significantly boosts the accuracy of UE positioning in the new target environment as well the reliability of its uncertainty estimation. This method outperforms traditional transfer learning methods, whether direct transfer learning (DTL) between environments or completely training from scratch with data from a new environment. The proposed approach is verified with real measurements for both line-of-sight (LOS) and non-LOS (NLOS) environments.
△ Less
Submitted 20 May, 2024;
originally announced May 2024.
-
Deep Learning based Positioning with Multi-task Learning and Uncertainty-based Fusion
Authors:
Anastasios Foliadis,
Mario H. Castañeda,
Richard A. Stirling-Gallacher,
Reiner S. Thomä
Abstract:
Deep learning (DL) methods have been shown to improve the performance of several use cases for the fifth-generation (5G) New radio (NR) air interface. In this paper we investigate user equipment (UE) positioning using the channel state information (CSI) fingerprints between a UE and multiple base stations (BSs). In such a setup, we consider two different fusion techniques: early and late fusion. W…
▽ More
Deep learning (DL) methods have been shown to improve the performance of several use cases for the fifth-generation (5G) New radio (NR) air interface. In this paper we investigate user equipment (UE) positioning using the channel state information (CSI) fingerprints between a UE and multiple base stations (BSs). In such a setup, we consider two different fusion techniques: early and late fusion. With early fusion, a single DL model can be trained for UE positioning by combining the CSI fingerprints of the multiple BSs as input. With late fusion, a separate DL model is trained at each BS using the CSI specific to that BS and the outputs of these individual models are then combined to determine the UE's position. In this work we compare these different fusion techniques and show that fusing the outputs of separate models achieves higher positioning accuracy, especially in a dynamic scenario. We also show that the combination of multiple outputs further benefits from considering the uncertainty of the output of the DL model at each BS. For a more efficient training of the DL model across BSs, we additionally propose a multi-task learning (MTL) scheme by sharing some parameters across the models while jointly training all models. This method, not only improves the accuracy of the individual models, but also of the final combined estimate. Lastly, we evaluate the reliability of the uncertainty estimation to determine which of the fusion methods provides the highest quality of uncertainty estimates.
△ Less
Submitted 28 August, 2024; v1 submitted 13 March, 2024;
originally announced March 2024.
-
Sounding-Based Evaluation of Multi-Sensor ISAC Networks for Drone Applications: Measurement and Simulation Perspectives
Authors:
Julia Beuster,
Carsten Jan Smeenk,
Saw James Myint,
Reza Faramarzahanagri,
Carsten Andrich,
Sebastian Giehl,
Christian Schneider,
Reiner S. Thomä
Abstract:
With the upcoming multitude of commercial and public applications envisioned in the mobile 6G radio landscape using unmanned aerial vehicles (UAVs), integrated sensing and communication (ISAC) plays a key role to enable the detection and localization of passive objects with radar sensing, while optimizing the utilization of scarce resources. To explore the potential of future ISAC architectures wi…
▽ More
With the upcoming multitude of commercial and public applications envisioned in the mobile 6G radio landscape using unmanned aerial vehicles (UAVs), integrated sensing and communication (ISAC) plays a key role to enable the detection and localization of passive objects with radar sensing, while optimizing the utilization of scarce resources. To explore the potential of future ISAC architectures with UAVs as mobile nodes in distributed multi-sensor networks, the system's fundamental capability to detect static and dynamic objects that reveal themselves by their bi-static back-scattering needs to be evaluated. Therefore, this paper addresses simulation- and measurement based data acquisition methods to gather knowledge about the bistatic reflectivity of single objects including their Micro-Doppler signature for object identification as well as the influence of multipath propagation in different environments on the localization accuracy and radar tracking performance. We show exemplary results from simulation models, bi-static reflectivity measurements in laboratory environment and real-flight channel sounding experiments in selected scenarios showcasing the potential of synthetic and measured data sets for development and evaluation of ISAC algorithms. The presented measurement data sets are publicly available to encourage the academic RF community to validate future algorithms using realistic scenarios alongside simulations models.
△ Less
Submitted 26 February, 2024;
originally announced February 2024.
-
Bistatic Reflectivity and Micro-Doppler Signatures of Drones for Integrated Communication and Sensing
Authors:
Heraldo Cesar Alves Costa,
Saw James Myint,
Carsten Andrich,
Sebastian W. Giehl,
Christian Schneider,
Reiner S. Thomä
Abstract:
The integration of wireless communication and radar sensing is gaining the interest of researchers from wireless communication and radar societies. Sensing in Integrated Communication and Sensing (ICAS) systems differs from the traditional radar system in the configuration of transmitter-target-receiver, the operating frequency bands, and the transmitting waveform. It is necessary to understand ho…
▽ More
The integration of wireless communication and radar sensing is gaining the interest of researchers from wireless communication and radar societies. Sensing in Integrated Communication and Sensing (ICAS) systems differs from the traditional radar system in the configuration of transmitter-target-receiver, the operating frequency bands, and the transmitting waveform. It is necessary to understand how target electromagnetic signatures behave in this context. Therefore, this paper presents measurements and analysis of two important target signatures, reflectivity and micro-Doppler, for sensing in ICAS. These target signatures are measured in the state-of-the-art measurement system, Bistatische-Radar-Messeinrichtung (BiRa).
△ Less
Submitted 8 March, 2024; v1 submitted 25 January, 2024;
originally announced January 2024.
-
Modelling Micro-Doppler Signature of Drone Propellers in Distributed ISAC
Authors:
Heraldo Cesar Alves Costa,
Saw James Myint,
Carsten Andrich,
Sebastian W. Giehl,
Christian Schneider,
Reiner S. Thomä
Abstract:
Integrated Sensing and Communication (ISAC) comprises detection and analysis of non-cooperative targets by exploiting the resources of the mobile radio system. In this context, micro-Doppler is of great importance for target classification, in order to distinguish objects with local movements. For developing algorithms for target classification, it is necessary to have a large amount of target sig…
▽ More
Integrated Sensing and Communication (ISAC) comprises detection and analysis of non-cooperative targets by exploiting the resources of the mobile radio system. In this context, micro-Doppler is of great importance for target classification, in order to distinguish objects with local movements. For developing algorithms for target classification, it is necessary to have a large amount of target signatures. Aiming to generate these data, this paper proposes a mathematical model for the micro-Doppler of drone rotating propellers, and validate the proposed model by comparing it to measured micro-Doppler. Results show that the proposed mathematical model can generate micro-Doppler data very similar to those from measurement data.
△ Less
Submitted 13 February, 2024; v1 submitted 25 January, 2024;
originally announced January 2024.
-
Heterogeneous Graph-based Trajectory Prediction using Local Map Context and Social Interactions
Authors:
Daniel Grimm,
Maximilian Zipfl,
Felix Hertlein,
Alexander Naumann,
Jürgen Lüttin,
Steffen Thoma,
Stefan Schmid,
Lavdim Halilaj,
Achim Rettinger,
J. Marius Zöllner
Abstract:
Precisely predicting the future trajectories of surrounding traffic participants is a crucial but challenging problem in autonomous driving, due to complex interactions between traffic agents, map context and traffic rules. Vector-based approaches have recently shown to achieve among the best performances on trajectory prediction benchmarks. These methods model simple interactions between traffic…
▽ More
Precisely predicting the future trajectories of surrounding traffic participants is a crucial but challenging problem in autonomous driving, due to complex interactions between traffic agents, map context and traffic rules. Vector-based approaches have recently shown to achieve among the best performances on trajectory prediction benchmarks. These methods model simple interactions between traffic agents but don't distinguish between relation-type and attributes like their distance along the road. Furthermore, they represent lanes only by sequences of vectors representing center lines and ignore context information like lane dividers and other road elements. We present a novel approach for vector-based trajectory prediction that addresses these shortcomings by leveraging three crucial sources of information: First, we model interactions between traffic agents by a semantic scene graph, that accounts for the nature and important features of their relation. Second, we extract agent-centric image-based map features to model the local map context. Finally, we generate anchor paths to enforce the policy in multi-modal prediction to permitted trajectories only. Each of these three enhancements shows advantages over the baseline model HoliGraph.
△ Less
Submitted 30 November, 2023;
originally announced November 2023.
-
XTSC-Bench: Quantitative Benchmarking for Explainers on Time Series Classification
Authors:
Jacqueline Höllig,
Steffen Thoma,
Florian Grimm
Abstract:
Despite the growing body of work on explainable machine learning in time series classification (TSC), it remains unclear how to evaluate different explainability methods. Resorting to qualitative assessment and user studies to evaluate explainers for TSC is difficult since humans have difficulties understanding the underlying information contained in time series data. Therefore, a systematic revie…
▽ More
Despite the growing body of work on explainable machine learning in time series classification (TSC), it remains unclear how to evaluate different explainability methods. Resorting to qualitative assessment and user studies to evaluate explainers for TSC is difficult since humans have difficulties understanding the underlying information contained in time series data. Therefore, a systematic review and quantitative comparison of explanation methods to confirm their correctness becomes crucial. While steps to standardized evaluations were taken for tabular, image, and textual data, benchmarking explainability methods on time series is challenging due to a) traditional metrics not being directly applicable, b) implementation and adaption of traditional metrics for time series in the literature vary, and c) varying baseline implementations. This paper proposes XTSC-Bench, a benchmarking tool providing standardized datasets, models, and metrics for evaluating explanation methods on TSC. We analyze 3 perturbation-, 6 gradient- and 2 example-based explanation methods to TSC showing that improvements in the explainers' robustness and reliability are necessary, especially for multivariate data.
△ Less
Submitted 23 October, 2023;
originally announced October 2023.
-
Literature Review: Computer Vision Applications in Transportation Logistics and Warehousing
Authors:
Alexander Naumann,
Felix Hertlein,
Laura Dörr,
Steffen Thoma,
Kai Furmans
Abstract:
Computer vision applications in transportation logistics and warehousing have a huge potential for process automation. We present a structured literature review on research in the field to help leverage this potential. The literature is categorized w.r.t. the application, i.e. the task it tackles and w.r.t. the computer vision techniques that are used. Regarding applications, we subdivide the lite…
▽ More
Computer vision applications in transportation logistics and warehousing have a huge potential for process automation. We present a structured literature review on research in the field to help leverage this potential. The literature is categorized w.r.t. the application, i.e. the task it tackles and w.r.t. the computer vision techniques that are used. Regarding applications, we subdivide the literature in two areas: Monitoring, i.e. observing and retrieving relevant information from the environment, and manipulation, where approaches are used to analyze and interact with the environment. Additionally, we point out directions for future research and link to recent developments in computer vision that are suitable for application in logistics. Finally, we present an overview of existing datasets and industrial solutions. The results of our analysis are also available online at https://a-nau.github.io/cv-in-logistics.
△ Less
Submitted 7 June, 2023; v1 submitted 12 April, 2023;
originally announced April 2023.
-
Relation-based Motion Prediction using Traffic Scene Graphs
Authors:
Maximilian Zipfl,
Felix Hertlein,
Achim Rettinger,
Steffen Thoma,
Lavdim Halilaj,
Juergen Luettin,
Stefan Schmid,
Cory Henson
Abstract:
Representing relevant information of a traffic scene and understanding its environment is crucial for the success of autonomous driving. Modeling the surrounding of an autonomous car using semantic relations, i.e., how different traffic participants relate in the context of traffic rule based behaviors, is hardly been considered in previous work. This stems from the fact that these relations are h…
▽ More
Representing relevant information of a traffic scene and understanding its environment is crucial for the success of autonomous driving. Modeling the surrounding of an autonomous car using semantic relations, i.e., how different traffic participants relate in the context of traffic rule based behaviors, is hardly been considered in previous work. This stems from the fact that these relations are hard to extract from real-world traffic scenes. In this work, we model traffic scenes in a form of spatial semantic scene graphs for various different predictions about the traffic participants, e.g., acceleration and deceleration. Our learning and inference approach uses Graph Neural Networks (GNNs) and shows that incorporating explicit information about the spatial semantic relations between traffic participants improves the predicdtion results. Specifically, the acceleration prediction of traffic participants is improved by up to 12% compared to the baselines, which do not exploit this explicit information. Furthermore, by including additional information about previous scenes, we achieve 73% improvements.
△ Less
Submitted 24 November, 2022;
originally announced December 2022.
-
Multi-Environment based Meta-Learning with CSI Fingerprints for Radio Based Positioning
Authors:
Anastasios Foliadis,
Mario H. Castañeda Garcia,
Richard A. Stirling-Gallacher,
Reiner S. Thomä
Abstract:
Radio based positioning of a user equipment (UE) based on deep learning (DL) methods using channel state information (CSI) fingerprints have shown promising results. DL models are able to capture complex properties embedded in the CSI about a particular environment and map UE's CSI to the UE's position. However, the CSI fingerprints and the DL models trained on such fingerprints are highly depende…
▽ More
Radio based positioning of a user equipment (UE) based on deep learning (DL) methods using channel state information (CSI) fingerprints have shown promising results. DL models are able to capture complex properties embedded in the CSI about a particular environment and map UE's CSI to the UE's position. However, the CSI fingerprints and the DL models trained on such fingerprints are highly dependent on a particular propagation environment, which generally limits the transfer of knowledge of the DL models from one environment to another. In this paper, we propose a DL model consisting of two parts: the first part aims to learn environment independent features while the second part combines those features depending on the particular environment. To improve transfer learning, we propose a meta learning scheme for training the first part over multiple environments. We show that for positioning in a new environment, initializing a DL model with the meta learned environment independent function achieves higher UE positioning accuracy compared to regular transfer learning from one environment to the new environment, or compared to training the DL model from scratch with only fingerprints from the new environment. Our proposed scheme is able to create an environment independent function which can embed knowledge from multiple environments and more effectively learn from a new environment.
△ Less
Submitted 26 October, 2022;
originally announced October 2022.
-
Characterization of Multi-Link Propagation and Bistatic Target Reflectivity for Distributed Multi-Sensor ISAC
Authors:
Reiner S. Thomä,
Carsten Andrich,
Julia Beuster,
Heraldo Cesar Alves Costa,
Sebastian Giehl,
Saw James Myint,
Christian Schneider,
Gerd Sommerkorn
Abstract:
Integrated sensing and communication (ISAC) qualifies mobile radio systems for detecting and localizing of passive objects by means of radar sensing. Advanced ISAC networks rely on meshed mobile radio access nodes (infrastructure and/or user equipment, resp.) establishing a distributed, multistatic MIMO radar system in which each target reveals itself by its bistatic backscattering. Therefore, cha…
▽ More
Integrated sensing and communication (ISAC) qualifies mobile radio systems for detecting and localizing of passive objects by means of radar sensing. Advanced ISAC networks rely on meshed mobile radio access nodes (infrastructure and/or user equipment, resp.) establishing a distributed, multistatic MIMO radar system in which each target reveals itself by its bistatic backscattering. Therefore, characterization of the bistatic reflectivity of targets along their trajectories of movement is of highest importance for ISAC performance prediction. We summarize several challenges in bistatic modeling and measurement of extended, potentially time-variant radar targets. We emphasize the specific challenges arising for distributed (hence multi-link) ISAC networks and compare to the state of the art in propagation modeling for mobile communication.
△ Less
Submitted 15 May, 2023; v1 submitted 21 October, 2022;
originally announced October 2022.
-
TSInterpret: A unified framework for time series interpretability
Authors:
Jacqueline Höllig,
Cedric Kulbach,
Steffen Thoma
Abstract:
With the increasing application of deep learning algorithms to time series classification, especially in high-stake scenarios, the relevance of interpreting those algorithms becomes key. Although research in time series interpretability has grown, accessibility for practitioners is still an obstacle. Interpretability approaches and their visualizations are diverse in use without a unified API or f…
▽ More
With the increasing application of deep learning algorithms to time series classification, especially in high-stake scenarios, the relevance of interpreting those algorithms becomes key. Although research in time series interpretability has grown, accessibility for practitioners is still an obstacle. Interpretability approaches and their visualizations are diverse in use without a unified API or framework. To close this gap, we introduce TSInterpret an easily extensible open-source Python library for interpreting predictions of time series classifiers that combines existing interpretation approaches into one unified framework. The library features (i) state-of-the-art interpretability algorithms, (ii) exposes a unified API enabling users to work with explanations consistently and provides (iii) suitable visualizations for each explanation.
△ Less
Submitted 15 August, 2022; v1 submitted 10 August, 2022;
originally announced August 2022.
-
Designing Tractable Piecewise Affine Policies for Multi-Stage Adjustable Robust Optimization
Authors:
Simon Thomä,
Grit Walther,
Maximilian Schiffer
Abstract:
We study piecewise affine policies for multi-stage adjustable robust optimization (ARO) problems with non-negative right-hand side uncertainty. First, we construct new dominating uncertainty sets and show how a multi-stage ARO problem can be solved efficiently with a linear program when uncertainty is replaced by these new sets. We then demonstrate how solutions for this alternative problem can be…
▽ More
We study piecewise affine policies for multi-stage adjustable robust optimization (ARO) problems with non-negative right-hand side uncertainty. First, we construct new dominating uncertainty sets and show how a multi-stage ARO problem can be solved efficiently with a linear program when uncertainty is replaced by these new sets. We then demonstrate how solutions for this alternative problem can be transformed into solutions for the original problem. By carefully choosing the dominating sets, we prove strong approximation bounds for our policies and extend many previously best-known bounds for the two-staged problem variant to its multi-stage counterpart. Moreover, the new bounds are - to the best of our knowledge - the first bounds shown for the general multi-stage ARO problem considered. We extensively compare our policies to other policies from the literature and prove relative performance guarantees. In two numerical experiments, we identify beneficial and disadvantageous properties for different policies and present effective adjustments to tackle the most critical disadvantages of our policies. Overall, the experiments show that our piecewise affine policies can be computed by orders of magnitude faster than affine policies, while often yielding comparable or even better results.
△ Less
Submitted 15 December, 2023; v1 submitted 1 July, 2022;
originally announced July 2022.
-
Reliable Deep Learning based Localization with CSI Fingerprints and Multiple Base Stations
Authors:
Anastasios Foliadis,
Mario H. Castañeda Garcia,
Richard A. Stirling-Gallacher,
Reiner S. Thomä
Abstract:
Deep learning (DL) methods have been recently proposed for user equipment (UE) localization in wireless communication networks, based on the channel state information (CSI) between a UE and each base station (BS) in the uplink. With the CSI from the available BSs, UE localization can be performed in different ways. One the one hand, a single neural network (NN) can be trained for the UE localizati…
▽ More
Deep learning (DL) methods have been recently proposed for user equipment (UE) localization in wireless communication networks, based on the channel state information (CSI) between a UE and each base station (BS) in the uplink. With the CSI from the available BSs, UE localization can be performed in different ways. One the one hand, a single neural network (NN) can be trained for the UE localization by considering the CSI from all the available BSs as one overall fingerprint of the user's location. On the other hand, the CSI at each BS can be used to obtain an estimate of the UE's position with a separate NN at each BS, and then the position estimates of all BSs are combined to obtain an overall estimate of the UE position. In this work, we show that UE localization with the latter approach can achieve a higher positioning accuracy. We propose to consider the uncertainty in the UE localization at each BS, such that overall UE's position is determined by combining the position estimates of the different BSs based on the uncertainty at each BS. With this approach, a more reliable position estimate can be obtained in case of variations in the channel.
△ Less
Submitted 23 November, 2021;
originally announced November 2021.
-
CSI-Based Localization with CNNs Exploiting Phase Information
Authors:
Anastasios Foliadis,
Mario H. Castañeda Garcia,
Richard A. Stirling-Gallacher,
Reiner S. Thomä
Abstract:
In this paper we study the use of the Channel State Information (CSI) as fingerprint inputs of a Convolutional Neural Network (CNN) for localization. We examine whether the CSI can be used as a distinct fingerprint corresponding to a single position by considering the inconsistencies with its raw phase that cause the CSI to be unreliable. We propose two methods to produce reliable fingerprints inc…
▽ More
In this paper we study the use of the Channel State Information (CSI) as fingerprint inputs of a Convolutional Neural Network (CNN) for localization. We examine whether the CSI can be used as a distinct fingerprint corresponding to a single position by considering the inconsistencies with its raw phase that cause the CSI to be unreliable. We propose two methods to produce reliable fingerprints including the phase information. Furthermore, we examine the structure of the CNN and more specifically the impact of pooling on the positioning performance, and show that pooling over the subcarriers can be more beneficial than over the antennas.
△ Less
Submitted 22 January, 2021;
originally announced January 2021.
-
Channel Correlation Diversity in MU-MIMO Systems -- Analysis and Measurements
Authors:
Harsh Tataria,
Seun Sangodoyin,
Andreas F. Molisch,
Peter J. Smith,
Michail Matthaiou,
Jianzhong Zhang,
Reiner S. Thomä
Abstract:
In multiuser multiple-input multiple-output (MU-MIMO) systems, channel correlation is detrimental to system performance. We demonstrate that widely used, yet overly simplified, correlation models that generate identical correlation profiles for each terminal tend to severely underestimate the system performance. In sharp contrast, more physically motivated models that capture variations in the pow…
▽ More
In multiuser multiple-input multiple-output (MU-MIMO) systems, channel correlation is detrimental to system performance. We demonstrate that widely used, yet overly simplified, correlation models that generate identical correlation profiles for each terminal tend to severely underestimate the system performance. In sharp contrast, more physically motivated models that capture variations in the power angular spectra across multiple terminals, generate diverse correlation patterns. This has a significant impact on the system performance. Assuming correlated Rayleigh fading and downlink zero-forcing precoding, tight closed-form approximations for the average signal-to-noise-ratio, and ergodic sum spectral efficiency are derived. Our expressions provide clear insights into the impact of diverse correlation patterns on the above performance metrics. Unlike previous works, the correlation models are parameterized with measured data from a recent 2.53 GHz urban macrocellular campaign in Cologne, Germany. Overall, results from this paper can be treated as a timely re-calibration of performance expectations from practical MU-MIMO systems.
△ Less
Submitted 1 July, 2019; v1 submitted 16 April, 2019;
originally announced April 2019.
-
Lower Bound on the Sum-rate of Decremental Beam Selection Algorithm for Beamspace MIMO Systems
Authors:
Naveed Iqbal,
Waqas Ahmad,
Christian Schneider,
Reiner S. Thomä
Abstract:
In general, the zero-forcing (ZF) precoding suffers from a severe receive signal-to-noise ratio (SNR) degradation in the high interference regime. However, recent evidences from realistic measurements demonstrated that millimeter wave (mmWave) systems are mainly noise-limited as high gain antennas behave as spatial filters to the interference signal. This makes ZF precoding equally attractive as t…
▽ More
In general, the zero-forcing (ZF) precoding suffers from a severe receive signal-to-noise ratio (SNR) degradation in the high interference regime. However, recent evidences from realistic measurements demonstrated that millimeter wave (mmWave) systems are mainly noise-limited as high gain antennas behave as spatial filters to the interference signal. This makes ZF precoding equally attractive as that of other linear precoding counterparts. Considering ZF precoding, this paper aims to derive a lower bound on the sum-rate achieved by a decremental beam selection (BS) algorithm in a beamspace MIMO (B-MIMO) system operating at mmWave frequencies. This bound relates Frobenious norms of precoding matrices of full and reduced dimensional (i.e. after BS) B-MIMO systems through a deterministic square-hyperbolic function. Note that, both ZF precoding and decremental BS are not new concepts. However, the derived sum-rate bound provides a new insight to the topic. Given a particular full dimensional B-MIMO channel, the presented bound can be used to understand limits of BS algorithms.
△ Less
Submitted 30 January, 2019;
originally announced January 2019.
-
Cooperative Passive Coherent Location: A Promising 5G Service to Support Road Safety
Authors:
Reiner S. Thomä,
Carsten Andrich,
Giovanni Del Galdo,
Michael Döbereiner,
Matthias A. Hein,
Martin Käske,
Günter Schäfer,
Steffen Schieler,
Christian Schneider,
Andreas Schwind,
Philip Wendland
Abstract:
5G promises many new vertical service areas beyond simple communication and data transfer. We propose CPCL (cooperative passive coherent location), a distributed MIMO radar service, which can be offered by mobile radio network operators as a service for public user groups. CPCL comes as an inherent part of the radio network and takes advantage of the most important key features proposed for 5G. It…
▽ More
5G promises many new vertical service areas beyond simple communication and data transfer. We propose CPCL (cooperative passive coherent location), a distributed MIMO radar service, which can be offered by mobile radio network operators as a service for public user groups. CPCL comes as an inherent part of the radio network and takes advantage of the most important key features proposed for 5G. It extends the well-known idea of passive radar (also known as passive coherent location, PCL) by introducing cooperative principles. These range from cooperative, synchronous radio signaling, and MAC up to radar data fusion on sensor and scenario levels. By using software-defined radio and network paradigms, as well as real-time mobile edge computing facilities intended for 5G, CPCL promises to become a ubiquitous radar service which may be adaptive, reconfigurable, and perhaps cognitive. As CPCL makes double use of radio resources (both in terms of frequency bands and hardware), it can be considered a green technology. Although we introduce the CPCL idea from the viewpoint of vehicle-to-vehicle/infrastructure (V2X) communication, it can definitely also be applied to many other applications in industry, transport, logistics, and for safety and security applications.
△ Less
Submitted 1 October, 2019; v1 submitted 12 February, 2018;
originally announced February 2018.
-
Knowledge Fusion via Embeddings from Text, Knowledge Graphs, and Images
Authors:
Steffen Thoma,
Achim Rettinger,
Fabian Both
Abstract:
We present a baseline approach for cross-modal knowledge fusion. Different basic fusion methods are evaluated on existing embedding approaches to show the potential of joining knowledge about certain concepts across modalities in a fused concept representation.
We present a baseline approach for cross-modal knowledge fusion. Different basic fusion methods are evaluated on existing embedding approaches to show the potential of joining knowledge about certain concepts across modalities in a fused concept representation.
△ Less
Submitted 20 April, 2017;
originally announced April 2017.
-
3D MIMO Outdoor-to-Indoor Propagation Channel Measurement
Authors:
Vinod Kristem,
Seun Sangodoyin,
C. U. Bas,
Martin Kaeske,
Juho Lee,
Christian Schneider,
Gerd Sommerkorn,
J. Zhang,
Reiner S. Thomae,
Andreas F. Molisch
Abstract:
3-dimensional Multiple-Input Multiple-Output (3D MIMO) systems have received great interest recently because of the spatial diversity advantage and capability for full-dimensional beamforming, making them promising candidates for practical realization of massive MIMO. In this paper, we present a low-cost test equipment (channel sounder) and post-processing algorithms suitable for investigating 3D…
▽ More
3-dimensional Multiple-Input Multiple-Output (3D MIMO) systems have received great interest recently because of the spatial diversity advantage and capability for full-dimensional beamforming, making them promising candidates for practical realization of massive MIMO. In this paper, we present a low-cost test equipment (channel sounder) and post-processing algorithms suitable for investigating 3D MIMO channels, as well as the results from a measurement campaign for obtaining elevation and azimuth characteristics in an outdoor-to-indoor (O2I) environment. Due to limitations in available antenna switches, our channel sounder consists of a hybrid switched/virtual cylindrical array with effectively 480 antenna elements at the base station (BS). The virtual setup increased the overall MIMO measurement duration, thereby introducing phase drift errors in the measurements. Using a reference antenna measurements, we estimate and correct for the phase errors during post-processing. We provide the elevation and azimuth angular spreads, for the measurements done in an urban macro-cellular (UMa) and urban micro-cellular (UMi) environments, and study their dependence on the UE height.
Based on the measurements done with UE placed on different floors, we study the feasibility of separating users in the elevation domain. The measured channel impulse responses are also used to study the channel hardening aspects of Massive MIMO and the optimality of Maximum Ratio Combining (MRC) receiver.
△ Less
Submitted 30 March, 2017;
originally announced March 2017.
-
Design and Analysis of Compressive Antenna Arrays for Direction of Arrival Estimation
Authors:
Mohamed Ibrahim,
Venkatesh Ramireddy,
Anastasia Lavrenko,
Jonas König,
Florian Römer,
Markus Landmann,
Marcus Grossmann,
Giovanni Del Galdo,
Reiner S. Thomä
Abstract:
In this paper we investigate the design of compressive antenna arrays for direction of arrival (DOA) estimation that aim to provide a larger aperture with a reduced hardware complexity by a linear combination of the antenna outputs to a lower number of receiver channels. We present a basic receiver architecture of such a compressive array and introduce a generic system model that includes differen…
▽ More
In this paper we investigate the design of compressive antenna arrays for direction of arrival (DOA) estimation that aim to provide a larger aperture with a reduced hardware complexity by a linear combination of the antenna outputs to a lower number of receiver channels. We present a basic receiver architecture of such a compressive array and introduce a generic system model that includes different options for the hardware implementation. We then discuss the design of the analog combining network that performs the receiver channel reduction, and propose two design approaches. The first approach is based on the spatial correlation function which is a low-complexity scheme that in certain cases admits a closed-form solution. The second approach is based on minimizing the Cramer-Rao Bound (CRB) with the constraint to limit the probability of false detection of paths to a pre-specified level. Our numerical simulations demonstrate the superiority of the proposed optimized compressive arrays compared to the sparse arrays of the same complexity and to compressive arrays with randomly chosen combining kernels.
△ Less
Submitted 11 November, 2016;
originally announced November 2016.
-
Using Quaternion-Valued Linear Algebra
Authors:
Dominik Schulz,
Reiner S. Thomä
Abstract:
Linear algebra is usually defined over a field such as the reals or complex numbers. It is possible to extend this to skew fields such as the quaternions. However, to the authors' knowledge there is no commonly accepted notation of linear algebra over skew fields. To this end, we discuss ways of notation that account for the non-commutativity of the quaternion multiplication.
Linear algebra is usually defined over a field such as the reals or complex numbers. It is possible to extend this to skew fields such as the quaternions. However, to the authors' knowledge there is no commonly accepted notation of linear algebra over skew fields. To this end, we discuss ways of notation that account for the non-commutativity of the quaternion multiplication.
△ Less
Submitted 20 March, 2014; v1 submitted 29 November, 2013;
originally announced November 2013.
