-
Mind the Detail: Uncovering Clinically Relevant Image Details in Accelerated MRI with Semantically Diverse Reconstructions
Authors:
Jan Nikolas Morshuis,
Christian Schlarmann,
Thomas Küstner,
Christian F. Baumgartner,
Matthias Hein
Abstract:
In recent years, accelerated MRI reconstruction based on deep learning has led to significant improvements in image quality with impressive results for high acceleration factors. However, from a clinical perspective image quality is only secondary; much more important is that all clinically relevant information is preserved in the reconstruction from heavily undersampled data. In this paper, we sh…
▽ More
In recent years, accelerated MRI reconstruction based on deep learning has led to significant improvements in image quality with impressive results for high acceleration factors. However, from a clinical perspective image quality is only secondary; much more important is that all clinically relevant information is preserved in the reconstruction from heavily undersampled data. In this paper, we show that existing techniques, even when considering resampling for diffusion-based reconstruction, can fail to reconstruct small and rare pathologies, thus leading to potentially wrong diagnosis decisions (false negatives). To uncover the potentially missing clinical information we propose ``Semantically Diverse Reconstructions'' (\SDR), a method which, given an original reconstruction, generates novel reconstructions with enhanced semantic variability while all of them are fully consistent with the measured data. To evaluate \SDR automatically we train an object detector on the fastMRI+ dataset. We show that \SDR significantly reduces the chance of false-negative diagnoses (higher recall) and improves mean average precision compared to the original reconstructions. The code is available on https://github.com/NikolasMorshuis/SDR
△ Less
Submitted 1 July, 2025;
originally announced July 2025.
-
Segmentation-guided MRI reconstruction for meaningfully diverse reconstructions
Authors:
Jan Nikolas Morshuis,
Matthias Hein,
Christian F. Baumgartner
Abstract:
Inverse problems, such as accelerated MRI reconstruction, are ill-posed and an infinite amount of possible and plausible solutions exist. This may not only lead to uncertainty in the reconstructed image but also in downstream tasks such as semantic segmentation. This uncertainty, however, is mostly not analyzed in the literature, even though probabilistic reconstruction models are commonly used. T…
▽ More
Inverse problems, such as accelerated MRI reconstruction, are ill-posed and an infinite amount of possible and plausible solutions exist. This may not only lead to uncertainty in the reconstructed image but also in downstream tasks such as semantic segmentation. This uncertainty, however, is mostly not analyzed in the literature, even though probabilistic reconstruction models are commonly used. These models can be prone to ignore plausible but unlikely solutions like rare pathologies. Building on MRI reconstruction approaches based on diffusion models, we add guidance to the diffusion process during inference, generating two meaningfully diverse reconstructions corresponding to an upper and lower bound segmentation. The reconstruction uncertainty can then be quantified by the difference between these bounds, which we coin the 'uncertainty boundary'. We analyzed the behavior of the upper and lower bound segmentations for a wide range of acceleration factors and found the uncertainty boundary to be both more reliable and more accurate compared to repeated sampling. Code is available at https://github.com/NikolasMorshuis/SGR
△ Less
Submitted 25 July, 2024;
originally announced July 2024.
-
BIRA: A Spherical Bistatic Radar Reflectivity Measurement System
Authors:
Carsten Andrich,
Tobias F. Nowack,
Alexander Ihlow,
Sebastian Giehl,
Maximilian Engelhardt,
Gerd Sommerkorn,
Andreas Schwind,
Willi Hofmann,
Christian Bornkessel,
Matthias A. Hein,
Reiner S. Thomä
Abstract:
The upcoming 6G mobile communication standard will offer a revolutionary new feature: Integrated sensing and communication (ISAC) reuses mobile communication signals to realize multi-static radar for various applications including localization. Consequently, applied ISAC propagation research necessitates to evolve from classical monostatic radar cross section (RCS) measurement of static targets on…
▽ More
The upcoming 6G mobile communication standard will offer a revolutionary new feature: Integrated sensing and communication (ISAC) reuses mobile communication signals to realize multi-static radar for various applications including localization. Consequently, applied ISAC propagation research necessitates to evolve from classical monostatic radar cross section (RCS) measurement of static targets on to bistatic radar reflectivity characterization of dynamic objects. Here, we introduce our Bistatic Radar (BIRA) measurement facility for independent spherical positioning of two probes with sub-millimeter accuracy on a diameter of up to 7 m and with almost continuous frequency coverage from 0.7 up to 260 GHz. Currently, BIRA is the only bistatic measurement facility capable of unrestricted ISAC research: In addition to vector network analysis, it employs advanced wideband transceiver technology with an instantaneous bandwidth of up to 4 GHz. These transceivers grant BIRA the unique capability to characterize dynamic targets in both Doppler and range, while also significantly accelerating measurements on static objects. Additionally, the installation is capable of spherical near-field antenna measurements over these wide frequency ranges.
△ Less
Submitted 30 June, 2025; v1 submitted 18 July, 2024;
originally announced July 2024.
-
PPO-based Dynamic Control of Uncertain Floating Platforms in the Zero-G Environment
Authors:
Mahya Ramezani,
M. Amin Alandihallaj,
Andreas M. Hein
Abstract:
In the field of space exploration, floating platforms play a crucial role in scientific investigations and technological advancements. However, controlling these platforms in zero-gravity environments presents unique challenges, including uncertainties and disturbances. This paper introduces an innovative approach that combines Proximal Policy Optimization (PPO) with Model Predictive Control (MPC)…
▽ More
In the field of space exploration, floating platforms play a crucial role in scientific investigations and technological advancements. However, controlling these platforms in zero-gravity environments presents unique challenges, including uncertainties and disturbances. This paper introduces an innovative approach that combines Proximal Policy Optimization (PPO) with Model Predictive Control (MPC) in the zero-gravity laboratory (Zero-G Lab) at the University of Luxembourg. This approach leverages PPO's reinforcement learning power and MPC's precision to navigate the complex control dynamics of floating platforms. Unlike traditional control methods, this PPO-MPC approach learns from MPC predictions, adapting to unmodeled dynamics and disturbances, resulting in a resilient control framework tailored to the zero-gravity environment. Simulations and experiments in the Zero-G Lab validate this approach, showcasing the adaptability of the PPO agent. This research opens new possibilities for controlling floating platforms in zero-gravity settings, promising advancements in space exploration.
△ Less
Submitted 3 July, 2024;
originally announced July 2024.
-
Adversarial Robustness of MR Image Reconstruction under Realistic Perturbations
Authors:
Jan Nikolas Morshuis,
Sergios Gatidis,
Matthias Hein,
Christian F. Baumgartner
Abstract:
Deep Learning (DL) methods have shown promising results for solving ill-posed inverse problems such as MR image reconstruction from undersampled $k$-space data. However, these approaches currently have no guarantees for reconstruction quality and the reliability of such algorithms is only poorly understood. Adversarial attacks offer a valuable tool to understand possible failure modes and worst ca…
▽ More
Deep Learning (DL) methods have shown promising results for solving ill-posed inverse problems such as MR image reconstruction from undersampled $k$-space data. However, these approaches currently have no guarantees for reconstruction quality and the reliability of such algorithms is only poorly understood. Adversarial attacks offer a valuable tool to understand possible failure modes and worst case performance of DL-based reconstruction algorithms. In this paper we describe adversarial attacks on multi-coil $k$-space measurements and evaluate them on the recently proposed E2E-VarNet and a simpler UNet-based model. In contrast to prior work, the attacks are targeted to specifically alter diagnostically relevant regions. Using two realistic attack models (adversarial $k$-space noise and adversarial rotations) we are able to show that current state-of-the-art DL-based reconstruction algorithms are indeed sensitive to such perturbations to a degree where relevant diagnostic information may be lost. Surprisingly, in our experiments the UNet and the more sophisticated E2E-VarNet were similarly sensitive to such attacks. Our findings add further to the evidence that caution must be exercised as DL-based methods move closer to clinical practice.
△ Less
Submitted 5 August, 2022;
originally announced August 2022.
-
Cooperative Passive Coherent Location: A Promising 5G Service to Support Road Safety
Authors:
Reiner S. Thomä,
Carsten Andrich,
Giovanni Del Galdo,
Michael Döbereiner,
Matthias A. Hein,
Martin Käske,
Günter Schäfer,
Steffen Schieler,
Christian Schneider,
Andreas Schwind,
Philip Wendland
Abstract:
5G promises many new vertical service areas beyond simple communication and data transfer. We propose CPCL (cooperative passive coherent location), a distributed MIMO radar service, which can be offered by mobile radio network operators as a service for public user groups. CPCL comes as an inherent part of the radio network and takes advantage of the most important key features proposed for 5G. It…
▽ More
5G promises many new vertical service areas beyond simple communication and data transfer. We propose CPCL (cooperative passive coherent location), a distributed MIMO radar service, which can be offered by mobile radio network operators as a service for public user groups. CPCL comes as an inherent part of the radio network and takes advantage of the most important key features proposed for 5G. It extends the well-known idea of passive radar (also known as passive coherent location, PCL) by introducing cooperative principles. These range from cooperative, synchronous radio signaling, and MAC up to radar data fusion on sensor and scenario levels. By using software-defined radio and network paradigms, as well as real-time mobile edge computing facilities intended for 5G, CPCL promises to become a ubiquitous radar service which may be adaptive, reconfigurable, and perhaps cognitive. As CPCL makes double use of radio resources (both in terms of frequency bands and hardware), it can be considered a green technology. Although we introduce the CPCL idea from the viewpoint of vehicle-to-vehicle/infrastructure (V2X) communication, it can definitely also be applied to many other applications in industry, transport, logistics, and for safety and security applications.
△ Less
Submitted 1 October, 2019; v1 submitted 12 February, 2018;
originally announced February 2018.
