-
Technical recommendation on multiplex MR elastography for tomographic mapping of abdominal stiffness with a focus on the pancreas and pancreatic ductal adenocarcinoma
Authors:
Jakob Schattenfroh,
Salma Almutawakel,
Jan Bieling,
Johannes Castelein,
Melanie Estrella,
Philippe Garteiser,
Viktor Hartung,
Karl H. Hillebrandt,
Adrian T. Huber,
Laura Körner,
Thomas Kröncke,
Thomas Malinka,
Hans-Jonas Meyer,
Tom Meyer,
Uwe Pelzer,
Felix Pfister,
Igor M. Sauer,
Anna Speth,
Bernard E. Van Beers,
Carsten Warmuth,
Nienke P. M. Wassenaar,
Yanglei Wu,
Rolf Reiter,
Ingolf Sack
Abstract:
Objectives: MR elastography (MRE) offers valuable mechanical tissue characterization, however, in deep abdominal organs like the pancreas conventional single-driver, single-frequency approaches often fail. This study evaluates whether multiplex MRE using multiple drivers and vibration frequencies can overcome these limitations.
Methods: This study used single-shot spin-echo MRE in 18 healthy vol…
▽ More
Objectives: MR elastography (MRE) offers valuable mechanical tissue characterization, however, in deep abdominal organs like the pancreas conventional single-driver, single-frequency approaches often fail. This study evaluates whether multiplex MRE using multiple drivers and vibration frequencies can overcome these limitations.
Methods: This study used single-shot spin-echo MRE in 18 healthy volunteers targeting the liver, pancreas, kidneys, and spleen. Each healthy volunteer underwent 16 MRE examinations with different sets of four vibration frequencies (30-60 Hz) and four driver combinations, and an additional null experiment without vibrations. Further, a cohort of 14 patients with pancreatic ductal adenocarcinoma (PDAC) were retrospectively assessed. The quality of shear-wave fields and stiffness maps was assessed by displacement amplitudes and image sharpness.
Results: In healthy volunteers, abdominal coverage with displacement amplitudes above the pre-determined noise level of 4 μm varied between MRE configurations: 24.2% ([0.0%-56.2%], single-driver, 60 Hz), 66.9% ([24.8%-97.7%], single-driver, 30-60 Hz), 70.2% ([0.0%-92.5%], multi-driver, 60 Hz) and 99.9% ([89.4%-100%], multi-driver, 30-60 Hz). In the pancreas, >60% coverage was achieved in all subjects using four drivers and multiple frequencies. This was achieved in only 2/18 subjects using single-driver/single-frequency MRE. Patients with PDAC had 99.1% [91.4%-100%] coverage in the pancreas and 96.3% [63.1%-100%] abdominal coverage (multi-driver, 30-60 Hz).
Conclusion: MRE with four drivers and multiple vibration frequencies between 30-60 Hz enables tomographic mapping of tissue stiffness across the entire abdomen, including the pancreas. Multiplex MRE offers a promising approach for generating detailed images of abdominal stiffness, potentially enhancing clinical diagnostics for abdominal and pancreatic diseases.
△ Less
Submitted 26 May, 2025;
originally announced May 2025.
-
Detecting Unforeseen Data Properties with Diffusion Autoencoder Embeddings using Spine MRI data
Authors:
Robert Graf,
Florian Hunecke,
Soeren Pohl,
Matan Atad,
Hendrik Moeller,
Sophie Starck,
Thomas Kroencke,
Stefanie Bette,
Fabian Bamberg,
Tobias Pischon,
Thoralf Niendorf,
Carsten Schmidt,
Johannes C. Paetzold,
Daniel Rueckert,
Jan S Kirschke
Abstract:
Deep learning has made significant strides in medical imaging, leveraging the use of large datasets to improve diagnostics and prognostics. However, large datasets often come with inherent errors through subject selection and acquisition. In this paper, we investigate the use of Diffusion Autoencoder (DAE) embeddings for uncovering and understanding data characteristics and biases, including biase…
▽ More
Deep learning has made significant strides in medical imaging, leveraging the use of large datasets to improve diagnostics and prognostics. However, large datasets often come with inherent errors through subject selection and acquisition. In this paper, we investigate the use of Diffusion Autoencoder (DAE) embeddings for uncovering and understanding data characteristics and biases, including biases for protected variables like sex and data abnormalities indicative of unwanted protocol variations. We use sagittal T2-weighted magnetic resonance (MR) images of the neck, chest, and lumbar region from 11186 German National Cohort (NAKO) participants. We compare DAE embeddings with existing generative models like StyleGAN and Variational Autoencoder. Evaluations on a large-scale dataset consisting of sagittal T2-weighted MR images of three spine regions show that DAE embeddings effectively separate protected variables such as sex and age. Furthermore, we used t-SNE visualization to identify unwanted variations in imaging protocols, revealing differences in head positioning. Our embedding can identify samples where a sex predictor will have issues learning the correct sex. Our findings highlight the potential of using advanced embedding techniques like DAEs to detect data quality issues and biases in medical imaging datasets. Identifying such hidden relations can enhance the reliability and fairness of deep learning models in healthcare applications, ultimately improving patient care and outcomes.
△ Less
Submitted 14 October, 2024;
originally announced October 2024.
-
MRSegmentator: Multi-Modality Segmentation of 40 Classes in MRI and CT
Authors:
Hartmut Häntze,
Lina Xu,
Christian J. Mertens,
Felix J. Dorfner,
Leonhard Donle,
Felix Busch,
Avan Kader,
Sebastian Ziegelmayer,
Nadine Bayerl,
Nassir Navab,
Daniel Rueckert,
Julia Schnabel,
Hugo JWL Aerts,
Daniel Truhn,
Fabian Bamberg,
Jakob Weiß,
Christopher L. Schlett,
Steffen Ringhof,
Thoralf Niendorf,
Tobias Pischon,
Hans-Ulrich Kauczor,
Tobias Nonnenmacher,
Thomas Kröncke,
Henry Völzke,
Jeanette Schulz-Menger
, et al. (7 additional authors not shown)
Abstract:
Purpose: To develop and evaluate a deep learning model for multi-organ segmentation of MRI scans.
Materials and Methods: The model was trained on 1,200 manually annotated 3D axial MRI scans from the UK Biobank, 221 in-house MRI scans, and 1228 CT scans from the TotalSegmentator dataset. A human-in-the-loop annotation workflow was employed, leveraging cross-modality transfer learning from an exis…
▽ More
Purpose: To develop and evaluate a deep learning model for multi-organ segmentation of MRI scans.
Materials and Methods: The model was trained on 1,200 manually annotated 3D axial MRI scans from the UK Biobank, 221 in-house MRI scans, and 1228 CT scans from the TotalSegmentator dataset. A human-in-the-loop annotation workflow was employed, leveraging cross-modality transfer learning from an existing CT segmentation model to segment 40 anatomical structures. The annotation process began with a model based on transfer learning between CT and MR, which was iteratively refined based on manual corrections to predicted segmentations. The model's performance was evaluated on MRI examinations obtained from the German National Cohort (NAKO) study (n=900) from the AMOS22 dataset (n=60) and from the TotalSegmentator-MRI test data (n=29). The Dice Similarity Coefficient (DSC) and Hausdorff Distance (HD) were used to assess segmentation quality, stratified by organ and scan type. The model and its weights will be open-sourced.
Results: MRSegmentator demonstrated high accuracy for well-defined organs (lungs: DSC 0.96, heart: DSC 0.94) and organs with anatomic variability (liver: DSC 0.96, kidneys: DSC 0.95). Smaller structures showed lower accuracy (portal/splenic veins: DSC 0.64, adrenal glands: DSC 0.69). On external validation using NAKO data, mean DSC ranged from 0.85 $\pm$ 0.08 for T2-HASTE to 0.91 $\pm$ 0.05 for in-phase sequences. The model generalized well to CT, achieving mean DSC of 0.84 $\pm$ 0.11 on AMOS CT data.
Conclusion: MRSegmentator accurately segments 40 anatomical structures in MRI across diverse datasets and imaging protocols, with additional generalizability to CT images. This open-source model will provide a valuable tool for automated multi-organ segmentation in medical imaging research. It can be downloaded from https://github.com/hhaentze/MRSegmentator.
△ Less
Submitted 14 November, 2024; v1 submitted 10 May, 2024;
originally announced May 2024.
-
SPINEPS -- Automatic Whole Spine Segmentation of T2-weighted MR images using a Two-Phase Approach to Multi-class Semantic and Instance Segmentation
Authors:
Hendrik Möller,
Robert Graf,
Joachim Schmitt,
Benjamin Keinert,
Matan Atad,
Anjany Sekuboyina,
Felix Streckenbach,
Hanna Schön,
Florian Kofler,
Thomas Kroencke,
Stefanie Bette,
Stefan Willich,
Thomas Keil,
Thoralf Niendorf,
Tobias Pischon,
Beate Endemann,
Bjoern Menze,
Daniel Rueckert,
Jan S. Kirschke
Abstract:
Purpose. To present SPINEPS, an open-source deep learning approach for semantic and instance segmentation of 14 spinal structures (ten vertebra substructures, intervertebral discs, spinal cord, spinal canal, and sacrum) in whole body T2w MRI.
Methods. During this HIPPA-compliant, retrospective study, we utilized the public SPIDER dataset (218 subjects, 63% female) and a subset of the German Nati…
▽ More
Purpose. To present SPINEPS, an open-source deep learning approach for semantic and instance segmentation of 14 spinal structures (ten vertebra substructures, intervertebral discs, spinal cord, spinal canal, and sacrum) in whole body T2w MRI.
Methods. During this HIPPA-compliant, retrospective study, we utilized the public SPIDER dataset (218 subjects, 63% female) and a subset of the German National Cohort (1423 subjects, mean age 53, 49% female) for training and evaluation. We combined CT and T2w segmentations to train models that segment 14 spinal structures in T2w sagittal scans both semantically and instance-wise. Performance evaluation metrics included Dice similarity coefficient, average symmetrical surface distance, panoptic quality, segmentation quality, and recognition quality. Statistical significance was assessed using the Wilcoxon signed-rank test. An in-house dataset was used to qualitatively evaluate out-of-distribution samples.
Results. On the public dataset, our approach outperformed the baseline (instance-wise vertebra dice score 0.929 vs. 0.907, p-value<0.001). Training on auto-generated annotations and evaluating on manually corrected test data from the GNC yielded global dice scores of 0.900 for vertebrae, 0.960 for intervertebral discs, and 0.947 for the spinal canal. Incorporating the SPIDER dataset during training increased these scores to 0.920, 0.967, 0.958, respectively.
Conclusions. The proposed segmentation approach offers robust segmentation of 14 spinal structures in T2w sagittal images, including the spinal cord, spinal canal, intervertebral discs, endplate, sacrum, and vertebrae. The approach yields both a semantic and instance mask as output, thus being easy to utilize. This marks the first publicly available algorithm for whole spine segmentation in sagittal T2w MR imaging.
△ Less
Submitted 22 April, 2024; v1 submitted 26 February, 2024;
originally announced February 2024.
-
An Uncertainty-Aware, Shareable and Transparent Neural Network Architecture for Brain-Age Modeling
Authors:
Tim Hahn,
Jan Ernsting,
Nils R. Winter,
Vincent Holstein,
Ramona Leenings,
Marie Beisemann,
Lukas Fisch,
Kelvin Sarink,
Daniel Emden,
Nils Opel,
Ronny Redlich,
Jonathan Repple,
Dominik Grotegerd,
Susanne Meinert,
Jochen G. Hirsch,
Thoralf Niendorf,
Beate Endemann,
Fabian Bamberg,
Thomas Kröncke,
Robin Bülow,
Henry Völzke,
Oyunbileg von Stackelberg,
Ramona Felizitas Sowade,
Lale Umutlu,
Börge Schmidt
, et al. (9 additional authors not shown)
Abstract:
The deviation between chronological age and age predicted from neuroimaging data has been identified as a sensitive risk-marker of cross-disorder brain changes, growing into a cornerstone of biological age-research. However, Machine Learning models underlying the field do not consider uncertainty, thereby confounding results with training data density and variability. Also, existing models are com…
▽ More
The deviation between chronological age and age predicted from neuroimaging data has been identified as a sensitive risk-marker of cross-disorder brain changes, growing into a cornerstone of biological age-research. However, Machine Learning models underlying the field do not consider uncertainty, thereby confounding results with training data density and variability. Also, existing models are commonly based on homogeneous training sets, often not independently validated, and cannot be shared due to data protection issues. Here, we introduce an uncertainty-aware, shareable, and transparent Monte-Carlo Dropout Composite-Quantile-Regression (MCCQR) Neural Network trained on N=10,691 datasets from the German National Cohort. The MCCQR model provides robust, distribution-free uncertainty quantification in high-dimensional neuroimaging data, achieving lower error rates compared to existing models across ten recruitment centers and in three independent validation samples (N=4,004). In two examples, we demonstrate that it prevents spurious associations and increases power to detect accelerated brain-aging. We make the pre-trained model publicly available.
△ Less
Submitted 16 July, 2021;
originally announced July 2021.
-
Predicting brain-age from raw T 1 -weighted Magnetic Resonance Imaging data using 3D Convolutional Neural Networks
Authors:
Lukas Fisch,
Jan Ernsting,
Nils R. Winter,
Vincent Holstein,
Ramona Leenings,
Marie Beisemann,
Kelvin Sarink,
Daniel Emden,
Nils Opel,
Ronny Redlich,
Jonathan Repple,
Dominik Grotegerd,
Susanne Meinert,
Niklas Wulms,
Heike Minnerup,
Jochen G. Hirsch,
Thoralf Niendorf,
Beate Endemann,
Fabian Bamberg,
Thomas Kröncke,
Annette Peters,
Robin Bülow,
Henry Völzke,
Oyunbileg von Stackelberg,
Ramona Felizitas Sowade
, et al. (11 additional authors not shown)
Abstract:
Age prediction based on Magnetic Resonance Imaging (MRI) data of the brain is a biomarker to quantify the progress of brain diseases and aging. Current approaches rely on preparing the data with multiple preprocessing steps, such as registering voxels to a standardized brain atlas, which yields a significant computational overhead, hampers widespread usage and results in the predicted brain-age to…
▽ More
Age prediction based on Magnetic Resonance Imaging (MRI) data of the brain is a biomarker to quantify the progress of brain diseases and aging. Current approaches rely on preparing the data with multiple preprocessing steps, such as registering voxels to a standardized brain atlas, which yields a significant computational overhead, hampers widespread usage and results in the predicted brain-age to be sensitive to preprocessing parameters. Here we describe a 3D Convolutional Neural Network (CNN) based on the ResNet architecture being trained on raw, non-registered T$_ 1$-weighted MRI data of N=10,691 samples from the German National Cohort and additionally applied and validated in N=2,173 samples from three independent studies using transfer learning. For comparison, state-of-the-art models using preprocessed neuroimaging data are trained and validated on the same samples. The 3D CNN using raw neuroimaging data predicts age with a mean average deviation of 2.84 years, outperforming the state-of-the-art brain-age models using preprocessed data. Since our approach is invariant to preprocessing software and parameter choices, it enables faster, more robust and more accurate brain-age modeling.
△ Less
Submitted 22 March, 2021;
originally announced March 2021.