-
MedLoRD: A Medical Low-Resource Diffusion Model for High-Resolution 3D CT Image Synthesis
Authors:
Marvin Seyfarth,
Salman Ul Hassan Dar,
Isabelle Ayx,
Matthias Alexander Fink,
Stefan O. Schoenberg,
Hans-Ulrich Kauczor,
Sandy Engelhardt
Abstract:
Advancements in AI for medical imaging offer significant potential. However, their applications are constrained by the limited availability of data and the reluctance of medical centers to share it due to patient privacy concerns. Generative models present a promising solution by creating synthetic data as a substitute for real patient data. However, medical images are typically high-dimensional,…
▽ More
Advancements in AI for medical imaging offer significant potential. However, their applications are constrained by the limited availability of data and the reluctance of medical centers to share it due to patient privacy concerns. Generative models present a promising solution by creating synthetic data as a substitute for real patient data. However, medical images are typically high-dimensional, and current state-of-the-art methods are often impractical for computational resource-constrained healthcare environments. These models rely on data sub-sampling, raising doubts about their feasibility and real-world applicability. Furthermore, many of these models are evaluated on quantitative metrics that alone can be misleading in assessing the image quality and clinical meaningfulness of the generated images. To address this, we introduce MedLoRD, a generative diffusion model designed for computational resource-constrained environments. MedLoRD is capable of generating high-dimensional medical volumes with resolutions up to 512$\times$512$\times$256, utilizing GPUs with only 24GB VRAM, which are commonly found in standard desktop workstations. MedLoRD is evaluated across multiple modalities, including Coronary Computed Tomography Angiography and Lung Computed Tomography datasets. Extensive evaluations through radiological evaluation, relative regional volume analysis, adherence to conditional masks, and downstream tasks show that MedLoRD generates high-fidelity images closely adhering to segmentation mask conditions, surpassing the capabilities of current state-of-the-art generative models for medical image synthesis in computational resource-constrained environments.
△ Less
Submitted 17 March, 2025;
originally announced March 2025.
-
MRSegmentator: Multi-Modality Segmentation of 40 Classes in MRI and CT
Authors:
Hartmut Häntze,
Lina Xu,
Christian J. Mertens,
Felix J. Dorfner,
Leonhard Donle,
Felix Busch,
Avan Kader,
Sebastian Ziegelmayer,
Nadine Bayerl,
Nassir Navab,
Daniel Rueckert,
Julia Schnabel,
Hugo JWL Aerts,
Daniel Truhn,
Fabian Bamberg,
Jakob Weiß,
Christopher L. Schlett,
Steffen Ringhof,
Thoralf Niendorf,
Tobias Pischon,
Hans-Ulrich Kauczor,
Tobias Nonnenmacher,
Thomas Kröncke,
Henry Völzke,
Jeanette Schulz-Menger
, et al. (7 additional authors not shown)
Abstract:
Purpose: To develop and evaluate a deep learning model for multi-organ segmentation of MRI scans.
Materials and Methods: The model was trained on 1,200 manually annotated 3D axial MRI scans from the UK Biobank, 221 in-house MRI scans, and 1228 CT scans from the TotalSegmentator dataset. A human-in-the-loop annotation workflow was employed, leveraging cross-modality transfer learning from an exis…
▽ More
Purpose: To develop and evaluate a deep learning model for multi-organ segmentation of MRI scans.
Materials and Methods: The model was trained on 1,200 manually annotated 3D axial MRI scans from the UK Biobank, 221 in-house MRI scans, and 1228 CT scans from the TotalSegmentator dataset. A human-in-the-loop annotation workflow was employed, leveraging cross-modality transfer learning from an existing CT segmentation model to segment 40 anatomical structures. The annotation process began with a model based on transfer learning between CT and MR, which was iteratively refined based on manual corrections to predicted segmentations. The model's performance was evaluated on MRI examinations obtained from the German National Cohort (NAKO) study (n=900) from the AMOS22 dataset (n=60) and from the TotalSegmentator-MRI test data (n=29). The Dice Similarity Coefficient (DSC) and Hausdorff Distance (HD) were used to assess segmentation quality, stratified by organ and scan type. The model and its weights will be open-sourced.
Results: MRSegmentator demonstrated high accuracy for well-defined organs (lungs: DSC 0.96, heart: DSC 0.94) and organs with anatomic variability (liver: DSC 0.96, kidneys: DSC 0.95). Smaller structures showed lower accuracy (portal/splenic veins: DSC 0.64, adrenal glands: DSC 0.69). On external validation using NAKO data, mean DSC ranged from 0.85 $\pm$ 0.08 for T2-HASTE to 0.91 $\pm$ 0.05 for in-phase sequences. The model generalized well to CT, achieving mean DSC of 0.84 $\pm$ 0.11 on AMOS CT data.
Conclusion: MRSegmentator accurately segments 40 anatomical structures in MRI across diverse datasets and imaging protocols, with additional generalizability to CT images. This open-source model will provide a valuable tool for automated multi-organ segmentation in medical imaging research. It can be downloaded from https://github.com/hhaentze/MRSegmentator.
△ Less
Submitted 14 November, 2024; v1 submitted 10 May, 2024;
originally announced May 2024.
-
Diffusion-weighted MRI-guided needle biopsies permit quantitative tumor heterogeneity assessment and cell load estimation
Authors:
Yi Yin,
Kai Breuhahn,
Hans-Ulrich Kauczor,
Oliver Sedlaczek,
Irene E. Vignon-Clementel,
Dirk Drasdo
Abstract:
Quantitative information on tumor heterogeneity and cell load could assist in designing effective and refined personalized treatment strategies. It was recently shown by us that such information can be inferred from the diffusion parameter D derived from the diffusion-weighted MRI (DWI) if a relation between D and cell density can be established. However, such relation cannot a priori be assumed t…
▽ More
Quantitative information on tumor heterogeneity and cell load could assist in designing effective and refined personalized treatment strategies. It was recently shown by us that such information can be inferred from the diffusion parameter D derived from the diffusion-weighted MRI (DWI) if a relation between D and cell density can be established. However, such relation cannot a priori be assumed to be constant for all patients and tumor types. Hence to assist in clinical decisions in palliative settings, the relation needs to be established without tumor resection. It is here demonstrated that biopsies may contain sufficient information for this purpose if the localization of biopsies is chosen as systematically elaborated in this paper. A superpixel-based method for automated optimal localization of biopsies from the DWI D-map is proposed. The performance of the DWI-guided procedure is evaluated by extensive simulations of biopsies. Needle biopsies yield sufficient histological information to establish a quantitative relationship between D-value and cell density, provided they are taken from regions with high, intermediate, and low D-value in DWI. The automated localization of the biopsy regions is demonstrated from a NSCLC patient tumor. In this case, even two or three biopsies give a reasonable estimate. Simulations of needle biopsies under different conditions indicate that the DWI-guidance highly improves the estimation results. Tumor cellularity and heterogeneity in solid tumors may be reliably investigated from DWI and a few needle biopsies that are sampled in regions of well-separated D-values, excluding adipose tissue. This procedure could provide a way of embedding in the clinical workflow assistance in cancer diagnosis and treatment based on personalized information.
△ Less
Submitted 28 February, 2021;
originally announced March 2021.
-
Prediction of low-keV monochromatic images from polyenergetic CT scans for improved automatic detection of pulmonary embolism
Authors:
Constantin Seibold,
Matthias A. Fink,
Charlotte Goos,
Hans-Ulrich Kauczor,
Heinz-Peter Schlemmer,
Rainer Stiefelhagen,
Jens Kleesiek
Abstract:
Detector-based spectral computed tomography is a recent dual-energy CT (DECT) technology that offers the possibility of obtaining spectral information. From this spectral data, different types of images can be derived, amongst others virtual monoenergetic (monoE) images. MonoE images potentially exhibit decreased artifacts, improve contrast, and overall contain lower noise values, making them idea…
▽ More
Detector-based spectral computed tomography is a recent dual-energy CT (DECT) technology that offers the possibility of obtaining spectral information. From this spectral data, different types of images can be derived, amongst others virtual monoenergetic (monoE) images. MonoE images potentially exhibit decreased artifacts, improve contrast, and overall contain lower noise values, making them ideal candidates for better delineation and thus improved diagnostic accuracy of vascular abnormalities.
In this paper, we are training convolutional neural networks~(CNN) that can emulate the generation of monoE images from conventional single energy CT acquisitions. For this task, we investigate several commonly used image-translation methods. We demonstrate that these methods while creating visually similar outputs, lead to a poorer performance when used for automatic classification of pulmonary embolism (PE). We expand on these methods through the use of a multi-task optimization approach, under which the networks achieve improved classification as well as generation results, as reflected by PSNR and SSIM scores. Further, evaluating our proposed framework on a subset of the RSNA-PE challenge data set shows that we are able to improve the Area under the Receiver Operating Characteristic curve (AuROC) in comparison to a naïve classification approach from 0.8142 to 0.8420.
△ Less
Submitted 23 February, 2021; v1 submitted 2 February, 2021;
originally announced February 2021.
-
An open-source tool for automated planning of overlapping ablation zones for percutaneous renal tumor treatment
Authors:
A. M. Franz,
B. J. Mittmann,
J. Roeser,
B. Schmidberger,
M. Meinke,
P. L. Pereira,
H. U. Kauczor,
G. M. Richter,
C. M. Sommer
Abstract:
Percutaneous thermal ablation is a minimally-invasive treatment option for renal cancer. To treat larger tumours, multiple overlapping ablations zones are required. Arrangements with a low number of ablation zones but coverage of the whole tumour volume are challenging to find for physicians. In this work, an open-source software tool with a new planning approach based on the automatic selection f…
▽ More
Percutaneous thermal ablation is a minimally-invasive treatment option for renal cancer. To treat larger tumours, multiple overlapping ablations zones are required. Arrangements with a low number of ablation zones but coverage of the whole tumour volume are challenging to find for physicians. In this work, an open-source software tool with a new planning approach based on the automatic selection from a large number of randomized geometrical arrangements is presented. Two uncertainty parameters are introduced to account for tissue shrinking and tolerance of non-ablated tumour volume. For seven clinical renal T1a, T1b and T2a tumours, ablation plans were proposed by the software. All proposals are comparable to manual plans of an experienced physician with regard to the number of required ablation zones.
△ Less
Submitted 19 December, 2019;
originally announced December 2019.
