-
Explaining Uncertainty in Multiple Sclerosis Lesion Segmentation Beyond Prediction Errors
Authors:
Nataliia Molchanova,
Pedro M. Gordaliza,
Alessandro Cagol,
Mario Ocampo--Pineda,
Po--Jui Lu,
Matthias Weigel,
Xinjie Chen,
Erin S. Beck,
Haris Tsagkas,
Daniel Reich,
Anna Stölting,
Pietro Maggi,
Delphine Ribes,
Adrien Depeursinge,
Cristina Granziera,
Henning Müller,
Meritxell Bach Cuadra
Abstract:
Trustworthy artificial intelligence (AI) is essential in healthcare, particularly for high-stakes tasks like medical image segmentation. Explainable AI and uncertainty quantification significantly enhance AI reliability by addressing key attributes such as robustness, usability, and explainability. Despite extensive technical advances in uncertainty quantification for medical imaging, understandin…
▽ More
Trustworthy artificial intelligence (AI) is essential in healthcare, particularly for high-stakes tasks like medical image segmentation. Explainable AI and uncertainty quantification significantly enhance AI reliability by addressing key attributes such as robustness, usability, and explainability. Despite extensive technical advances in uncertainty quantification for medical imaging, understanding the clinical informativeness and interpretability of uncertainty remains limited. This study introduces a novel framework to explain the potential sources of predictive uncertainty, specifically in cortical lesion segmentation in multiple sclerosis using deep ensembles. The proposed analysis shifts the focus from the uncertainty-error relationship towards relevant medical and engineering factors. Our findings reveal that instance-wise uncertainty is strongly related to lesion size, shape, and cortical involvement. Expert rater feedback confirms that similar factors impede annotator confidence. Evaluations conducted on two datasets (206 patients, almost 2000 lesions) under both in-domain and distribution-shift conditions highlight the utility of the framework in different scenarios.
△ Less
Submitted 19 May, 2025; v1 submitted 7 April, 2025;
originally announced April 2025.
-
Unveiling Normative Trajectories of Lifespan Brain Maturation Using Quantitative MRI
Authors:
Xinjie Chen,
Mario Ocampo-Pineda,
Po-Jui Lu,
Clara Ekerdt,
Matthias Weigel,
Michelle G. Jansen,
Alessandro Cagol,
Kwok-Shing Chan,
Sabine Schädelin,
Marcel Zwiers,
Joukje M. Oosterman,
David G. Norris,
Johanna M. M. Bayer,
Andre F. Marquand,
Willeke M. Menks,
Jens Kuhle,
Ludwig Kappos,
Lester Melie-Garcia,
Cristina Granziera,
José P. Marques
Abstract:
Background: Brain maturation and aging involve significant microstructural changes, resulting in functional and cognitive alterations. Quantitative MRI (qMRI) can measure this evolution, distinguishing the physiological effects of normal aging from pathological deviations.
Methods: We conducted a multicentre study using qMRI metrics (R1, R2*, and Quantitative Susceptibility Mapping) to model age…
▽ More
Background: Brain maturation and aging involve significant microstructural changes, resulting in functional and cognitive alterations. Quantitative MRI (qMRI) can measure this evolution, distinguishing the physiological effects of normal aging from pathological deviations.
Methods: We conducted a multicentre study using qMRI metrics (R1, R2*, and Quantitative Susceptibility Mapping) to model age trajectories across brain structures, including tractography-based white matter bundles (TWMB), superficial white matter (SWM), and cortical grey matter (CGM). MRI data from 537 healthy subjects, aged 8 to 79 years, were harmonized using two independent methods. We modeled age trajectories and performed regional analyses to capture maturation patterns and aging effects across the lifespan.
Findings: Our findings revealed a distinct brain maturation gradient, with early qMRI peak values in TWMB, followed by SWM, and culminating in CGM regions. This gradient was observed as a posterior-to-anterior maturation pattern in the cortex and an inferior-to-superior maturation pattern in white matter tracts. R1 demonstrated the most robust age trajectories, while R2* and susceptibility exhibited greater variability and different patterns. The normative modeling framework confirmed the reliability of our age-modelled trajectories across datasets.
Interpretation: Our study highlights the potential of multiparametric qMRI to capture complex, region-specific brain development patterns, addressing the need for comprehensive, age-spanning studies across multiple brain structures. Various harmonization strategies can merge qMRI cohorts, improving the robustness of qMRI-based age models and facilitating the understanding of normal patterns and disease-associated deviations.
△ Less
Submitted 1 November, 2024;
originally announced November 2024.
-
Interpretability of Uncertainty: Exploring Cortical Lesion Segmentation in Multiple Sclerosis
Authors:
Nataliia Molchanova,
Alessandro Cagol,
Pedro M. Gordaliza,
Mario Ocampo-Pineda,
Po-Jui Lu,
Matthias Weigel,
Xinjie Chen,
Adrien Depeursinge,
Cristina Granziera,
Henning Müller,
Meritxell Bach Cuadra
Abstract:
Uncertainty quantification (UQ) has become critical for evaluating the reliability of artificial intelligence systems, especially in medical image segmentation. This study addresses the interpretability of instance-wise uncertainty values in deep learning models for focal lesion segmentation in magnetic resonance imaging, specifically cortical lesion (CL) segmentation in multiple sclerosis. CL seg…
▽ More
Uncertainty quantification (UQ) has become critical for evaluating the reliability of artificial intelligence systems, especially in medical image segmentation. This study addresses the interpretability of instance-wise uncertainty values in deep learning models for focal lesion segmentation in magnetic resonance imaging, specifically cortical lesion (CL) segmentation in multiple sclerosis. CL segmentation presents several challenges, including the complexity of manual segmentation, high variability in annotation, data scarcity, and class imbalance, all of which contribute to aleatoric and epistemic uncertainty. We explore how UQ can be used not only to assess prediction reliability but also to provide insights into model behavior, detect biases, and verify the accuracy of UQ methods. Our research demonstrates the potential of instance-wise uncertainty values to offer post hoc global model explanations, serving as a sanity check for the model. The implementation is available at https://github.com/NataliiaMolch/interpret-lesion-unc.
△ Less
Submitted 8 July, 2024;
originally announced July 2024.