-
Deep Learning-Based Automated Post-Operative Gross Tumor Volume Segmentation in Glioblastoma Patients
Authors:
Rajarajeswari Muthusivarajan,
Adrian Celaya,
Maguy Farhat,
Wasif Talpur,
Holly Langshaw,
Victoria White,
Andrew Elliott,
Sara Thrower,
Dawid Schellingerhout,
David Fuentes,
Caroline Chung
Abstract:
Precise automated delineation of post-operative gross tumor volume in glioblastoma cases is challenging and time-consuming owing to the presence of edema and the deformed brain tissue resulting from the surgical tumor resection. To develop a model for automated delineation of post-operative gross tumor volumes in glioblastoma, we proposed a novel 3D double pocket U-Net architecture that has two pa…
▽ More
Precise automated delineation of post-operative gross tumor volume in glioblastoma cases is challenging and time-consuming owing to the presence of edema and the deformed brain tissue resulting from the surgical tumor resection. To develop a model for automated delineation of post-operative gross tumor volumes in glioblastoma, we proposed a novel 3D double pocket U-Net architecture that has two parallel pocket U-Nets. Both U-Nets were trained simultaneously with two different subsets of MRI sequences and the output from the models was combined to do the final prediction. We strategically combined the MRI input sequences (T1, T2, T1C, FL) for model training to achieve improved segmentation accuracy. The dataset comprised 82 post-operative studies collected from 23 glioblastoma patients who underwent maximal safe tumor resection. All had gross tumor volume (GTV) segmentations performed by human experts, and these were used as a reference standard. The results of 3D double pocket U-Net were compared with baseline 3D pocket U-Net models and the ensemble of 3D pocket U-Net models. All the models were evaluated with fivefold cross-validation in terms of the Dice similarity coefficient and Hausdorff distance. Our proposed double U-Net model trained with input sequences [T1, T1C, FL + T2, T1C] achieved a better mean Dice score of 0.8585 and Hausdorff distance of 4.1942 compared to all the baseline models and ensemble models trained. The presence of infiltrating tumors and vasogenic edema in the post-operative MRI scans tends to reduce segmentation accuracy when considering the MRI sequences T1, T2, T1C, and FL together for model training. The double U-Net approach of combining subsets of the MRI sequences as distinct inputs for model training improves segmentation accuracy by 7% when compared with the conventional method of model training with all four sequences.
△ Less
Submitted 23 September, 2024;
originally announced September 2024.
-
MIST: A Simple and Scalable End-To-End 3D Medical Imaging Segmentation Framework
Authors:
Adrian Celaya,
Evan Lim,
Rachel Glenn,
Brayden Mi,
Alex Balsells,
Dawid Schellingerhout,
Tucker Netherton,
Caroline Chung,
Beatrice Riviere,
David Fuentes
Abstract:
Medical imaging segmentation is a highly active area of research, with deep learning-based methods achieving state-of-the-art results in several benchmarks. However, the lack of standardized tools for training, testing, and evaluating new methods makes the comparison of methods difficult. To address this, we introduce the Medical Imaging Segmentation Toolkit (MIST), a simple, modular, and end-to-e…
▽ More
Medical imaging segmentation is a highly active area of research, with deep learning-based methods achieving state-of-the-art results in several benchmarks. However, the lack of standardized tools for training, testing, and evaluating new methods makes the comparison of methods difficult. To address this, we introduce the Medical Imaging Segmentation Toolkit (MIST), a simple, modular, and end-to-end medical imaging segmentation framework designed to facilitate consistent training, testing, and evaluation of deep learning-based medical imaging segmentation methods. MIST standardizes data analysis, preprocessing, and evaluation pipelines, accommodating multiple architectures and loss functions. This standardization ensures reproducible and fair comparisons across different methods. We detail MIST's data format requirements, pipelines, and auxiliary features and demonstrate its efficacy using the BraTS Adult Glioma Post-Treatment Challenge dataset. Our results highlight MIST's ability to produce accurate segmentation masks and its scalability across multiple GPUs, showcasing its potential as a powerful tool for future medical imaging research and development.
△ Less
Submitted 18 November, 2024; v1 submitted 31 July, 2024;
originally announced July 2024.
-
FMG-Net and W-Net: Multigrid Inspired Deep Learning Architectures For Medical Imaging Segmentation
Authors:
Adrian Celaya,
Beatrice Riviere,
David Fuentes
Abstract:
Accurate medical imaging segmentation is critical for precise and effective medical interventions. However, despite the success of convolutional neural networks (CNNs) in medical image segmentation, they still face challenges in handling fine-scale features and variations in image scales. These challenges are particularly evident in complex and challenging segmentation tasks, such as the BraTS mul…
▽ More
Accurate medical imaging segmentation is critical for precise and effective medical interventions. However, despite the success of convolutional neural networks (CNNs) in medical image segmentation, they still face challenges in handling fine-scale features and variations in image scales. These challenges are particularly evident in complex and challenging segmentation tasks, such as the BraTS multi-label brain tumor segmentation challenge. In this task, accurately segmenting the various tumor sub-components, which vary significantly in size and shape, remains a significant challenge, with even state-of-the-art methods producing substantial errors. Therefore, we propose two architectures, FMG-Net and W-Net, that incorporate the principles of geometric multigrid methods for solving linear systems of equations into CNNs to address these challenges. Our experiments on the BraTS 2020 dataset demonstrate that both FMG-Net and W-Net outperform the widely used U-Net architecture regarding tumor subcomponent segmentation accuracy and training efficiency. These findings highlight the potential of incorporating the principles of multigrid methods into CNNs to improve the accuracy and efficiency of medical imaging segmentation.
△ Less
Submitted 10 November, 2023; v1 submitted 5 April, 2023;
originally announced April 2023.
-
A Generalized Surface Loss for Reducing the Hausdorff Distance in Medical Imaging Segmentation
Authors:
Adrian Celaya,
Beatrice Riviere,
David Fuentes
Abstract:
Within medical imaging segmentation, the Dice coefficient and Hausdorff-based metrics are standard measures of success for deep learning models. However, modern loss functions for medical image segmentation often only consider the Dice coefficient or similar region-based metrics during training. As a result, segmentation architectures trained over such loss functions run the risk of achieving high…
▽ More
Within medical imaging segmentation, the Dice coefficient and Hausdorff-based metrics are standard measures of success for deep learning models. However, modern loss functions for medical image segmentation often only consider the Dice coefficient or similar region-based metrics during training. As a result, segmentation architectures trained over such loss functions run the risk of achieving high accuracy for the Dice coefficient but low accuracy for Hausdorff-based metrics. Low accuracy on Hausdorff-based metrics can be problematic for applications such as tumor segmentation, where such benchmarks are crucial. For example, high Dice scores accompanied by significant Hausdorff errors could indicate that the predictions fail to detect small tumors. We propose the Generalized Surface Loss function, a novel loss function to minimize Hausdorff-based metrics with more desirable numerical properties than current methods and with weighting terms for class imbalance. Our loss function outperforms other losses when tested on the LiTS and BraTS datasets using the state-of-the-art nnUNet architecture. These results suggest we can improve medical imaging segmentation accuracy with our novel loss function.
△ Less
Submitted 23 January, 2024; v1 submitted 7 February, 2023;
originally announced February 2023.
-
Correlation between image quality metrics of magnetic resonance images and the neural network segmentation accuracy
Authors:
Rajarajeswari Muthusivarajan,
Adrian Celaya,
Joshua P. Yung,
Satish Viswanath,
Daniel S. Marcus,
Caroline Chung,
David Fuentes
Abstract:
Deep neural networks with multilevel connections process input data in complex ways to learn the information.A networks learning efficiency depends not only on the complex neural network architecture but also on the input training images.Medical image segmentation with deep neural networks for skull stripping or tumor segmentation from magnetic resonance images enables learning both global and loc…
▽ More
Deep neural networks with multilevel connections process input data in complex ways to learn the information.A networks learning efficiency depends not only on the complex neural network architecture but also on the input training images.Medical image segmentation with deep neural networks for skull stripping or tumor segmentation from magnetic resonance images enables learning both global and local features of the images.Though medical images are collected in a controlled environment,there may be artifacts or equipment based variance that cause inherent bias in the input set.In this study, we investigated the correlation between the image quality metrics of MR images with the neural network segmentation accuracy.For that we have used the 3D DenseNet architecture and let the network trained on the same input but applying different methodologies to select the training data set based on the IQM values.The difference in the segmentation accuracy between models based on the random training inputs with IQM based training inputs shed light on the role of image quality metrics on segmentation accuracy.By running the image quality metrics to choose the training inputs,further we may tune the learning efficiency of the network and the segmentation accuracy.
△ Less
Submitted 1 November, 2021;
originally announced November 2021.
-
PocketNet: A Smaller Neural Network for Medical Image Analysis
Authors:
Adrian Celaya,
Jonas A. Actor,
Rajarajeswari Muthusivarajan,
Evan Gates,
Caroline Chung,
Dawid Schellingerhout,
Beatrice Riviere,
David Fuentes
Abstract:
Medical imaging deep learning models are often large and complex, requiring specialized hardware to train and evaluate these models. To address such issues, we propose the PocketNet paradigm to reduce the size of deep learning models by throttling the growth of the number of channels in convolutional neural networks. We demonstrate that, for a range of segmentation and classification tasks, Pocket…
▽ More
Medical imaging deep learning models are often large and complex, requiring specialized hardware to train and evaluate these models. To address such issues, we propose the PocketNet paradigm to reduce the size of deep learning models by throttling the growth of the number of channels in convolutional neural networks. We demonstrate that, for a range of segmentation and classification tasks, PocketNet architectures produce results comparable to that of conventional neural networks while reducing the number of parameters by multiple orders of magnitude, using up to 90% less GPU memory, and speeding up training times by up to 40%, thereby allowing such models to be trained and deployed in resource-constrained settings.
△ Less
Submitted 18 September, 2022; v1 submitted 21 April, 2021;
originally announced April 2021.