-
Domain Shift Analysis in Chest Radiographs Classification in a Veterans Healthcare Administration Population
Authors:
Mayanka Chandrashekar,
Ian Goethert,
Md Inzamam Ul Haque,
Benjamin McMahon,
Sayera Dhaubhadel,
Kathryn Knight,
Joseph Erdos,
Donna Reagan,
Caroline Taylor,
Peter Kuzmak,
John Michael Gaziano,
Eileen McAllister,
Lauren Costa,
Yuk-Lam Ho,
Kelly Cho,
Suzanne Tamang,
Samah Fodeh-Jarad,
Olga S. Ovchinnikova,
Amy C. Justice,
Jacob Hinkle,
Ioana Danciu
Abstract:
Objectives: This study aims to assess the impact of domain shift on chest X-ray classification accuracy and to analyze the influence of ground truth label quality and demographic factors such as age group, sex, and study year. Materials and Methods: We used a DenseNet121 model pretrained MIMIC-CXR dataset for deep learning-based multilabel classification using ground truth labels from radiology re…
▽ More
Objectives: This study aims to assess the impact of domain shift on chest X-ray classification accuracy and to analyze the influence of ground truth label quality and demographic factors such as age group, sex, and study year. Materials and Methods: We used a DenseNet121 model pretrained MIMIC-CXR dataset for deep learning-based multilabel classification using ground truth labels from radiology reports extracted using the CheXpert and CheXbert Labeler. We compared the performance of the 14 chest X-ray labels on the MIMIC-CXR and Veterans Healthcare Administration chest X-ray dataset (VA-CXR). The VA-CXR dataset comprises over 259k chest X-ray images spanning between the years 2010 and 2022. Results: The validation of ground truth and the assessment of multi-label classification performance across various NLP extraction tools revealed that the VA-CXR dataset exhibited lower disagreement rates than the MIMIC-CXR datasets. Additionally, there were notable differences in AUC scores between models utilizing CheXpert and CheXbert. When evaluating multi-label classification performance across different datasets, minimal domain shift was observed in unseen datasets, except for the label "Enlarged Cardiomediastinum." The study year's subgroup analyses exhibited the most significant variations in multi-label classification model performance. These findings underscore the importance of considering domain shifts in chest X-ray classification tasks, particularly concerning study years. Conclusion: Our study reveals the significant impact of domain shift and demographic factors on chest X-ray classification, emphasizing the need for improved transfer learning and equitable model development. Addressing these challenges is crucial for advancing medical imaging and enhancing patient care.
△ Less
Submitted 30 July, 2024;
originally announced July 2024.
-
VISION: Toward a Standardized Process for Radiology Image Management at the National Level
Authors:
Kathryn Knight,
Ioana Danciu,
Olga Ovchinnikova,
Jacob Hinkle,
Mayanka Chandra Shekar,
Debangshu Mukherjee,
Eileen McAllister,
Caitlin Rizy,
Kelly Cho,
Amy C. Justice,
Joseph Erdos,
Peter Kuzmak,
Lauren Costa,
Yuk-Lam Ho,
Reddy Madipadga,
Suzanne Tamang,
Ian Goethert
Abstract:
The compilation and analysis of radiological images poses numerous challenges for researchers. The sheer volume of data as well as the computational needs of algorithms capable of operating on images are extensive. Additionally, the assembly of these images alone is difficult, as these exams may differ widely in terms of clinical context, structured annotation available for model training, modalit…
▽ More
The compilation and analysis of radiological images poses numerous challenges for researchers. The sheer volume of data as well as the computational needs of algorithms capable of operating on images are extensive. Additionally, the assembly of these images alone is difficult, as these exams may differ widely in terms of clinical context, structured annotation available for model training, modality, and patient identifiers. In this paper, we describe our experiences and challenges in establishing a trusted collection of radiology images linked to the United States Department of Veterans Affairs (VA) electronic health record database. We also discuss implications in making this repository research-ready for medical investigators. Key insights include uncovering the specific procedures required for transferring images from a clinical to a research-ready environment, as well as roadblocks and bottlenecks in this process that may hinder future efforts at automation.
△ Less
Submitted 29 April, 2024;
originally announced April 2024.
-
Enabling Autonomous Electron Microscopy for Networked Computation and Steering
Authors:
Anees Al-Najjar,
Nageswara S. V. Rao,
Ramanan Sankaran,
Maxim Ziatdinov,
Debangshu Mukherjee,
Olga Ovchinnikova,
Kevin Roccapriore,
Andrew R. Lupini,
Sergei V. Kalinin
Abstract:
Advanced electron microscopy workflows require an ecosystem of microscope instruments and computing systems possibly located at different sites to conduct remotely steered and automated experiments. Current workflow executions involve manual operations for steering and measurement tasks, which are typically performed from control workstations co-located with microscopes; consequently, their operat…
▽ More
Advanced electron microscopy workflows require an ecosystem of microscope instruments and computing systems possibly located at different sites to conduct remotely steered and automated experiments. Current workflow executions involve manual operations for steering and measurement tasks, which are typically performed from control workstations co-located with microscopes; consequently, their operational tempo and effectiveness are limited. We propose an approach based on separate data and control channels for such an ecosystem of Scanning Transmission Electron Microscopes (STEM) and computing systems, for which no general solutions presently exist, unlike the neutron and light source instruments. We demonstrate automated measurement transfers and remote steering of Nion STEM physical instruments over site networks. We propose a Virtual Infrastructure Twin (VIT) of this ecosystem, which is used to develop and test our steering software modules without requiring access to the physical instrument infrastructure. Additionally, we develop a VIT for a multiple laboratory scenario, which illustrates the applicability of this approach to ecosystems connected over wide-area networks, for the development and testing of software modules and their later field deployment.
△ Less
Submitted 18 October, 2022;
originally announced October 2022.
-
Image Gradient Decomposition for Parallel and Memory-Efficient Ptychographic Reconstruction
Authors:
Xiao Wang,
Aristeidis Tsaris,
Debangshu Mukherjee,
Mohamed Wahib,
Peng Chen,
Mark Oxley,
Olga Ovchinnikova,
Jacob Hinkle
Abstract:
Ptychography is a popular microscopic imaging modality for many scientific discoveries and sets the record for highest image resolution. Unfortunately, the high image resolution for ptychographic reconstruction requires significant amount of memory and computations, forcing many applications to compromise their image resolution in exchange for a smaller memory footprint and a shorter reconstructio…
▽ More
Ptychography is a popular microscopic imaging modality for many scientific discoveries and sets the record for highest image resolution. Unfortunately, the high image resolution for ptychographic reconstruction requires significant amount of memory and computations, forcing many applications to compromise their image resolution in exchange for a smaller memory footprint and a shorter reconstruction time. In this paper, we propose a novel image gradient decomposition method that significantly reduces the memory footprint for ptychographic reconstruction by tessellating image gradients and diffraction measurements into tiles. In addition, we propose a parallel image gradient decomposition method that enables asynchronous point-to-point communications and parallel pipelining with minimal overhead on a large number of GPUs. Our experiments on a Titanate material dataset (PbTiO3) with 16632 probe locations show that our Gradient Decomposition algorithm reduces memory footprint by 51 times. In addition, it achieves time-to-solution within 2.2 minutes by scaling to 4158 GPUs with a super-linear strong scaling efficiency at 364% compared to runtimes at 6 GPUs. This performance is 2.7 times more memory efficient, 9 times more scalable and 86 times faster than the state-of-the-art algorithm.
△ Less
Submitted 16 December, 2022; v1 submitted 12 May, 2022;
originally announced May 2022.
