-
Hybrid artificial intelligence echogenic components-based diagnosis of adnexal masses on ultrasound
Authors:
Roni Yoeli-Bik,
Heather M. Whitney,
Hui Li,
Agnes Bilecz,
Jacques S. Abramowicz,
Li Lan,
Ryan E. Longman,
Maryellen L. Giger,
Ernst Lengyel
Abstract:
Background: Adnexal masses are heterogeneous and have varied sonographic presentations, making them difficult to diagnose correctly. Purpose: Our study aimed to develop an innovative hybrid artificial intelligence/computer aided diagnosis (AI/CADx)-based pipeline to distinguish between benign and malignant adnexal masses on ultrasound imaging based upon automatic segmentation and echogenic-based c…
▽ More
Background: Adnexal masses are heterogeneous and have varied sonographic presentations, making them difficult to diagnose correctly. Purpose: Our study aimed to develop an innovative hybrid artificial intelligence/computer aided diagnosis (AI/CADx)-based pipeline to distinguish between benign and malignant adnexal masses on ultrasound imaging based upon automatic segmentation and echogenic-based classification. Methods: The retrospective study was conducted on a consecutive dataset of patients with an adnexal mass. There was one image per mass. Mass borders were segmented from the background via a supervised U-net algorithm. Masses were spatially subdivided automatically into their hypo- and hyper-echogenic components by a physics-driven unsupervised clustering algorithm. The dataset was separated by patient into a training/validation set (95 masses; 70%) and an independent held-out test set (41 masses; 30%). Eight component-based radiomic features plus a binary measure of the presence or absence of solid components were used to train a linear discriminant analysis classifier to distinguish between malignant and benign masses. Classification performance was evaluated using the area under the receiver operating characteristic curve (AUC), along with sensitivity, specificity, negative predictive value, positive predictive value, and accuracy at target 95% sensitivity. Results: The cohort included 133 patients with 136 adnexal masses. In distinguishing between malignant and benign masses, the pipeline achieved an AUC of 0.90 [0.84, 0.95] on the training/validation set and 0.93 [0.83, 0.98] on the independent test set. Strong diagnostic performance was observed at the target 95% sensitivity. Conclusions: A novel hybrid AI/CADx echogenic components-based ultrasound imaging pipeline can distinguish between malignant and benign adnexal masses with strong diagnostic performance.
△ Less
Submitted 16 April, 2025;
originally announced April 2025.
-
AI analysis of medical images at scale as a health disparities probe: a feasibility demonstration using chest radiographs
Authors:
Heather M. Whitney,
Hui Li,
Karen Drukker,
Elbert Huang,
Maryellen L. Giger
Abstract:
Health disparities (differences in non-genetic conditions that influence health) can be associated with differences in burden of disease by groups within a population. Social determinants of health (SDOH) are domains such as health care access, dietary access, and economics frequently studied for potential association with health disparities. Evaluating SDOH-related phenotypes using routine medica…
▽ More
Health disparities (differences in non-genetic conditions that influence health) can be associated with differences in burden of disease by groups within a population. Social determinants of health (SDOH) are domains such as health care access, dietary access, and economics frequently studied for potential association with health disparities. Evaluating SDOH-related phenotypes using routine medical images as data sources may enhance health disparities research. We developed a pipeline for using quantitative measures automatically extracted from medical images as inputs into health disparities index calculations. Our study focused on the use case of two SDOH demographic correlates (sex and race) and data extracted from chest radiographs of 1,571 unique patients. The likelihood of severe disease within the lung parenchyma from each image type, measured using an established deep learning model, was merged into a single numerical image-based phenotype for each patient. Patients were then separated into phenogroups by unsupervised clustering of the image-based phenotypes. The health rate for each phenogroup was defined as the median image-based phenotype for each SDOH used as inputs to four imaging-derived health disparities indices (iHDIs): one absolute measure (between-group variance) and three relative measures (index of disparity, Theil index, and mean log deviation). The iHDI measures demonstrated feasible values for each SDOH demographic correlate, showing potential for medical images to serve as a novel probe for health disparities. Large-scale AI analysis of medical images can serve as a probe for a novel data source for health disparities research.
△ Less
Submitted 8 April, 2025;
originally announced April 2025.
-
Longitudinal assessment of demographic representativeness in the Medical Imaging and Data Resource Center Open Data Commons
Authors:
Heather M. Whitney,
Natalie Baughan,
Kyle J. Myers,
Karen Drukker,
Judy Gichoya,
Brad Bower,
Weijie Chen,
Nicholas Gruszauskas,
Jayashree Kalpathy-Cramer,
Sanmi Koyejo,
Rui C. Sá,
Berkman Sahiner,
Zi Zhang,
Maryellen L. Giger
Abstract:
Purpose: The Medical Imaging and Data Resource Center (MIDRC) open data commons was launched to accelerate the development of artificial intelligence (AI) algorithms to help address the COVID-19 pandemic. The purpose of this study was to quantify longitudinal representativeness of the demographic characteristics of the primary imaging dataset compared to the United States general population (US Ce…
▽ More
Purpose: The Medical Imaging and Data Resource Center (MIDRC) open data commons was launched to accelerate the development of artificial intelligence (AI) algorithms to help address the COVID-19 pandemic. The purpose of this study was to quantify longitudinal representativeness of the demographic characteristics of the primary imaging dataset compared to the United States general population (US Census) and COVID-19 positive case counts from the Centers for Disease Control and Prevention (CDC). Approach: The Jensen Shannon distance (JSD) was used to longitudinally measure the similarity of the distribution of (1) all unique patients in the MIDRC data to the 2020 US Census and (2) all unique COVID-19 positive patients in the MIDRC data to the case counts reported by the CDC. The distributions were evaluated in the demographic categories of age at index, sex, race, ethnicity, and the intersection of race and ethnicity. Results: Representativeness the MIDRC data by ethnicity and the intersection of race and ethnicity was impacted by the percentage of CDC case counts for which data in these categories is not reported. The distributions by sex and race have retained their level of representativeness over time. Conclusion: The representativeness of the open medical imaging datasets in the curated public data commons at MIDRC has evolved over time as both the number of contributing institutions and overall number of subjects has grown. The use of metrics such as the JSD support measurement of representativeness, one step needed for fair and generalizable AI algorithm development.
△ Less
Submitted 18 March, 2023;
originally announced March 2023.
-
Transfer Learning in 4D for Breast Cancer Diagnosis using Dynamic Contrast-Enhanced Magnetic Resonance Imaging
Authors:
Qiyuan Hu,
Heather M. Whitney,
Maryellen L. Giger
Abstract:
Deep transfer learning using dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) has shown strong predictive power in characterization of breast lesions. However, pretrained convolutional neural networks (CNNs) require 2D inputs, limiting the ability to exploit the rich 4D (volumetric and temporal) image information inherent in DCE-MRI that is clinically valuable for lesion assessment.…
▽ More
Deep transfer learning using dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) has shown strong predictive power in characterization of breast lesions. However, pretrained convolutional neural networks (CNNs) require 2D inputs, limiting the ability to exploit the rich 4D (volumetric and temporal) image information inherent in DCE-MRI that is clinically valuable for lesion assessment. Training 3D CNNs from scratch, a common method to utilize high-dimensional information in medical images, is computationally expensive and is not best suited for moderately sized healthcare datasets. Therefore, we propose a novel approach using transfer learning that incorporates the 4D information from DCE-MRI, where volumetric information is collapsed at feature level by max pooling along the projection perpendicular to the transverse slices and the temporal information is contained either in second-post contrast subtraction images. Our methodology yielded an area under the receiver operating characteristic curve of 0.89+/-0.01 on a dataset of 1161 breast lesions, significantly outperforming a previous approach that incorporates the 4D information in DCE-MRI by the use of maximum intensity projection (MIP) images.
△ Less
Submitted 7 November, 2019;
originally announced November 2019.
