-
ReXErr: Synthesizing Clinically Meaningful Errors in Diagnostic Radiology Reports
Authors:
Vishwanatha M. Rao,
Serena Zhang,
Julian N. Acosta,
Subathra Adithan,
Pranav Rajpurkar
Abstract:
Accurately interpreting medical images and writing radiology reports is a critical but challenging task in healthcare. Both human-written and AI-generated reports can contain errors, ranging from clinical inaccuracies to linguistic mistakes. To address this, we introduce ReXErr, a methodology that leverages Large Language Models to generate representative errors within chest X-ray reports. Working…
▽ More
Accurately interpreting medical images and writing radiology reports is a critical but challenging task in healthcare. Both human-written and AI-generated reports can contain errors, ranging from clinical inaccuracies to linguistic mistakes. To address this, we introduce ReXErr, a methodology that leverages Large Language Models to generate representative errors within chest X-ray reports. Working with board-certified radiologists, we developed error categories that capture common mistakes in both human and AI-generated reports. Our approach uses a novel sampling scheme to inject diverse errors while maintaining clinical plausibility. ReXErr demonstrates consistency across error categories and produces errors that closely mimic those found in real-world scenarios. This method has the potential to aid in the development and evaluation of report correction algorithms, potentially enhancing the quality and reliability of radiology reporting.
△ Less
Submitted 16 September, 2024;
originally announced September 2024.
-
TABSurfer: a Hybrid Deep Learning Architecture for Subcortical Segmentation
Authors:
Aaron Cao,
Vishwanatha M. Rao,
Kejia Liu,
Xinru Liu,
Andrew F. Laine,
Jia Guo
Abstract:
Subcortical segmentation remains challenging despite its important applications in quantitative structural analysis of brain MRI scans. The most accurate method, manual segmentation, is highly labor intensive, so automated tools like FreeSurfer have been adopted to handle this task. However, these traditional pipelines are slow and inefficient for processing large datasets. In this study, we propo…
▽ More
Subcortical segmentation remains challenging despite its important applications in quantitative structural analysis of brain MRI scans. The most accurate method, manual segmentation, is highly labor intensive, so automated tools like FreeSurfer have been adopted to handle this task. However, these traditional pipelines are slow and inefficient for processing large datasets. In this study, we propose TABSurfer, a novel 3D patch-based CNN-Transformer hybrid deep learning model designed for superior subcortical segmentation compared to existing state-of-the-art tools. To evaluate, we first demonstrate TABSurfer's consistent performance across various T1w MRI datasets with significantly shorter processing times compared to FreeSurfer. Then, we validate against manual segmentations, where TABSurfer outperforms FreeSurfer based on the manual ground truth. In each test, we also establish TABSurfer's advantage over a leading deep learning benchmark, FastSurferVINN. Together, these studies highlight TABSurfer's utility as a powerful tool for fully automated subcortical segmentation with high fidelity.
△ Less
Submitted 13 December, 2023;
originally announced December 2023.
-
Pixelated Interactions: Exploring Pixel Art for Graphical Primitives on a Tactile Display
Authors:
Tigmanshu Bhatnagar,
Vikas Upadhyay,
Anchal Sharma,
P V Madhusudhan Rao,
Mark Miodownik,
Nicolai Marquardt,
Catherine Holloway
Abstract:
Two-dimensional pin array tactile displays enable access to tactile graphics that are important for the education of students with visual impairments. Due to their prohibitive cost, limited access, and limited research within HCI, the rules to design graphical primitives on these low-resolution tactile displays are unclear. In this paper, eight tactile readers with visual impairments qualitatively…
▽ More
Two-dimensional pin array tactile displays enable access to tactile graphics that are important for the education of students with visual impairments. Due to their prohibitive cost, limited access, and limited research within HCI, the rules to design graphical primitives on these low-resolution tactile displays are unclear. In this paper, eight tactile readers with visual impairments qualitatively evaluate the implementation of Pixel Art to create tactile graphical primitives on a pin array display. Every pin of the pin array is assumed to be a pixel on a pixel grid. Our findings suggest that Pixel Art tactile graphics on a pin array are clear and comprehensible to tactile readers, positively confirming its use to design basic tactile shapes and line segments. The guidelines provide a framework to create tactile media which implies that the guidelines can be used to downsize basic shapes for refreshable pin-array displays.
△ Less
Submitted 30 May, 2023;
originally announced May 2023.
-
Detecting Schizophrenia with 3D Structural Brain MRI Using Deep Learning
Authors:
Junhao Zhang,
Vishwanatha M. Rao,
Ye Tian,
Yanting Yang,
Nicolas Acosta,
Zihan Wan,
Pin-Yu Lee,
Chloe Zhang,
Lawrence S. Kegeles,
Scott A. Small,
Jia Guo
Abstract:
Schizophrenia is a chronic neuropsychiatric disorder that causes distinct structural alterations within the brain. We hypothesize that deep learning applied to a structural neuroimaging dataset could detect disease-related alteration and improve classification and diagnostic accuracy. We tested this hypothesis using a single, widely available, and conventional T1-weighted MRI scan, from which we e…
▽ More
Schizophrenia is a chronic neuropsychiatric disorder that causes distinct structural alterations within the brain. We hypothesize that deep learning applied to a structural neuroimaging dataset could detect disease-related alteration and improve classification and diagnostic accuracy. We tested this hypothesis using a single, widely available, and conventional T1-weighted MRI scan, from which we extracted the 3D whole-brain structure using standard post-processing methods. A deep learning model was then developed, optimized, and evaluated on three open datasets with T1-weighted MRI scans of patients with schizophrenia. Our proposed model outperformed the benchmark model, which was also trained with structural MR images using a 3D CNN architecture. Our model is capable of almost perfectly (area under the ROC curve = 0.987) distinguishing schizophrenia patients from healthy controls on unseen structural MRI scans. Regional analysis localized subcortical regions and ventricles as the most predictive brain regions. Subcortical structures serve a pivotal role in cognitive, affective, and social functions in humans, and structural abnormalities of these regions have been associated with schizophrenia. Our finding corroborates that schizophrenia is associated with widespread alterations in subcortical brain structure and the subcortical structural information provides prominent features in diagnostic classification. Together, these results further demonstrate the potential of deep learning to improve schizophrenia diagnosis and identify its structural neuroimaging signatures from a single, standard T1-weighted brain MRI.
△ Less
Submitted 7 July, 2022; v1 submitted 26 June, 2022;
originally announced June 2022.
-
Improving Across-Dataset Brain Tissue Segmentation Using Transformer
Authors:
Vishwanatha M. Rao,
Zihan Wan,
Soroush Arabshahi,
David J. Ma,
Pin-Yu Lee,
Ye Tian,
Xuzhe Zhang,
Andrew F. Laine,
Jia Guo
Abstract:
Brain tissue segmentation has demonstrated great utility in quantifying MRI data through Voxel-Based Morphometry and highlighting subtle structural changes associated with various conditions within the brain. However, manual segmentation is highly labor-intensive, and automated approaches have struggled due to properties inherent to MRI acquisition, leaving a great need for an effective segmentati…
▽ More
Brain tissue segmentation has demonstrated great utility in quantifying MRI data through Voxel-Based Morphometry and highlighting subtle structural changes associated with various conditions within the brain. However, manual segmentation is highly labor-intensive, and automated approaches have struggled due to properties inherent to MRI acquisition, leaving a great need for an effective segmentation tool. Despite the recent success of deep convolutional neural networks (CNNs) for brain tissue segmentation, many such solutions do not generalize well to new datasets, which is critical for a reliable solution. Transformers have demonstrated success in natural image segmentation and have recently been applied to 3D medical image segmentation tasks due to their ability to capture long-distance relationships in the input where the local receptive fields of CNNs struggle. This study introduces a novel CNN-Transformer hybrid architecture designed for brain tissue segmentation. We validate our model's performance across four multi-site T1w MRI datasets, covering different vendors, field strengths, scan parameters, time points, and neuropsychiatric conditions. In all situations, our model achieved the greatest generality and reliability. Out method is inherently robust and can serve as a valuable tool for brain-related T1w MRI studies. The code for the TABS network is available at: https://github.com/raovish6/TABS.
△ Less
Submitted 31 January, 2023; v1 submitted 21 January, 2022;
originally announced January 2022.
-
Energy Efficient Task Assignment in Virtualized Wireless Sensor Networks
Authors:
Vahid Maleki Raee,
Diala Naboulsi,
Roch Glitho
Abstract:
Wireless Sensor Networks (WSNs) are being used extensively today in various domains. However, they are traditionally deployed with applications embedded in them which precludes their re-use for new applications. Nowadays, virtualization enables several applications on a same WSN by abstracting the physical resources (i.e. sensing capabilities) into logical ones. However, this comes at a cost, incl…
▽ More
Wireless Sensor Networks (WSNs) are being used extensively today in various domains. However, they are traditionally deployed with applications embedded in them which precludes their re-use for new applications. Nowadays, virtualization enables several applications on a same WSN by abstracting the physical resources (i.e. sensing capabilities) into logical ones. However, this comes at a cost, including an energy cost. It is therefore critical to ensure the efficient allocation of these resources. In this paper, we study the problem of assigning application sensing tasks to sensor devices, in virtualized WSNs. Our goal is to minimize the overall energy consumption resulting from the assignment. We focus on the static version of the problem and formulate it using Integer Linear Programming (ILP), while accounting for sensor nodes' available energy and virtualization overhead. We solve the problem over different scenarios and compare the obtained solution to the case of a traditional WSN, i.e. one with no support for virtualization. Our results show that significant energy can be saved when tasks are appropriately assigned in a WSN that supports virtualization.
△ Less
Submitted 7 May, 2018;
originally announced May 2018.
