-
Accelerated Cardiac Parametric Mapping using Deep Learning-Refined Subspace Models
Authors:
Calder D. Sheagren,
Brenden T. Kadota,
Jaykumar H. Patel,
Mark Chiew,
Graham A. Wright
Abstract:
Cardiac parametric mapping is useful for evaluating cardiac fibrosis and edema. Parametric mapping relies on single-shot heartbeat-by-heartbeat imaging, which is susceptible to intra-shot motion during the imaging window. However, reducing the imaging window requires undersampled reconstruction techniques to preserve image fidelity and spatial resolution. The proposed approach is based on a low-ra…
▽ More
Cardiac parametric mapping is useful for evaluating cardiac fibrosis and edema. Parametric mapping relies on single-shot heartbeat-by-heartbeat imaging, which is susceptible to intra-shot motion during the imaging window. However, reducing the imaging window requires undersampled reconstruction techniques to preserve image fidelity and spatial resolution. The proposed approach is based on a low-rank tensor model of the multi-dimensional data, which jointly estimates spatial basis images and temporal basis time-courses from an auxiliary parallel imaging reconstruction. The tensor-estimated spatial basis is then further refined using a deep neural network, trained in a fully supervised fashion, improving the fidelity of the spatial basis using learned representations of cardiac basis functions. This two-stage spatial basis estimation will be compared against Fourier-based reconstructions and parallel imaging alone to demonstrate the sharpening and denoising properties of the deep learning-based subspace analysis.
△ Less
Submitted 22 March, 2025;
originally announced March 2025.
-
Low-Rank Conjugate Gradient-Net for Accelerated Cardiac MR Imaging
Authors:
Jaykumar H. Patel,
Brenden T. Kadota,
Calder D. Sheagren,
Mark Chiew,
Graham A. Wright
Abstract:
Cardiovascular diseases (CVDs) remain the leading cause of mortality and morbidity worldwide. Both diagnosis and prognosis of these diseases benefit from high-quality imaging, which cardiac magnetic resonance imaging provides. CMR imaging requires lengthy acquisition times and multiple breath-holds for a complete exam, which can lead to patient discomfort and frequently results in image artifacts.…
▽ More
Cardiovascular diseases (CVDs) remain the leading cause of mortality and morbidity worldwide. Both diagnosis and prognosis of these diseases benefit from high-quality imaging, which cardiac magnetic resonance imaging provides. CMR imaging requires lengthy acquisition times and multiple breath-holds for a complete exam, which can lead to patient discomfort and frequently results in image artifacts. In this work, we present a Low-rank tensor U-Net method (LowRank-CGNet) that rapidly reconstructs highly undersampled data with a variety of anatomy, contrast, and undersampling artifacts. The model uses conjugate gradient data consistency to solve for the spatial and temporal bases and employs a U-Net to further regularize the basis vectors. Currently, model performance is superior to a standard U-Net, but inferior to conventional compressed sensing methods. In the future, we aim to further improve model performance by increasing the U-Net size, extending the training duration, and dynamically updating the tensor rank for different anatomies.
△ Less
Submitted 17 November, 2024;
originally announced November 2024.
-
Training dynamic models using early exits for automatic speech recognition on resource-constrained devices
Authors:
George August Wright,
Umberto Cappellazzo,
Salah Zaiem,
Desh Raj,
Lucas Ondel Yang,
Daniele Falavigna,
Mohamed Nabih Ali,
Alessio Brutti
Abstract:
The ability to dynamically adjust the computational load of neural models during inference is crucial for on-device processing scenarios characterised by limited and time-varying computational resources. A promising solution is presented by early-exit architectures, in which additional exit branches are appended to intermediate layers of the encoder. In self-attention models for automatic speech r…
▽ More
The ability to dynamically adjust the computational load of neural models during inference is crucial for on-device processing scenarios characterised by limited and time-varying computational resources. A promising solution is presented by early-exit architectures, in which additional exit branches are appended to intermediate layers of the encoder. In self-attention models for automatic speech recognition (ASR), early-exit architectures enable the development of dynamic models capable of adapting their size and architecture to varying levels of computational resources and ASR performance demands. Previous research on early-exiting ASR models has relied on pre-trained self-supervised models, fine-tuned with an early-exit loss. In this paper, we undertake an experimental comparison between fine-tuning pre-trained backbones and training models from scratch with the early-exiting objective. Experiments conducted on public datasets reveal that early-exit models trained from scratch not only preserve performance when using fewer encoder layers but also exhibit enhanced task accuracy compared to single-exit or pre-trained models. Furthermore, we explore an exit selection strategy grounded in posterior probabilities as an alternative to the conventional frame-based entropy approach. Results provide insights into the training dynamics of early-exit architectures for ASR models, particularly the efficacy of training strategies and exit selection methods.
△ Less
Submitted 22 February, 2024; v1 submitted 18 September, 2023;
originally announced September 2023.
-
A general method for estimating zonal transmission interface limits from nodal network data
Authors:
Patrick R. Brown,
Clayton P. Barrows,
Jarrad G. Wright,
Gregory L. Brinkman,
Sourabh Dalvi,
Jiazi Zhang,
Trieu Mai
Abstract:
Capacity expansion models for the electric power system often employ zonal (rather than nodal) resolution, necessitating estimates of aggregate power transfer limits across the interfaces between model zones. Interface limits between planning areas are sometimes published, but they are not generalizable to arbitrary zone shapes. There is thus a need for a reproducible method for estimating interfa…
▽ More
Capacity expansion models for the electric power system often employ zonal (rather than nodal) resolution, necessitating estimates of aggregate power transfer limits across the interfaces between model zones. Interface limits between planning areas are sometimes published, but they are not generalizable to arbitrary zone shapes. There is thus a need for a reproducible method for estimating interface transfer limits (ITLs) between user-defined zones directly from nodal transmission system data. Here, we present a simple method for estimating ITLs using a DC power flow approximation via the power transfer distribution factor (PTDF) matrix. Linear optimization is performed to identify the distribution of power flows that maximizes the total flow on interface-crossing lines, subject to individual line ratings, limits on bus injection/withdrawal, and the relationships among flows, injections, and withdrawals imposed by the PTDF matrix. We demonstrate the application of the method on a 134-zone ~65000-bus system, and we explore the influence of flow direction, contingency level, and zone size on the estimated ITLs. There is significant heterogeneity in the ratio of the ITL to the sum of interface-crossing line ratings, which highlights the importance of accounting for the physical constraints on power flows imposed by Kirchhoff's laws when estimating zonal ITLs.
△ Less
Submitted 7 August, 2023;
originally announced August 2023.
-
cuFINUFFT: a load-balanced GPU library for general-purpose nonuniform FFTs
Authors:
Yu-hsuan Shih,
Garrett Wright,
Joakim Andén,
Johannes Blaschke,
Alex H. Barnett
Abstract:
Nonuniform fast Fourier transforms dominate the computational cost in many applications including image reconstruction and signal processing. We thus present a general-purpose GPU-based CUDA library for type 1 (nonuniform to uniform) and type 2 (uniform to nonuniform) transforms in dimensions 2 and 3, in single or double precision. It achieves high performance for a given user-requested accuracy,…
▽ More
Nonuniform fast Fourier transforms dominate the computational cost in many applications including image reconstruction and signal processing. We thus present a general-purpose GPU-based CUDA library for type 1 (nonuniform to uniform) and type 2 (uniform to nonuniform) transforms in dimensions 2 and 3, in single or double precision. It achieves high performance for a given user-requested accuracy, regardless of the distribution of nonuniform points, via cache-aware point reordering, and load-balanced blocked spreading in shared memory. At low accuracies, this gives on-GPU throughputs around $10^9$ nonuniform points per second, and (even including host-device transfer) is typically 4-10$\times$ faster than the latest parallel CPU code FINUFFT (at 28 threads). It is competitive with two established GPU codes, being up to 90$\times$ faster at high accuracy and/or type 1 clustered point distributions. Finally we demonstrate a 5-12$\times$ speedup versus CPU in an X-ray diffraction 3D iterative reconstruction task at $10^{-12}$ accuracy, observing excellent multi-GPU weak scaling up to one rank per GPU.
△ Less
Submitted 25 March, 2021; v1 submitted 16 February, 2021;
originally announced February 2021.
-
Estimating Uncertainty in Neural Networks for Cardiac MRI Segmentation: A Benchmark Study
Authors:
Matthew Ng,
Fumin Guo,
Labonny Biswas,
Steffen E. Petersen,
Stefan K. Piechnik,
Stefan Neubauer,
Graham Wright
Abstract:
Objective: Convolutional neural networks (CNNs) have demonstrated promise in automated cardiac magnetic resonance image segmentation. However, when using CNNs in a large real-world dataset, it is important to quantify segmentation uncertainty and identify segmentations which could be problematic. In this work, we performed a systematic study of Bayesian and non-Bayesian methods for estimating unce…
▽ More
Objective: Convolutional neural networks (CNNs) have demonstrated promise in automated cardiac magnetic resonance image segmentation. However, when using CNNs in a large real-world dataset, it is important to quantify segmentation uncertainty and identify segmentations which could be problematic. In this work, we performed a systematic study of Bayesian and non-Bayesian methods for estimating uncertainty in segmentation neural networks.
Methods: We evaluated Bayes by Backprop, Monte Carlo Dropout, Deep Ensembles, and Stochastic Segmentation Networks in terms of segmentation accuracy, probability calibration, uncertainty on out-of-distribution images, and segmentation quality control.
Results: We observed that Deep Ensembles outperformed the other methods except for images with heavy noise and blurring distortions. We showed that Bayes by Backprop is more robust to noise distortions while Stochastic Segmentation Networks are more resistant to blurring distortions. For segmentation quality control, we showed that segmentation uncertainty is correlated with segmentation accuracy for all the methods. With the incorporation of uncertainty estimates, we were able to reduce the percentage of poor segmentation to 5% by flagging 31--48% of the most uncertain segmentations for manual review, substantially lower than random review without using neural network uncertainty (reviewing 75--78% of all images).
Conclusion: This work provides a comprehensive evaluation of uncertainty estimation methods and showed that Deep Ensembles outperformed other methods in most cases.
Significance: Neural network uncertainty measures can help identify potentially inaccurate segmentations and alert users for manual review.
△ Less
Submitted 30 December, 2022; v1 submitted 31 December, 2020;
originally announced December 2020.
-
Microtubule Motility Analysis based on Time-Lapse Fluorescence Microscopy
Authors:
Samira Masoudi,
Cameron H. G. Wright,
Jesse C. Gatlin,
John. S. Oakey
Abstract:
This paper describes an investigation into part of the mechanical mechanisms underlying the formation of mitotic spindle, the cellular machinery responsible for chromosomal separation during cell division. In normal eukaryotic cells, spindles are composed of microtubule filaments that radiate outward from two centrosomes. In many transformed cells, however, centrosome number is misregulated result…
▽ More
This paper describes an investigation into part of the mechanical mechanisms underlying the formation of mitotic spindle, the cellular machinery responsible for chromosomal separation during cell division. In normal eukaryotic cells, spindles are composed of microtubule filaments that radiate outward from two centrosomes. In many transformed cells, however, centrosome number is misregulated resulting in cells with more than two centrosomes. Addressing the question of how these cells accommodate these additional structures by coalescing supernumerary centrosomes to form normal spindles will provide a powerful insight toward understanding the proliferation of cancer cells and developing new therapeutics. The process of centrosome coalescence is thought to involve motor proteins that function to slide microtubules relative to one another. Here we use in vitro motility assays combined with fluorescence microscopy to visualize, characterize and quantify microtubule-microtubule interactions. After segmenting the microtubules, their speed and direction of movement are the extracted features to cluster their interaction type. In order to evaluate the potential of our processing algorithm, we created a simulated dataset similar to the time-lapse series. Once our procedure has been optimized using the simulated data, we will apply it to the real data. Results of our analyses will provide a quantitative description of interaction among microtubules. This is a potentially important step toward more thorough understanding of cancer.
△ Less
Submitted 27 May, 2019;
originally announced May 2019.
