-
Imaging 3D Chemistry at 1 nm Resolution with Fused Multi-Modal Electron Tomography
Authors:
Jonathan Schwartz,
Zichao Wendy Di,
Yi Jiang,
Jason Manassa,
Jacob Pietryga,
Yiwen Qian,
Min Gee Cho,
Jonathan L. Rowell,
Huihuo Zheng,
Richard D. Robinson,
Junsi Gu,
Alexey Kirilin,
Steve Rozeveld,
Peter Ercius,
Jeffrey A. Fessler,
Ting Xu,
Mary Scott,
Robert Hovden
Abstract:
Measuring the three-dimensional (3D) distribution of chemistry in nanoscale matter is a longstanding challenge for metrological science. The inelastic scattering events required for 3D chemical imaging are too rare, requiring high beam exposure that destroys the specimen before an experiment completes. Even larger doses are required to achieve high resolution. Thus, chemical mapping in 3D has been…
▽ More
Measuring the three-dimensional (3D) distribution of chemistry in nanoscale matter is a longstanding challenge for metrological science. The inelastic scattering events required for 3D chemical imaging are too rare, requiring high beam exposure that destroys the specimen before an experiment completes. Even larger doses are required to achieve high resolution. Thus, chemical mapping in 3D has been unachievable except at lower resolution with the most radiation-hard materials. Here, high-resolution 3D chemical imaging is achieved near or below one nanometer resolution in a Au-Fe$_3$O$_4$ metamaterial, Co$_3$O$_4$ - Mn$_3$O$_4$ core-shell nanocrystals, and ZnS-Cu$_{0.64}$S$_{0.36}$ nanomaterial using fused multi-modal electron tomography. Multi-modal data fusion enables high-resolution chemical tomography often with 99\% less dose by linking information encoded within both elastic (HAADF) and inelastic (EDX / EELS) signals. Now sub-nanometer 3D resolution of chemistry is measurable for a broad class of geometrically and compositionally complex materials.
△ Less
Submitted 18 June, 2024; v1 submitted 24 April, 2023;
originally announced April 2023.
-
Imaging Atomic-Scale Chemistry from Fused Multi-Modal Electron Microscopy
Authors:
Jonathan Schwartz,
Zichao Wendy Di,
Yi Jiang,
Alyssa J. Fielitz,
Don-Hyung Ha,
Sanjaya D. Perera,
Ismail El Baggari,
Richard D. Robinson,
Jeffrey A. Fessler,
Colin Ophus,
Steve Rozeveld,
Robert Hovden
Abstract:
Efforts to map atomic-scale chemistry at low doses with minimal noise using electron microscopes are fundamentally limited by inelastic interactions. Here, fused multi-modal electron microscopy offers high signal-to-noise ratio (SNR) recovery of material chemistry at nano- and atomic- resolution by coupling correlated information encoded within both elastic scattering (high-angle annular dark fiel…
▽ More
Efforts to map atomic-scale chemistry at low doses with minimal noise using electron microscopes are fundamentally limited by inelastic interactions. Here, fused multi-modal electron microscopy offers high signal-to-noise ratio (SNR) recovery of material chemistry at nano- and atomic- resolution by coupling correlated information encoded within both elastic scattering (high-angle annular dark field (HAADF)) and inelastic spectroscopic signals (electron energy loss (EELS) or energy-dispersive x-ray (EDX)). By linking these simultaneously acquired signals, or modalities, the chemical distribution within nanomaterials can be imaged at significantly lower doses with existing detector hardware. In many cases, the dose requirements can be reduced by over one order of magnitude. This high SNR recovery of chemistry is tested against simulated and experimental atomic resolution data of heterogeneous nanomaterials.
△ Less
Submitted 5 November, 2023; v1 submitted 3 March, 2022;
originally announced March 2022.
-
Manifold Model for High-Resolution fMRI Joint Reconstruction and Dynamic Quantification
Authors:
Shouchang Guo,
Jeffrey A. Fessler,
Douglas C. Noll
Abstract:
Oscillating Steady-State Imaging (OSSI) is a recent fMRI acquisition method that exploits a large and oscillating signal, and can provide high SNR fMRI. However, the oscillatory nature of the signal leads to an increased number of acquisitions. To improve temporal resolution and accurately model the nonlinearity of OSSI signals, we build the MR physics for OSSI signal generation as a regularizer f…
▽ More
Oscillating Steady-State Imaging (OSSI) is a recent fMRI acquisition method that exploits a large and oscillating signal, and can provide high SNR fMRI. However, the oscillatory nature of the signal leads to an increased number of acquisitions. To improve temporal resolution and accurately model the nonlinearity of OSSI signals, we build the MR physics for OSSI signal generation as a regularizer for the undersampled reconstruction rather than using subspace models that are not well suited for the data. Our proposed physics-based manifold model turns the disadvantages of OSSI acquisition into advantages and enables joint reconstruction and quantification. OSSI manifold model (OSSIMM) outperforms subspace models and reconstructs high-resolution fMRI images with a factor of 12 acceleration and without spatial or temporal resolution smoothing. Furthermore, OSSIMM can dynamically quantify important physics parameters, including $R_2^*$ maps, with a temporal resolution of 150 ms.
△ Less
Submitted 16 April, 2021;
originally announced April 2021.
-
Improved low-count quantitative PET reconstruction with an iterative neural network
Authors:
Hongki Lim,
Il Yong Chun,
Yuni K. Dewaraja,
Jeffrey A. Fessler
Abstract:
Image reconstruction in low-count PET is particularly challenging because gammas from natural radioactivity in Lu-based crystals cause high random fractions that lower the measurement signal-to-noise-ratio (SNR). In model-based image reconstruction (MBIR), using more iterations of an unregularized method may increase the noise, so incorporating regularization into the image reconstruction is desir…
▽ More
Image reconstruction in low-count PET is particularly challenging because gammas from natural radioactivity in Lu-based crystals cause high random fractions that lower the measurement signal-to-noise-ratio (SNR). In model-based image reconstruction (MBIR), using more iterations of an unregularized method may increase the noise, so incorporating regularization into the image reconstruction is desirable to control the noise. New regularization methods based on learned convolutional operators are emerging in MBIR. We modify the architecture of an iterative neural network, BCD-Net, for PET MBIR, and demonstrate the efficacy of the trained BCD-Net using XCAT phantom data that simulates the low true coincidence count-rates with high random fractions typical for Y-90 PET patient imaging after Y-90 microsphere radioembolization. Numerical results show that the proposed BCD-Net significantly improves CNR and RMSE of the reconstructed images compared to MBIR methods using non-trained regularizers, total variation (TV) and non-local means (NLM). Moreover, BCD-Net successfully generalizes to test data that differs from the training data. Improvements were also demonstrated for the clinically relevant phantom measurement data where we used training and testing datasets having very different activity distributions and count-levels.
△ Less
Submitted 25 May, 2020; v1 submitted 5 June, 2019;
originally announced June 2019.
-
Fast, Precise Myelin Water Quantification using DESS MRI and Kernel Learning
Authors:
Gopal Nataraj,
Jon-Fredrik Nielsen,
Mingjie Gao,
Jeffrey A. Fessler
Abstract:
Purpose: To investigate the feasibility of myelin water content quantification using fast dual-echo steady-state (DESS) scans and machine learning with kernels.
Methods: We optimized combinations of steady-state (SS) scans for precisely estimating the fast-relaxing signal fraction ff of a two-compartment signal model, subject to a scan time constraint. We estimated ff from the optimized DESS acq…
▽ More
Purpose: To investigate the feasibility of myelin water content quantification using fast dual-echo steady-state (DESS) scans and machine learning with kernels.
Methods: We optimized combinations of steady-state (SS) scans for precisely estimating the fast-relaxing signal fraction ff of a two-compartment signal model, subject to a scan time constraint. We estimated ff from the optimized DESS acquisition using a recently developed method for rapid parameter estimation via regression with kernels (PERK). We compared DESS PERK ff estimates to conventional myelin water fraction (MWF) estimates from a longer multi-echo spin-echo (MESE) acquisition in simulation, in vivo, and ex vivo studies.
Results: Simulations demonstrate that DESS PERK ff estimators and MESE MWF estimators achieve comparable error levels. In vivo and ex vivo experiments demonstrate that MESE MWF and DESS PERK ff estimates are quantitatively comparable measures of WM myelin water content. To our knowledge, these experiments are the first to demonstrate myelin water images from a SS acquisition that are quantitatively similar to conventional MESE MWF images.
Conclusion: Combinations of fast DESS scans can be designed to enable precise ff estimation. PERK is well-suited for ff estimation. DESS PERK ff and MESE MWF estimates are quantitatively similar measures of WM myelin water content.
△ Less
Submitted 24 September, 2018;
originally announced September 2018.
-
SPULTRA: Low-Dose CT Image Reconstruction with Joint Statistical and Learned Image Models
Authors:
Siqi Ye,
Saiprasad Ravishankar,
Yong Long,
Jeffrey A. Fessler
Abstract:
Low-dose CT image reconstruction has been a popular research topic in recent years. A typical reconstruction method based on post-log measurements is called penalized weighted-least squares (PWLS). Due to the underlying limitations of the post-log statistical model, the PWLS reconstruction quality is often degraded in low-dose scans. This paper investigates a shifted-Poisson (SP) model based likel…
▽ More
Low-dose CT image reconstruction has been a popular research topic in recent years. A typical reconstruction method based on post-log measurements is called penalized weighted-least squares (PWLS). Due to the underlying limitations of the post-log statistical model, the PWLS reconstruction quality is often degraded in low-dose scans. This paper investigates a shifted-Poisson (SP) model based likelihood function that uses the pre-log raw measurements that better represents the measurement statistics, together with a data-driven regularizer exploiting a Union of Learned TRAnsforms (SPULTRA). Both the SP induced data-fidelity term and the regularizer in the proposed framework are nonconvex. The proposed SPULTRA algorithm uses quadratic surrogate functions for the SP induced data-fidelity term. Each iteration involves a quadratic subproblem for updating the image, and a sparse coding and clustering subproblem that has a closed-form solution. The SPULTRA algorithm has a similar computational cost per iteration as its recent counterpart PWLS-ULTRA that uses post-log measurements, and it provides better image reconstruction quality than PWLS-ULTRA, especially in low-dose scans.
△ Less
Submitted 12 August, 2019; v1 submitted 27 August, 2018;
originally announced August 2018.
-
Statistical Image Reconstruction Using Mixed Poisson-Gaussian Noise Model for X-Ray CT
Authors:
Qiaoqiao Ding,
Yong Long,
Xiaoqun Zhang,
Jeffrey A. Fessler
Abstract:
Statistical image reconstruction (SIR) methods for X-ray CT produce high-quality and accurate images, while greatly reducing patient exposure to radiation. When further reducing X-ray dose to an ultra-low level by lowering the tube current, photon starvation happens and electronic noise starts to dominate, which introduces negative or zero values into the raw measurements. These non-positive value…
▽ More
Statistical image reconstruction (SIR) methods for X-ray CT produce high-quality and accurate images, while greatly reducing patient exposure to radiation. When further reducing X-ray dose to an ultra-low level by lowering the tube current, photon starvation happens and electronic noise starts to dominate, which introduces negative or zero values into the raw measurements. These non-positive values pose challenges to post-log SIR methods that require taking the logarithm of the raw data, and causes artifacts in the reconstructed images if simple correction methods are used to process these non-positive raw measurements. The raw data at ultra-low dose deviates significantly from Poisson or shifted Poisson statistics for pre-log data and from Gaussian statistics for post-log data. This paper proposes a novel SIR method called MPG (mixed Poisson-Gaussian). MPG models the raw noisy measurements using a mixed Poisson-Gaussian distribution that accounts for both the quantum noise and electronic noise. MPG is able to directly use the negative and zero values in raw data without any pre-processing. MPG cost function contains a reweighted least square data-fit term, an edge preserving regularization term and a non-negativity constraint term. We use Alternating Direction Method of Multipliers (ADMM) to separate the MPG optimization problem into several sub-problems that are easier to solve. Our results on 3D simulated cone-beam data set and synthetic helical data set generated from clinical data indicate that the proposed MPG method reduces noise and decreases bias in the reconstructed images, comparing with the conventional filtered back projection (FBP), penalized weighted least-square (PWLS) and shift Poisson (SP) method for ultra-low dose CT (ULDCT) imaging.
△ Less
Submitted 19 January, 2018;
originally announced January 2018.
-
Sparse-View X-Ray CT Reconstruction Using $\ell_1$ Prior with Learned Transform
Authors:
Xuehang Zheng,
Il Yong Chun,
Zhipeng Li,
Yong Long,
Jeffrey A. Fessler
Abstract:
A major challenge in X-ray computed tomography (CT) is reducing radiation dose while maintaining high quality of reconstructed images. To reduce the radiation dose, one can reduce the number of projection views (sparse-view CT); however, it becomes difficult to achieve high-quality image reconstruction as the number of projection views decreases. Researchers have applied the concept of learning sp…
▽ More
A major challenge in X-ray computed tomography (CT) is reducing radiation dose while maintaining high quality of reconstructed images. To reduce the radiation dose, one can reduce the number of projection views (sparse-view CT); however, it becomes difficult to achieve high-quality image reconstruction as the number of projection views decreases. Researchers have applied the concept of learning sparse representations from (high-quality) CT image dataset to the sparse-view CT reconstruction. We propose a new statistical CT reconstruction model that combines penalized weighted-least squares (PWLS) and $\ell_1$ prior with learned sparsifying transform (PWLS-ST-$\ell_1$), and a corresponding efficient algorithm based on Alternating Direction Method of Multipliers (ADMM). To moderate the difficulty of tuning ADMM parameters, we propose a new ADMM parameter selection scheme based on approximated condition numbers. We interpret the proposed model by analyzing the minimum mean square error of its ($\ell_2$-norm relaxed) image update estimator. Our results with the extended cardiac-torso (XCAT) phantom data and clinical chest data show that, for sparse-view 2D fan-beam CT and 3D axial cone-beam CT, PWLS-ST-$\ell_1$ improves the quality of reconstructed images compared to the CT reconstruction methods using edge-preserving regularizer and $\ell_2$ prior with learned ST. These results also show that, for sparse-view 2D fan-beam CT, PWLS-ST-$\ell_1$ achieves comparable or better image quality and requires much shorter runtime than PWLS-DL using a learned overcomplete dictionary. Our results with clinical chest data show that, methods using the unsupervised learned prior generalize better than a state-of-the-art deep "denoising" neural network that does not use a physical imaging model.
△ Less
Submitted 15 September, 2019; v1 submitted 2 November, 2017;
originally announced November 2017.
-
Dictionary-Free MRI PERK: Parameter Estimation via Regression with Kernels
Authors:
Gopal Nataraj,
Jon-Fredrik Nielsen,
Clayton Scott,
Jeffrey A. Fessler
Abstract:
This paper introduces a fast, general method for dictionary-free parameter estimation in quantitative magnetic resonance imaging (QMRI) via regression with kernels (PERK). PERK first uses prior distributions and the nonlinear MR signal model to simulate many parameter-measurement pairs. Inspired by machine learning, PERK then takes these parameter-measurement pairs as labeled training points and l…
▽ More
This paper introduces a fast, general method for dictionary-free parameter estimation in quantitative magnetic resonance imaging (QMRI) via regression with kernels (PERK). PERK first uses prior distributions and the nonlinear MR signal model to simulate many parameter-measurement pairs. Inspired by machine learning, PERK then takes these parameter-measurement pairs as labeled training points and learns from them a nonlinear regression function using kernel functions and convex optimization. PERK admits a simple implementation as per-voxel nonlinear lifting of MRI measurements followed by linear minimum mean-squared error regression. We demonstrate PERK for $T_1,T_2$ estimation, a well-studied application where it is simple to compare PERK estimates against dictionary-based grid search estimates. Numerical simulations as well as single-slice phantom and in vivo experiments demonstrate that PERK and grid search produce comparable $T_1,T_2$ estimates in white and gray matter, but PERK is consistently at least $23\times$ faster. This acceleration factor will increase by several orders of magnitude for full-volume QMRI estimation problems involving more latent parameters per voxel.
△ Less
Submitted 6 October, 2017;
originally announced October 2017.
-
Medical image reconstruction: a brief overview of past milestones and future directions
Authors:
Jeffrey A. Fessler
Abstract:
This paper briefly reviews past milestones in the field of medical image reconstruction and describes some future directions. It is part of an overview paper on "open problems in signal processing" that will appear in IEEE Signal Processing Magazine, but presented here with citations and equations.
This paper briefly reviews past milestones in the field of medical image reconstruction and describes some future directions. It is part of an overview paper on "open problems in signal processing" that will appear in IEEE Signal Processing Magazine, but presented here with citations and equations.
△ Less
Submitted 18 July, 2017;
originally announced July 2017.
