Showing 1–6 of 6 results for author: Shastri, S K

Solving Inverse Problems using Diffusion with Iterative Colored Renoising

Authors: Matt C. Bendel, Saurav K. Shastri, Rizwan Ahmad, Philip Schniter

Abstract: Imaging inverse problems can be solved in an unsupervised manner using pre-trained diffusion models, but doing so requires approximating the gradient of the measurement-conditional score function in the diffusion reverse process. We show that the approximations produced by existing methods are relatively poor, especially early in the reverse process, and so we propose a new approach that iterative… ▽ More Imaging inverse problems can be solved in an unsupervised manner using pre-trained diffusion models, but doing so requires approximating the gradient of the measurement-conditional score function in the diffusion reverse process. We show that the approximations produced by existing methods are relatively poor, especially early in the reverse process, and so we propose a new approach that iteratively reestimates and "renoises" the estimate several times per diffusion step. This iterative approach, which we call Fast Iterative REnoising (FIRE), injects colored noise that is shaped to ensure that the pre-trained diffusion model always sees white noise, in accordance with how it was trained. We then embed FIRE into the DDIM reverse process and show that the resulting "DDfire" offers state-of-the-art accuracy and runtime on several linear inverse problems, as well as phase retrieval. Our implementation is at https://github.com/matt-bendel/DDfire △ Less

Submitted 13 April, 2025; v1 submitted 29 January, 2025; originally announced January 2025.

Fast and Robust Phase Retrieval via Deep Expectation-Consistent Approximation

Authors: Saurav K. Shastri, Philip Schniter

Abstract: Accurately recovering images from phaseless measurements is a challenging and long-standing problem. In this work, we present "deepECpr," which combines expectation-consistent (EC) approximation with deep denoising networks to surpass state-of-the-art phase-retrieval methods in both speed and accuracy. In addition to applying EC in a non-traditional manner, deepECpr includes a novel stochastic dam… ▽ More Accurately recovering images from phaseless measurements is a challenging and long-standing problem. In this work, we present "deepECpr," which combines expectation-consistent (EC) approximation with deep denoising networks to surpass state-of-the-art phase-retrieval methods in both speed and accuracy. In addition to applying EC in a non-traditional manner, deepECpr includes a novel stochastic damping scheme that is inspired by recent diffusion methods. Like existing phase-retrieval methods based on plug-and-play priors, regularization by denoising, or diffusion, deepECpr iterates a denoising stage with a measurement-exploitation stage. But unlike existing methods, deepECpr requires far fewer denoiser calls. We compare deepECpr to the state-of-the-art prDeep (Metzler et al., 2018), Deep-ITA (Wang et al., 2020), DOLPH (Shoushtari et al., 2023), and Diffusion Posterior Sampling (Chung et al., 2023) methods for noisy phase-retrieval of color, natural, and unnatural grayscale images on oversampled-Fourier and coded-diffraction-pattern measurements and find improvements in both PSNR and SSIM with significantly fewer denoiser calls. △ Less

Submitted 26 November, 2024; v1 submitted 12 July, 2024; originally announced July 2024.

Denoising Generalized Expectation-Consistent Approximation for MR Image Recovery

Authors: Saurav K. Shastri, Rizwan Ahmad, Christopher A. Metzler, Philip Schniter

Abstract: To solve inverse problems, plug-and-play (PnP) methods replace the proximal step in a convex optimization algorithm with a call to an application-specific denoiser, often implemented using a deep neural network (DNN). Although such methods yield accurate solutions, they can be improved. For example, denoisers are usually designed/trained to remove white Gaussian noise, but the denoiser input error… ▽ More To solve inverse problems, plug-and-play (PnP) methods replace the proximal step in a convex optimization algorithm with a call to an application-specific denoiser, often implemented using a deep neural network (DNN). Although such methods yield accurate solutions, they can be improved. For example, denoisers are usually designed/trained to remove white Gaussian noise, but the denoiser input error in PnP algorithms is usually far from white or Gaussian. Approximate message passing (AMP) methods provide white and Gaussian denoiser input error, but only when the forward operator is sufficiently random. In this work, for Fourier-based forward operators, we propose a PnP algorithm based on generalized expectation-consistent (GEC) approximation -- a close cousin of AMP -- that offers predictable error statistics at each iteration, as well as a new DNN denoiser that leverages those statistics. We apply our approach to magnetic resonance (MR) image recovery and demonstrate its advantages over existing PnP and AMP methods. △ Less

Submitted 7 September, 2022; v1 submitted 8 June, 2022; originally announced June 2022.

Expectation Consistent Plug-and-Play for MRI

Authors: Saurav K Shastri, Rizwan Ahmad, Christopher A Metzler, Philip Schniter

Abstract: For image recovery problems, plug-and-play (PnP) methods have been developed that replace the proximal step in an optimization algorithm with a call to an application-specific denoiser, often implemented using a deep neural network. Although such methods have been successful, they can be improved. For example, the denoiser is often trained using white Gaussian noise, while PnP's denoiser input err… ▽ More For image recovery problems, plug-and-play (PnP) methods have been developed that replace the proximal step in an optimization algorithm with a call to an application-specific denoiser, often implemented using a deep neural network. Although such methods have been successful, they can be improved. For example, the denoiser is often trained using white Gaussian noise, while PnP's denoiser input error is often far from white and Gaussian, with statistics that are difficult to predict from iteration to iteration. PnP methods based on approximate message passing (AMP) are an exception, but only when the forward operator behaves like a large random matrix. In this work, we design a PnP method using the expectation consistent (EC) approximation algorithm, a generalization of AMP, that offers predictable error statistics at each iteration, from which a deep-net denoiser can be effectively trained. △ Less

Submitted 11 February, 2022; originally announced February 2022.

Autotuning Plug-and-Play Algorithms for MRI

Authors: Saurav K. Shastri, Rizwan Ahmad, Philip Schniter

Abstract: For magnetic resonance imaging (MRI), recently proposed "plug-and-play" (PnP) image recovery algorithms have shown remarkable performance. These PnP algorithms are similar to traditional iterative algorithms like FISTA, ADMM, or primal-dual splitting (PDS), but differ in that the proximal update is replaced by a call to an application-specific image denoiser, such as BM3D or DnCNN. The fixed-point… ▽ More For magnetic resonance imaging (MRI), recently proposed "plug-and-play" (PnP) image recovery algorithms have shown remarkable performance. These PnP algorithms are similar to traditional iterative algorithms like FISTA, ADMM, or primal-dual splitting (PDS), but differ in that the proximal update is replaced by a call to an application-specific image denoiser, such as BM3D or DnCNN. The fixed-points of PnP algorithms depend upon an algorithmic stepsize parameter, however, which must be tuned for optimal performance. In this work, we propose a fast and robust auto-tuning PnP-PDS algorithm that exploits knowledge of the measurement-noise variance that is available from a pre-scan in MRI. Experimental results show that our algorithm converges very close to genie-tuned performance, and does so significantly faster than existing autotuning approaches. △ Less

Submitted 1 December, 2020; originally announced December 2020.

Generalized Design of Sampling Kernels for 2-D FRI Signals

Authors: Saurav Kumaraswami Shastri, Sunil Rudresh, Chandra Sekhar Seelamantula

Abstract: One of the interesting problems in the finite-rate-of-innovation signal sampling framework is the design of compactly supported sampling kernels. In this paper, we present a generic framework for designing sampling kernels in 2-D. We consider both separable and nonseparable kernels. The design is carried out in the frequency domain, where a set of alias cancellation conditions are imposed on the k… ▽ More One of the interesting problems in the finite-rate-of-innovation signal sampling framework is the design of compactly supported sampling kernels. In this paper, we present a generic framework for designing sampling kernels in 2-D. We consider both separable and nonseparable kernels. The design is carried out in the frequency domain, where a set of alias cancellation conditions are imposed on the kernel's frequency response. The Paley-Wiener theorem for 2-D signals is invoked to arrive at admissible kernels with a compact support. As a specific case, we show that a certain separable extension of the 1-D design framework results in 2-D sum-of-modulated-spline (SMS) kernels. Similar to their 1-D counterparts, the 2-D SMS kernels have the attractive feature of reproducing a class of 2-D polynomial-modulated exponentials of a desired order. Also, the support of the kernels is independent of the order. The design framework is generic and also allows one to design nonseparable sampling kernels. To this end, we demonstrate the design of a nonseparable kernel and present simulation results. △ Less

Submitted 19 February, 2019; v1 submitted 7 February, 2019; originally announced February 2019.