Showing 1–9 of 9 results for author: Betcke, M M

Parallel-in-Time Solutions with Random Projection Neural Networks

Authors: Marta M. Betcke, Lisa Maria Kreusser, Davide Murari

Abstract: This paper considers one of the fundamental parallel-in-time methods for the solution of ordinary differential equations, Parareal, and extends it by adopting a neural network as a coarse propagator. We provide a theoretical analysis of the convergence properties of the proposed algorithm and show its effectiveness for several examples, including Lorenz and Burgers' equations. In our numerical sim… ▽ More This paper considers one of the fundamental parallel-in-time methods for the solution of ordinary differential equations, Parareal, and extends it by adopting a neural network as a coarse propagator. We provide a theoretical analysis of the convergence properties of the proposed algorithm and show its effectiveness for several examples, including Lorenz and Burgers' equations. In our numerical simulations, we further specialize the underpinning neural architecture to Random Projection Neural Networks (RPNNs), a 2-layer neural network where the first layer weights are drawn at random rather than optimized. This restriction substantially increases the efficiency of fitting RPNN's weights in comparison to a standard feedforward network without negatively impacting the accuracy, as demonstrated in the SIR system example. △ Less

Submitted 19 August, 2024; originally announced August 2024.

Photoacoustic Reconstruction Using Sparsity in Curvelet Frame: Image versus Data Domain

Authors: Bolin Pan, Simon R. Arridge, Felix Lucka, Ben T. Cox, Nam Huynh, Paul C. Beard, Edward Z. Zhang, Marta M. Betcke

Abstract: Curvelet frame is of special significance for photoacoustic tomography (PAT) due to its sparsifying and microlocalisation properties. We derive a one-to-one map between wavefront directions in image and data spaces in PAT which suggests near equivalence between the recovery of the initial pressure and PAT data from compressed/subsampled measurements when assuming sparsity in Curvelet frame. As the… ▽ More Curvelet frame is of special significance for photoacoustic tomography (PAT) due to its sparsifying and microlocalisation properties. We derive a one-to-one map between wavefront directions in image and data spaces in PAT which suggests near equivalence between the recovery of the initial pressure and PAT data from compressed/subsampled measurements when assuming sparsity in Curvelet frame. As the latter is computationally more tractable, investigation to which extent this equivalence holds conducted in this paper is of immediate practical significance. To this end we formulate and compare DR, a two step approach based on the recovery of the complete volume of the photoacoustic data from the subsampled data followed by the acoustic inversion, and p0R, a one step approach where the photoacoustic image (the initial pressure, p0) is directly recovered from the subsampled data. Effective representation of the photoacoustic data requires basis defined on the range of the photoacoustic forward operator. To this end we propose a novel wedge-restriction of Curvelet transform which enables us to construct such basis. Both recovery problems are formulated in a variational framework. As the Curvelet frame is heavily overdetermined, we use reweighted l1 norm penalties to enhance the sparsity of the solution. The data reconstruction problem DR is a standard compressed sensing recovery problem, which we solve using an ADMMtype algorithm, SALSA. Subsequently, the initial pressure is recovered using time reversal as implemented in the k-Wave Toolbox. The p0 reconstruction problem, p0R, aims to recover the photoacoustic image directly via FISTA, or ADMM when in addition including a non-negativity constraint. We compare and discuss the relative merits of the two approaches and illustrate them on 2D simulated and 3D real data in a fair and rigorous manner. △ Less

Submitted 6 August, 2021; v1 submitted 25 November, 2020; originally announced November 2020.

Comments: 06 August 2021 (Accepted Version)

Hamilton-Green solver for the forward and adjoint problems in photoacoustic tomography

Authors: Francesc Rullan, Marta M. Betcke

Abstract: The majority of the solvers for the acoustic problem in Photoacoustic Tomography (PAT) rely on full solution of the wave equation which makes them less suitable for real-time and dynamic applications where only partial data is available. This is in contrast to other tomographic modalities, e.g. X-ray tomography, where partial data implies partial cost for the application of the forward and adjoint… ▽ More The majority of the solvers for the acoustic problem in Photoacoustic Tomography (PAT) rely on full solution of the wave equation which makes them less suitable for real-time and dynamic applications where only partial data is available. This is in contrast to other tomographic modalities, e.g. X-ray tomography, where partial data implies partial cost for the application of the forward and adjoint operators. In this work we present a novel solver for the forward and adjoint wave equations for the acoustic problem in PAT. We term the proposed solver Hamilton-Green as it approximates the fundamental solution to the respective wave equation along the trajectories of the Hamiltonian system resulting from the high frequency asymptotics for the wave equation. This approach is fast and scalable in the sense that it allows computing the solution for each sensor independently at a fraction of the cost of the full wave solution. The theoretical foundations of our approach are rooted in results available in seismics and ocean acoustics. We present results for 2D numerical phantom with heterogeneous sound speed which we evaluate against a full wave solution obtained with a pseudospectral method implemented in k-Wave toolbox. △ Less

Submitted 19 June, 2021; v1 submitted 31 October, 2018; originally announced October 2018.

Comments: 35 pages, 15 figures

Choose your path wisely: gradient descent in a Bregman distance framework

Authors: Martin Benning, Marta M. Betcke, Matthias J. Ehrhardt, Carola-Bibiane Schönlieb

Abstract: We propose an extension of a special form of gradient descent -- in the literature known as linearised Bregman iteration -- to a larger class of non-convex functions. We replace the classical (squared) two norm metric in the gradient descent setting with a generalised Bregman distance, based on a proper, convex and lower semi-continuous function. The algorithm's global convergence is proven for fu… ▽ More We propose an extension of a special form of gradient descent -- in the literature known as linearised Bregman iteration -- to a larger class of non-convex functions. We replace the classical (squared) two norm metric in the gradient descent setting with a generalised Bregman distance, based on a proper, convex and lower semi-continuous function. The algorithm's global convergence is proven for functions that satisfy the Kurdyka-Łojasiewicz property. Examples illustrate that features of different scale are being introduced throughout the iteration, transitioning from coarse to fine. This coarse-to-fine approach with respect to scale allows to recover solutions of non-convex optimisation problems that are superior to those obtained with conventional gradient descent, or even projected and proximal gradient descent. The effectiveness of the linearised Bregman iteration in combination with early stopping is illustrated for the applications of parallel magnetic resonance imaging, blind deconvolution as well as image classification with neural networks. △ Less

Submitted 25 May, 2021; v1 submitted 11 December, 2017; originally announced December 2017.

Comments: 29 pages, 6 figures, journal submission

MSC Class: 49M37; 65K05; 65K10; 90C26; 90C30

Gradient descent in a generalised Bregman distance framework

Authors: Martin Benning, Marta M. Betcke, Matthias J. Ehrhardt, Carola-Bibiane Schönlieb

Abstract: We discuss a special form of gradient descent that in the literature has become known as the so-called linearised Bregman iteration. The idea is to replace the classical (squared) two norm metric in the gradient descent setting with a generalised Bregman distance, based on a more general proper, convex and lower semi-continuous functional. Gradient descent as well as the entropic mirror descent by… ▽ More We discuss a special form of gradient descent that in the literature has become known as the so-called linearised Bregman iteration. The idea is to replace the classical (squared) two norm metric in the gradient descent setting with a generalised Bregman distance, based on a more general proper, convex and lower semi-continuous functional. Gradient descent as well as the entropic mirror descent by Nemirovsky and Yudin are special cases, as is a specific form of non-linear Landweber iteration introduced by Bachmayr and Burger. We are going to analyse the linearised Bregman iteration in a setting where the functional we want to minimise is neither necessarily Lipschitz-continuous (in the classical sense) nor necessarily convex, and establish a global convergence result under the additional assumption that the functional we wish to minimise satisfies the so-called Kurdyka-Łojasiewicz property. △ Less

Submitted 27 December, 2016; v1 submitted 7 December, 2016; originally announced December 2016.

Comments: Conference proceedings of '2016 Geometric Numerical Integration and its Applications Maths Conference at La Trobe University, Melbourne Australia', MI Lecture Notes series of Kyushu University, six pages, one figure, program code: https://doi.org/10.17863/CAM.6714

MSC Class: 49M37; 65K05; 65K10; 90C26; 90C30 ACM Class: G.1.0; G.1.6

Acoustic Wave Field Reconstruction from Compressed Measurements with Application in Photoacoustic Tomography

Authors: Marta M. Betcke, Ben T. Cox, Nam Huynh, Edward Z. Zhang, Paul C. Beard, Simon R. Arridge

Abstract: We present a method for the recovery of compressively sensed acoustic fields using patterned, instead of point-by-point, detection. From a limited number of such compressed measurements, we propose to reconstruct the field on the sensor plane in each time step independently assuming its sparsity in a Curvelet frame. A modification of the Curvelet frame is proposed to account for the smoothing effe… ▽ More We present a method for the recovery of compressively sensed acoustic fields using patterned, instead of point-by-point, detection. From a limited number of such compressed measurements, we propose to reconstruct the field on the sensor plane in each time step independently assuming its sparsity in a Curvelet frame. A modification of the Curvelet frame is proposed to account for the smoothing effects of data acquisition and motivated by a frequency domain model for photoacoustic tomography. An ADMM type algorithm, SALSA, is used to recover the pointwise data in each individual time step from the patterned measurements. For photoacoustic applications, the photoacoustic image of the initial pressure is reconstructed using time reversal in ${\bf k}$-Wave Toolbox. △ Less

Submitted 9 September, 2016; originally announced September 2016.

Comments: submitted to IEEE Transactions on Image Processing

On the Adjoint Operator in Photoacoustic Tomography

Authors: Simon R. Arridge, Marta M. Betcke, Ben T. Cox, Felix Lucka, Brad E. Treeby

Abstract: Photoacoustic Tomography (PAT) is an emerging biomedical "imaging from coupled physics" technique, in which the image contrast is due to optical absorption, but the information is carried to the surface of the tissue as ultrasound pulses. Many algorithms and formulae for PAT image reconstruction have been proposed for the case when a complete data set is available. In many practical imaging scenar… ▽ More Photoacoustic Tomography (PAT) is an emerging biomedical "imaging from coupled physics" technique, in which the image contrast is due to optical absorption, but the information is carried to the surface of the tissue as ultrasound pulses. Many algorithms and formulae for PAT image reconstruction have been proposed for the case when a complete data set is available. In many practical imaging scenarios, however, it is not possible to obtain the full data, or the data may be sub-sampled for faster data acquisition. In such cases, image reconstruction algorithms that can incorporate prior knowledge to ameliorate the loss of data are required. Hence, recently there has been an increased interest in using variational image reconstruction. A crucial ingredient for the application of these techniques is the adjoint of the PAT forward operator, which is described in this article from physical, theoretical and numerical perspectives. First, a simple mathematical derivation of the adjoint of the PAT forward operator in the continuous framework is presented. Then, an efficient numerical implementation of the adjoint using a k-space time domain wave propagation model is described and illustrated in the context of variational PAT image reconstruction, on both 2D and 3D examples including inhomogeneous sound speed. The principal advantage of this analytical adjoint over an algebraic adjoint (obtained by taking the direct adjoint of the particular numerical forward scheme used) is that it can be implemented using currently available fast wave propagation solvers. △ Less

Submitted 1 August, 2016; v1 submitted 5 February, 2016; originally announced February 2016.

Comments: submitted to "Inverse Problems"

Multi-Contrast MRI Reconstruction with Structure-Guided Total Variation

Authors: Matthias J. Ehrhardt, Marta M. Betcke

Abstract: Magnetic resonance imaging (MRI) is a versatile imaging technique that allows different contrasts depending on the acquisition parameters. Many clinical imaging studies acquire MRI data for more than one of these contrasts---such as for instance T1 and T2 weighted images---which makes the overall scanning procedure very time consuming. As all of these images show the same underlying anatomy one ca… ▽ More Magnetic resonance imaging (MRI) is a versatile imaging technique that allows different contrasts depending on the acquisition parameters. Many clinical imaging studies acquire MRI data for more than one of these contrasts---such as for instance T1 and T2 weighted images---which makes the overall scanning procedure very time consuming. As all of these images show the same underlying anatomy one can try to omit unnecessary measurements by taking the similarity into account during reconstruction. We will discuss two modifications of total variation---based on i) location and ii) direction---that take structural a priori knowledge into account and reduce to total variation in the degenerate case when no structural knowledge is available. We solve the resulting convex minimization problem with the alternating direction method of multipliers that separates the forward operator from the prior. For both priors the corresponding proximal operator can be implemented as an extension of the fast gradient projection method on the dual problem for total variation. We tested the priors on six data sets that are based on phantoms and real MRI images. In all test cases exploiting the structural information from the other contrast yields better results than separate reconstruction with total variation in terms of standard metrics like peak signal-to-noise ratio and structural similarity index. Furthermore, we found that exploiting the two dimensional directional information results in images with well defined edges, superior to those reconstructed solely using a priori information about the edge location. △ Less

Submitted 20 November, 2015; originally announced November 2015.

Comments: 18 pages, 16 figures

A priorconditioned LSQR algorithm for linear ill-posed problems with edge-preserving regularization

Authors: Simon R. Arridge, Marta M. Betcke, Lauri Harhanen

Abstract: This article presents a method for solving large-scale linear inverse problems regular- ized with a nonlinear, edge-preserving penalty term such as the total variation or Perona-Malik. In the proposed scheme, the nonlinearity is handled with lagged diffusivity fixed point iteration which involves solving a large-scale linear least squares problem in each iteration. Because the convergence of Krylo… ▽ More This article presents a method for solving large-scale linear inverse problems regular- ized with a nonlinear, edge-preserving penalty term such as the total variation or Perona-Malik. In the proposed scheme, the nonlinearity is handled with lagged diffusivity fixed point iteration which involves solving a large-scale linear least squares problem in each iteration. Because the convergence of Krylov methods for problems with discontinuities is notoriously slow, we propose to accelerate it by means of priorconditioning. Priorconditioning is a technique which embeds the information contained in the prior (expressed as a regularizer in Bayesian framework) directly into the forward operator and hence into the solution space. We derive a factorization-free priorconditioned LSQR algorithm, allowing implicit application of the preconditioner through efficient schemes such as multigrid. The resulting method is matrix-free i.e. the forward map can be defined through its action on a vector. We demonstrate the effectiveness of the proposed scheme on a three-dimensional problem in fluorescence diffuse optical tomography using algebraic multigrid preconditioner. △ Less

Submitted 29 August, 2013; originally announced August 2013.