-
On the convergence analysis of one-shot inversion methods
Authors:
Marcella Bonazzoli,
Houssem Haddar,
Tuan Anh Vu
Abstract:
When an inverse problem is solved by a gradient-based optimization algorithm, the corresponding forward and adjoint problems, which are introduced to compute the gradient, can be also solved iteratively. The idea of iterating at the same time on the inverse problem unknown and on the forward and adjoint problem solutions yields the concept of one-shot inversion methods. We are especially intereste…
▽ More
When an inverse problem is solved by a gradient-based optimization algorithm, the corresponding forward and adjoint problems, which are introduced to compute the gradient, can be also solved iteratively. The idea of iterating at the same time on the inverse problem unknown and on the forward and adjoint problem solutions yields the concept of one-shot inversion methods. We are especially interested in the case where the inner iterations for the direct and adjoint problems are incomplete, that is, stopped before achieving a high accuracy on their solutions. Here, we focus on general linear inverse problems and generic fixed-point iterations for the associated forward problem. We analyze variants of the so-called multi-step one-shot methods, in particular semi-implicit schemes with a regularization parameter. We establish sufficient conditions on the descent step for convergence, by studying the eigenvalues of the block matrix of the coupled iterations. Several numerical experiments are provided to illustrate the convergence of these methods in comparison with the classical gradient descent, where the forward and adjoint problems are solved exactly by a direct solver instead. We observe that very few inner iterations are enough to guarantee good convergence of the inversion algorithm, even in the presence of noisy data.
△ Less
Submitted 11 April, 2024;
originally announced April 2024.
-
Multi-domain FEM-BEM coupling for acoustic scattering
Authors:
Marcella Bonazzoli,
Xavier Claeys
Abstract:
We model time-harmonic acoustic scattering by an object composed of piece-wise homogeneous parts and an arbitrarily heterogeneous part. We propose and analyze new formulations that couple, adopting a Costabel-type approach, boundary integral equations for the homogeneous subdomains with volume variational formulations for the heterogeneous subdomain. This is an extension of the Costabel FEM-BEM co…
▽ More
We model time-harmonic acoustic scattering by an object composed of piece-wise homogeneous parts and an arbitrarily heterogeneous part. We propose and analyze new formulations that couple, adopting a Costabel-type approach, boundary integral equations for the homogeneous subdomains with volume variational formulations for the heterogeneous subdomain. This is an extension of the Costabel FEM-BEM coupling to a multi-domain configuration, with cross-points allowed, i.e. points where three or more subdomains are adjacent. While generally just the exterior unbounded subdomain is treated with the BEM, here we wish to exploit the advantages of BEM whenever it is applicable, that is, for all the homogeneous parts of the scattering object. Our formulation is based on the multi-trace formalism, which initially was introduced for acoustic scattering by piece-wise homogeneous objects. Instead, here we allow the wavenumber to vary arbitrarily in a part of the domain. We prove that the bilinear form associated with the proposed formulation satisfies a Gårding coercivity inequality, which ensures stability of the variational problem if it is uniquely solvable. We identify conditions for injectivity and construct modified versions immune to spurious resonances.
△ Less
Submitted 26 April, 2024; v1 submitted 16 May, 2023;
originally announced May 2023.
-
How does the partition of unity influence SORAS preconditioner?
Authors:
Marcella Bonazzoli,
Xavier Claeys,
Frédéric Nataf,
Pierre-Henri Tournier
Abstract:
We investigate the influence of the choice of the partition of unity on the convergence of the Symmetrized Optimized Restricted Additive Schwarz (SORAS) preconditioner for the reaction-convection-diffusion equation. We focus on two kinds of partitions of unity, and study the dependence on the overlap and on the number of subdomains. In particular, the second kind of partition of unity, which is no…
▽ More
We investigate the influence of the choice of the partition of unity on the convergence of the Symmetrized Optimized Restricted Additive Schwarz (SORAS) preconditioner for the reaction-convection-diffusion equation. We focus on two kinds of partitions of unity, and study the dependence on the overlap and on the number of subdomains. In particular, the second kind of partition of unity, which is non-zero in the interior of the whole overlapping region, gives more favorable convergence properties, especially when increasing the overlap width, in comparison with the first kind of partition of unity, whose gradient is zero on the subdomain interfaces and which would be the natural choice for ORAS solver instead.
△ Less
Submitted 24 April, 2023; v1 submitted 6 December, 2022;
originally announced December 2022.
-
Convergence analysis of multi-step one-shot methods for linear inverse problems
Authors:
Marcella Bonazzoli,
Houssem Haddar,
Tuan Anh Vu
Abstract:
In this work we are interested in general linear inverse problems where the corresponding forward problem is solved iteratively using fixed point methods. Then one-shot methods, which iterate at the same time on the forward problem solution and on the inverse problem unknown, can be applied. We analyze two variants of the so-called multi-step one-shot methods and establish sufficient conditions on…
▽ More
In this work we are interested in general linear inverse problems where the corresponding forward problem is solved iteratively using fixed point methods. Then one-shot methods, which iterate at the same time on the forward problem solution and on the inverse problem unknown, can be applied. We analyze two variants of the so-called multi-step one-shot methods and establish sufficient conditions on the descent step for their convergence, by studying the eigenvalues of the block matrix of the coupled iterations. Several numerical experiments are provided to illustrate the convergence of these methods in comparison with the classical usual and shifted gradient descent. In particular, we observe that very few inner iterations on the forward problem are enough to guarantee good convergence of the inversion algorithm.
△ Less
Submitted 26 July, 2022; v1 submitted 21 July, 2022;
originally announced July 2022.
-
Analysis of the SORAS domain decomposition preconditioner for non-self-adjoint or indefinite problems
Authors:
Marcella Bonazzoli,
Xavier Claeys,
Frédéric Nataf,
Pierre-Henri Tournier
Abstract:
We analyze the convergence of the one-level overlapping domain decomposition preconditioner SORAS (Symmetrized Optimized Restricted Additive Schwarz) applied to a generic linear system whose matrix is not necessarily symmetric/self-adjoint nor positive definite. By generalizing the theory for the Helmholtz equation developed in [I.G. Graham, E.A. Spence, and J. Zou, SIAM J.Numer.Anal., 2020], we i…
▽ More
We analyze the convergence of the one-level overlapping domain decomposition preconditioner SORAS (Symmetrized Optimized Restricted Additive Schwarz) applied to a generic linear system whose matrix is not necessarily symmetric/self-adjoint nor positive definite. By generalizing the theory for the Helmholtz equation developed in [I.G. Graham, E.A. Spence, and J. Zou, SIAM J.Numer.Anal., 2020], we identify a list of assumptions and estimates that are sufficient to obtain an upper bound on the norm of the preconditioned matrix, and a lower bound on the distance of its field of values from the origin. We stress that our theory is general in the sense that it is not specific to one particular boundary value problem. Moreover, it does not rely on a coarse mesh whose elements are sufficiently small. As an illustration of this framework, we prove new estimates for overlapping domain decomposition methods with Robin-type transmission conditions for the heterogeneous reaction-convection-diffusion equation (to prove the stability assumption for this equation we consider the case of a coercive bilinear form, which is non-symmetric, though).
△ Less
Submitted 27 May, 2021; v1 submitted 20 March, 2020;
originally announced March 2020.
-
An example of explicit implementation strategy and preconditioning for the high order edge finite elements applied to the time-harmonic Maxwell's equations
Authors:
Marcella Bonazzoli,
Victorita Dolean,
Frédéric Hecht,
Francesca Rapetti
Abstract:
In this paper we focus on high order finite element approximations of the electric field combined with suitable preconditioners, to solve the time-harmonic Maxwell's equations in waveguide configurations.The implementation of high order curl-conforming finite elements is quite delicate, especially in the three-dimensional case. Here, we explicitly describe an implementation strategy, which has be…
▽ More
In this paper we focus on high order finite element approximations of the electric field combined with suitable preconditioners, to solve the time-harmonic Maxwell's equations in waveguide configurations.The implementation of high order curl-conforming finite elements is quite delicate, especially in the three-dimensional case. Here, we explicitly describe an implementation strategy, which has been embedded in the open source finite element software FreeFem++ (http://www.freefem.org/ff++/). In particular, we use the inverse of a generalized Vandermonde matrix to build basis functions in duality with the degrees of freedom, resulting in an easy-to-use but powerful interpolation operator. We carefully address the problem of applying the same Vandermonde matrix to possibly differently oriented tetrahedra of the mesh over the computational domain. We investigate the preconditioning for Maxwell's equations in the time-harmonic regime, which is an underdeveloped issue in the literature, particularly for high order discretizations. In the numerical experiments, we study the effect of varying several parameters on the spectrum of the matrix preconditioned with overlapping Schwarz methods, both for 2d and 3d waveguide configurations.
△ Less
Submitted 18 November, 2017; v1 submitted 14 November, 2017;
originally announced November 2017.
-
Domain decomposition preconditioning for the high-frequency time-harmonic Maxwell equations with absorption
Authors:
Marcella Bonazzoli,
Victorita Dolean,
Ivan G. Graham,
Euan A. Spence,
Pierre-Henri Tournier
Abstract:
This paper rigorously analyses preconditioners for the time-harmonic Maxwell equations with absorption, where the PDE is discretised using curl-conforming finite-element methods of fixed, arbitrary order and the preconditioner is constructed using Additive Schwarz domain decomposition methods. The theory developed here shows that if the absorption is large enough, and if the subdomain and coarse m…
▽ More
This paper rigorously analyses preconditioners for the time-harmonic Maxwell equations with absorption, where the PDE is discretised using curl-conforming finite-element methods of fixed, arbitrary order and the preconditioner is constructed using Additive Schwarz domain decomposition methods. The theory developed here shows that if the absorption is large enough, and if the subdomain and coarse mesh diameters and overlap are chosen appropriately, then the classical two-level overlapping Additive Schwarz preconditioner (with PEC boundary conditions on the subdomains) performs optimally -- in the sense that GMRES converges in a wavenumber-independent number of iterations -- for the problem with absorption. An important feature of the theory is that it allows the coarse space to be built from low-order elements even if the PDE is discretised using high-order elements. It also shows that additive methods with minimal overlap can be robust. Numerical experiments are given that illustrate the theory and its dependence on various parameters. These experiments motivate some extensions of the preconditioners which have better robustness for problems with less absorption, including the propagative case. At the end of the paper we illustrate the performance of these on two substantial applications; the first (a problem with absorption arising from medical imaging) shows the empirical robustness of the preconditioner against heterogeneity, and the second (scattering by a COBRA cavity) shows good scalability of the preconditioner with up to 3,000 processors.
△ Less
Submitted 6 March, 2019; v1 submitted 10 November, 2017;
originally announced November 2017.
-
Two-level preconditioners for the Helmholtz equation
Authors:
Marcella Bonazzoli,
Victorita Dolean,
Ivan Graham,
Euan Spence,
Pierre-Henri Tournier
Abstract:
In this paper we compare numerically two different coarse space definitions for two-level domain decomposition preconditioners for the Helmholtz equation, both in two and three dimensions. While we solve the pure Helmholtz problem without absorption, the preconditioners are built from problems with absorption. In the first method, the coarse space is based on the discretization of the problem with…
▽ More
In this paper we compare numerically two different coarse space definitions for two-level domain decomposition preconditioners for the Helmholtz equation, both in two and three dimensions. While we solve the pure Helmholtz problem without absorption, the preconditioners are built from problems with absorption. In the first method, the coarse space is based on the discretization of the problem with absorption on a coarse mesh, with diameter constrained by the wavenumber. In the second method, the coarse space is built by solving local eigenproblems involving the Dirichlet-to-Neumann (DtN) operator.
△ Less
Submitted 21 February, 2018; v1 submitted 23 May, 2017;
originally announced May 2017.
-
A two-level domain-decomposition preconditioner for the time-harmonic Maxwell's equations
Authors:
Marcella Bonazzoli,
Victorita Dolean,
Ivan Graham,
Euan Spence,
Pierre-Henri Tournier
Abstract:
The construction of fast iterative solvers for the indefinite time-harmonic Maxwell's system at mid- to high-frequency is a problem of great current interest. Some of the difficulties that arise are similar to those encountered in the case of the mid- to high-frequency Helmholtz equation. Here we investigate how two-level domain-decomposition preconditioners recently proposed for the Helmholtz equ…
▽ More
The construction of fast iterative solvers for the indefinite time-harmonic Maxwell's system at mid- to high-frequency is a problem of great current interest. Some of the difficulties that arise are similar to those encountered in the case of the mid- to high-frequency Helmholtz equation. Here we investigate how two-level domain-decomposition preconditioners recently proposed for the Helmholtz equation work in the Maxwell case, both from the theoretical and numerical points of view.
△ Less
Submitted 21 February, 2018; v1 submitted 23 May, 2017;
originally announced May 2017.
-
Explicit implementation strategy of high order edge finite elements and Schwarz preconditioning for the time-harmonic Maxwell's equations
Authors:
Marcella Bonazzoli,
Victorita Dolean,
Frédéric Hecht,
Francesca Rapetti
Abstract:
In this paper we focus on high order finite element approximations of the electric field combined with suitable preconditioners, to solve the time-harmonic Maxwell's equations in waveguide configurations. The implementation of high order curl-conforming finite elements is quite delicate, especially in the three-dimensional case. Here, we explicitly describe an implementation strategy, which has be…
▽ More
In this paper we focus on high order finite element approximations of the electric field combined with suitable preconditioners, to solve the time-harmonic Maxwell's equations in waveguide configurations. The implementation of high order curl-conforming finite elements is quite delicate, especially in the three-dimensional case. Here, we explicitly describe an implementation strategy, which has been embedded in the open source finite element software FreeFem++ (http://www.freefem.org/ff++/). In particular, we use the inverse of a generalized Vandermonde matrix to build a basis of generators in duality with the degrees of freedom, resulting in an easy-to-use but powerful interpolation operator. We carefully address the problem of applying the same Vandermonde matrix to possibly differently oriented tetrahedra of the mesh over the computational domain. We investigate the preconditioning for Maxwell's equations in the time-harmonic regime, which is an underdeveloped issue in the literature, particularly for high order discretizations. In the numerical experiments, we study the effect of varying several parameters on the spectrum of the matrix preconditioned with overlapping Schwarz methods, both for 2d and 3d waveguide configurations.
△ Less
Submitted 14 May, 2017; v1 submitted 15 May, 2016;
originally announced May 2016.