Showing 1–49 of 49 results for author: Gander, M J

Discontinuous Galerkin time integration for second-order differential problems: formulations, analysis, and analogies

Authors: Gabriele Ciaramella, Martin J. Gander, Ilario Mazzieri

Abstract: We thoroughly investigate Discontinuous Galerkin (DG) discretizations as time integrators for second-order oscillatory systems, considering both second-order and first-order formulations of the original problem. Key contributions include new convergence analyses for the second-order formulation and equivalence proofs between DG and classical time-stepping schemes (such as Newmark schemes and gener… ▽ More We thoroughly investigate Discontinuous Galerkin (DG) discretizations as time integrators for second-order oscillatory systems, considering both second-order and first-order formulations of the original problem. Key contributions include new convergence analyses for the second-order formulation and equivalence proofs between DG and classical time-stepping schemes (such as Newmark schemes and general linear methods). In addition, the chapter provides a detailed review and convergence analysis for the first-order formulation, alongside comparisons of the proposed schemes in terms of accuracy, consistency, and computational cost. △ Less

Submitted 9 May, 2025; originally announced May 2025.

On an efficient line smoother for the p-multigrid γ-cycle

Authors: José Pablo Lucero Lorca, Duane Rosenberg, Isidora Jankov, Conor McCoid, Martin Jakob Gander

Abstract: As part of the development of a Poisson solver for the spectral element discretization used in the GeoFluid Object Workbench (GeoFLOW) code, we propose a solver for the linear system arising from a Gauss-Legendre-Lobatto global spectral method. We precondition using a p-multigrid γ-cycle with highly-vectorizable smoothers, that we refer to as line smoothers. Our smoothers are restrictions of spect… ▽ More As part of the development of a Poisson solver for the spectral element discretization used in the GeoFluid Object Workbench (GeoFLOW) code, we propose a solver for the linear system arising from a Gauss-Legendre-Lobatto global spectral method. We precondition using a p-multigrid γ-cycle with highly-vectorizable smoothers, that we refer to as line smoothers. Our smoothers are restrictions of spectral and finite element discretizations to low-order one-dimensional problems along lines, that are solved by a reformulation of cyclic reduction as a direct multigrid method. We illustrate our method with numerical experiments showing the apparent boundedness of the iteration count for a fixed residual reduction over a range of moderately deformed domains, right hand sides and Dirichlet boundary conditions. △ Less

Submitted 14 April, 2025; originally announced April 2025.

MSC Class: 65N35

Time parallelization for hyperbolic and parabolic problems

Authors: Martin J. Gander, Shu-Lin Wu, Tao Zhou

Abstract: Time parallelization, also known as PinT (Parallel-in-Time) is a new research direction for the development of algorithms used for solving very large scale evolution problems on highly parallel computing architectures. Despite the fact that interesting theoretical work on PinT appeared as early 1964, it was not until 2004, when processor clock speeds reached their physical limit, that research in… ▽ More Time parallelization, also known as PinT (Parallel-in-Time) is a new research direction for the development of algorithms used for solving very large scale evolution problems on highly parallel computing architectures. Despite the fact that interesting theoretical work on PinT appeared as early 1964, it was not until 2004, when processor clock speeds reached their physical limit, that research in PinT took off. A distinctive characteristic of parallelization in time is that information flow only goes forward in time, meaning that time evolution processes seem necessarily to be sequential. Nevertheless, many algorithms have been developed over the last two decades to do PinT computations, and they are often grouped into four basic classes according to how the techniques work and are used: shooting-type methods; waveform relaxation methods based on domain decomposition; multigrid methods in space-time; and direct time parallel methods. However, over the past few years, it has been recognized that highly successful PinT algorithms for parabolic problems struggle when applied to hyperbolic problems. We focus in this survey therefore on this important aspect, by first providing a summary of the fundamental differences between parabolic and hyperbolic problems for time parallelization. We then group PinT algorithms into two basic groups: the first group contains four effective PinT techniques for hyperbolic problems, namely Schwarz Waveform Relaxation with its relation to Tent Pitching; Parallel Integral Deferred Correction; ParaExp; and ParaDiag. While the methods in the first group also work well for parabolic problems, we then present PinT methods especially designed for parabolic problems in the second group: Parareal: the Parallel Full Approximation Scheme in Space-Time; Multigrid Reduction in Time; and Space-Time Multigrid. △ Less

Submitted 14 March, 2025; originally announced March 2025.

Comments: 107 pages; this paper is accepted for publication in Acta Numerica

MSC Class: 65M55; 65M12; 65M15; 65Y05

Journal ref: Vol. 4, Acta Numerica, pp. 1-107, 2025

Natural damping of time-harmonic waves and its influence on Schwarz methods

Authors: Martin J. Gander, Hui Zhang

Abstract: The influence of various damping on the performance of Schwarz methods for time-harmonic waves is visualized by Fourier analysis. The influence of various damping on the performance of Schwarz methods for time-harmonic waves is visualized by Fourier analysis. △ Less

Submitted 19 February, 2025; originally announced February 2025.

Comments: 8 pages, submitted to the 28th International Conference on Domain Decomposition Methods

Fourier Analysis of Finite Difference Schemes for the Helmholtz Equation: Sharp Estimates and Relative Errors

Authors: Martin J. Gander, Hui Zhang

Abstract: We propose an approach based on Fourier analysis to wavenumber explicit sharp estimation of absolute and relative errors of finite difference methods for the Helmholtz equation. We use the approach to analyze the classical centred scheme for the Helmholtz equation with a general smooth source term and Dirichlet boundary conditions in 1D. For the Fourier interpolants of the discrete solution with h… ▽ More We propose an approach based on Fourier analysis to wavenumber explicit sharp estimation of absolute and relative errors of finite difference methods for the Helmholtz equation. We use the approach to analyze the classical centred scheme for the Helmholtz equation with a general smooth source term and Dirichlet boundary conditions in 1D. For the Fourier interpolants of the discrete solution with homogeneous (or inhomogeneous) Dirichlet conditions, we show rigorously that the worst case attainable convergence order of the absolute error is k2h2 (or k3h2) in the L2-norm and k3h2 (or k4h2) in the H1-semi-norm, and that of the relative error is k3h2 in both L2- and H1-semi-norms. Even though the classical centred scheme is well-known, it is the first time that such sharp estimates of absolute and relative errors are obtained. We show also that the Fourier analysis approach can be used as a convenient visual tool for evaluating finite difference schemes in presence of source terms, which is beyond the scope of dispersion analysis. △ Less

Submitted 27 January, 2025; originally announced January 2025.

Comments: 30 pages, 21 figures

MSC Class: 65N06; 65N12; 65N15

A Parareal algorithm without Coarse Propagator?

Authors: Martin J. Gander, Mario Ohlberger, Stephan Rave

Abstract: The Parareal algorithm was invented in 2001 in order to parallelize the solution of evolution problems in the time direction. It is based on parallel fine time propagators called F and sequential coarse time propagators called G, which alternatingly solve the evolution problem and iteratively converge to the fine solution. The coarse propagator G is a very important component of Parareal, as one s… ▽ More The Parareal algorithm was invented in 2001 in order to parallelize the solution of evolution problems in the time direction. It is based on parallel fine time propagators called F and sequential coarse time propagators called G, which alternatingly solve the evolution problem and iteratively converge to the fine solution. The coarse propagator G is a very important component of Parareal, as one sees in the convergence analyses. We present here for the first time a Parareal algorithm without coarse propagator, and explain why this can work very well for parabolic problems. We give a new convergence proof for coarse propagators approximating in space, in contrast to the more classical coarse propagators which are approximations in time, and our proof also applies in the absence of the coarse propagator. We illustrate our theoretical results with numerical experiments, and also explain why this approach can not work for hyperbolic problems. △ Less

Submitted 4 September, 2024; originally announced September 2024.

Non-overlapping Schwarz methods in time for parabolic optimal control problems

Authors: Martin Jakob Gander, Liu-Di Lu

Abstract: We present here the classical Schwarz method with a time domain decomposition applied to unconstrained parabolic optimal control problems. Unlike Dirichlet-Neumann and Neumann-Neumann algorithms, we find different properties based on the forward-backward structure of the optimality system. Variants can be found using only Dirichlet and Neumann transmission conditions. Some of these variants are on… ▽ More We present here the classical Schwarz method with a time domain decomposition applied to unconstrained parabolic optimal control problems. Unlike Dirichlet-Neumann and Neumann-Neumann algorithms, we find different properties based on the forward-backward structure of the optimality system. Variants can be found using only Dirichlet and Neumann transmission conditions. Some of these variants are only good smoothers, while others could lead to efficient solvers. △ Less

Submitted 22 August, 2024; originally announced August 2024.

Comments: 28th International Conference on Domain Decomposition Methods (DD28)

New time domain decomposition methods for parabolic optimal control problems II: Neumann-Neumann algorithms

Authors: Martin Jakob Gander, Liu-Di Lu

Abstract: We present new Neumann-Neumann algorithms based on a time domain decomposition applied to unconstrained parabolic optimal control problems. After a spatial semi-discretization, the Lagrange multiplier approach provides a coupled forward-backward optimality system, which can be solved using a time domain decomposition. Due to the forward-backward structure of the optimality system, nine variants ca… ▽ More We present new Neumann-Neumann algorithms based on a time domain decomposition applied to unconstrained parabolic optimal control problems. After a spatial semi-discretization, the Lagrange multiplier approach provides a coupled forward-backward optimality system, which can be solved using a time domain decomposition. Due to the forward-backward structure of the optimality system, nine variants can be found for the Neumann-Neumann algorithms. We analyze their convergence behavior and determine the optimal relaxation parameter for each algorithm. Our analysis reveals that the most natural algorithms are actually only good smoothers, and there are better choices which lead to efficient solvers. We illustrate our analysis with numerical experiments. △ Less

Submitted 27 January, 2024; originally announced January 2024.

MSC Class: 65M12; 65M55; 65Y05

New time domain decomposition methods for parabolic control problems I: Dirichlet-Neumann and Neumann-Dirichlet algorithms

Authors: Martin Jakob Gander, Liu-Di Lu

Abstract: We present new Dirichlet-Neumann and Neumann-Dirichlet algorithms with a time domain decomposition applied to unconstrained parabolic optimal control problems. After a spatial semi-discretization, we use the Lagrange multiplier approach to derive a coupled forward-backward optimality system, which can then be solved using a time domain decomposition. Due to the forward-backward structure of the op… ▽ More We present new Dirichlet-Neumann and Neumann-Dirichlet algorithms with a time domain decomposition applied to unconstrained parabolic optimal control problems. After a spatial semi-discretization, we use the Lagrange multiplier approach to derive a coupled forward-backward optimality system, which can then be solved using a time domain decomposition. Due to the forward-backward structure of the optimality system, three variants can be found for the Dirichlet-Neumann and Neumann-Dirichlet algorithms. We analyze their convergence behavior and determine the optimal relaxation parameter for each algorithm. Our analysis reveals that the most natural algorithms are actually only good smoothers, and there are better choices which lead to efficient solvers. We illustrate our analysis with numerical experiments. △ Less

Submitted 24 August, 2023; originally announced August 2023.

MSC Class: 65M12; 65M55; 65Y05

Dirichlet-Neumann and Neumann-Neumann Methods for Elliptic Control Problems

Authors: Martin Jakob Gander, Liu-Di Lu

Abstract: We present the Dirichlet-Neumann (DN) and Neumann-Neumann (NN) methods applied to the optimal control problems arising from elliptic partial differential equations (PDEs) under the $H^{-1}$ regularization. We use the Lagrange multiplier approach to derive a forward-backward optimality system with the $L^2$ regularization, and a singular perturbed Poisson equation with the $H^{-1}$ regularization.… ▽ More We present the Dirichlet-Neumann (DN) and Neumann-Neumann (NN) methods applied to the optimal control problems arising from elliptic partial differential equations (PDEs) under the $H^{-1}$ regularization. We use the Lagrange multiplier approach to derive a forward-backward optimality system with the $L^2$ regularization, and a singular perturbed Poisson equation with the $H^{-1}$ regularization. The $H^{-1}$ regularization thus avoids solving a coupled bi-Laplacian problem, yet the solutions are less regular. The singular perturbed Poisson equation is then solved by using the DN and NN methods, and a detailed analysis is given both in the one-dimensional and two-dimensional case. Finally, we provide some numerical experiments with conclusions. △ Less

Submitted 24 August, 2023; originally announced August 2023.

Comments: 27th International Domain Decomposition Conference (DD27)

Cross-points in the Dirichlet-Neumann method II: a geometrically convergent variant

Authors: Bastien Chaudet-Dumas, Martin J. Gander

Abstract: When considered as a standalone iterative solver for elliptic boundary value problems, the Dirichlet-Neumann (DN) method is known to converge geometrically for domain decompositions into strips, even for a large number of subdomains. However, whenever the domain decomposition includes cross-points, i.e.$\!$ points where more than two subdomains meet, the convergence proof does not hold anymore as… ▽ More When considered as a standalone iterative solver for elliptic boundary value problems, the Dirichlet-Neumann (DN) method is known to converge geometrically for domain decompositions into strips, even for a large number of subdomains. However, whenever the domain decomposition includes cross-points, i.e.$\!$ points where more than two subdomains meet, the convergence proof does not hold anymore as the method generates subproblems that might not be well-posed. Focusing on a simple two-dimensional example involving one cross-point, we proposed in a previous work a decomposition of the solution into two parts: an even symmetric part and an odd symmetric part. Based on this decomposition, we proved that the DN method was geometrically convergent for the even symmetric part and that it was not well-posed for the odd symmetric part. Here, we introduce a new variant of the DN method which generates subproblems that remain well-posed for the odd symmetric part as well. Taking advantage of the symmetry properties of the domain decomposition considered, we manage to prove that our new method converges geometrically in the presence of cross-points. We also extend our results to the three-dimensional case, and present numerical experiments that illustrate our theoretical findings. △ Less

Submitted 18 July, 2023; originally announced July 2023.

MSC Class: 35J05; 35D35; 65N55; 65N06

A new ParaDiag time-parallel time integration method

Authors: Martin J. Gander, Davide Palitta

Abstract: Time-parallel time integration has received a lot of attention in the high performance computing community over the past two decades. Indeed, it has been shown that parallel-in-time techniques have the potential to remedy one of the main computational drawbacks of parallel-in-space solvers. In particular, it is well-known that for large-scale evolution problems space parallelization saturates long… ▽ More Time-parallel time integration has received a lot of attention in the high performance computing community over the past two decades. Indeed, it has been shown that parallel-in-time techniques have the potential to remedy one of the main computational drawbacks of parallel-in-space solvers. In particular, it is well-known that for large-scale evolution problems space parallelization saturates long before all processing cores are effectively used on today's large scale parallel computers. Among the many approaches for time-parallel time integration, ParaDiag schemes have proved themselves to be a very effective approach. In this framework, the time stepping matrix or an approximation thereof is diagonalized by Fourier techniques, so that computations taking place at different time steps can be indeed carried out in parallel. We propose here a new ParaDiag algorithm combining the Sherman-Morrison-Woodbury formula and Krylov techniques. A panel of diverse numerical examples illustrates the potential of our new solver. In particular, we show that it performs very well compared to different ParaDiag algorithms recently proposed in the literature. △ Less

Submitted 23 September, 2023; v1 submitted 25 April, 2023; originally announced April 2023.

An optimized Space-Time Multigrid algorithm for parabolic PDEs

Authors: Bastien Chaudet-Dumas, Martin J. Gander, Ausra Pogozelskyte

Abstract: We investigate three directions to further improve the highly efficient Space-Time Multigrid algorithm with block-Jacobi smoother introduced in [GanNeu16]. First, we derive an analytical expression for the optimal smoothing parameter in the case of a full space-time coarsening strategy; second, we propose a new and efficient direct coarsening strategy which simplifies the code by preventing change… ▽ More We investigate three directions to further improve the highly efficient Space-Time Multigrid algorithm with block-Jacobi smoother introduced in [GanNeu16]. First, we derive an analytical expression for the optimal smoothing parameter in the case of a full space-time coarsening strategy; second, we propose a new and efficient direct coarsening strategy which simplifies the code by preventing changes of coarsening regimes; and third, we also optimize the entire two cycle to investigate if further efficiency gains are possible. Especially, we show that our new coarsening strategy leads to a significant efficiency gain when the ratio $τ/h^2$ is small, where $τ$ and $h$ represent the time and space steps. Our analysis is performed for the heat equation in one spatial dimension, using centered finite differences in space and Backward Euler in time, but could be generalized to other situations. We also present numerical experiments that confirm our theoretical findings. △ Less

Submitted 27 February, 2023; originally announced February 2023.

Cross-points in the Neumann-Neumann method

Authors: Bastien Chaudet-Dumas, Martin J. Gander

Abstract: In this work, we focus on the Neumann-Neumann method (NNM), which is one of the most popular non-overlapping domain decomposition methods. Even though the NNM is widely used and proves itself very efficient when applied to discrete problems in practical applications, it is in general not well defined at the continuous level when the geometric decomposition involves cross-points. Our goals are to i… ▽ More In this work, we focus on the Neumann-Neumann method (NNM), which is one of the most popular non-overlapping domain decomposition methods. Even though the NNM is widely used and proves itself very efficient when applied to discrete problems in practical applications, it is in general not well defined at the continuous level when the geometric decomposition involves cross-points. Our goals are to investigate this well-posedness issue and to provide a complete analysis of the method at the continuous level, when applied to a simple elliptic problem on a configuration involving one cross-point. More specifically, we prove that the algorithm generates solutions that are singular near the cross-points. We also exhibit the type of singularity introduced by the method, and show how it propagates through the iterations. Then, based on this analysis, we design a new set of transmission conditions that makes the new NNM geometrically convergent for this simple configuration. Finally, we illustrate our results with numerical experiments. △ Less

Submitted 27 February, 2023; originally announced February 2023.

Schwarz methods by domain truncation

Authors: Martin J. Gander, Hui Zhang

Abstract: Schwarz methods use a decomposition of the computational domain into subdomains and need to put boundary conditions on the subdomain boundaries. In domain truncation one restricts the unbounded domain to a bounded computational domain and also needs to put boundary conditions on the computational domain boundaries. It turns out to be fruitful to think of the domain decomposition in Schwarz methods… ▽ More Schwarz methods use a decomposition of the computational domain into subdomains and need to put boundary conditions on the subdomain boundaries. In domain truncation one restricts the unbounded domain to a bounded computational domain and also needs to put boundary conditions on the computational domain boundaries. It turns out to be fruitful to think of the domain decomposition in Schwarz methods as truncation of the domain onto subdomains. The first truly optimal Schwarz method that converges in a finite number of steps was proposed in 1994 and used precisely transparent boundary conditions as transmission conditions between subdomains. Approximating these transparent boundary conditions for fast convergence of Schwarz methods led to the development of optimized Schwarz methods -- a name that has become common for Schwarz methods based on domain truncation. Compared to classical Schwarz methods which use simple Dirichlet transmission conditions and have been successfully used in a wide range of applications, optimized Schwarz methods are much less well understood, mainly due to their more sophisticated transmission conditions. This present situation is the motivation for our survey: to give a comprehensive review and precise exploration of convergence behaviors of optimized Schwarz methods based on Fourier analysis taking into account the original boundary conditions, many subdomain decompositions and layered media. The transmission conditions we study include the lowest order absorbing conditions (Robin), and also more advanced perfectly matched layers (PML), both developed first for domain truncation. △ Less

Submitted 20 July, 2022; originally announced July 2022.

Comments: 32MB, 137 pages, a lot of figures

MSC Class: 65Y05

Journal ref: published in Acta Numerica 2022, pp.1-134

Closed form optimized transmission conditions for complex diffusion with many subdomains

Authors: Victorita Dolean, Martin J. Gander, Alexandros Kyriakis

Abstract: Optimized transmission conditions in domain decomposition methods have been the focus of intensive research efforts over the past decade. Traditionally, transmission conditions are optimized for two subdomain model configurations, and then used in practice for many subdomains. We optimize here transmission conditions for the first time directly for many subdomains for a class of complex diffusion… ▽ More Optimized transmission conditions in domain decomposition methods have been the focus of intensive research efforts over the past decade. Traditionally, transmission conditions are optimized for two subdomain model configurations, and then used in practice for many subdomains. We optimize here transmission conditions for the first time directly for many subdomains for a class of complex diffusion problems. Our asymptotic analysis leads to closed form optimized transmission conditions for many subdomains, and shows that the asymptotic best choice in the mesh size only differs from the two subdomain best choice in the constants, for which we derive the dependence on the number of subdomains explicitly, including the limiting case of an infinite number of subdomains, leading to new insight into scalability. Our results include both Robin and Ventcell transmission conditions, and we also optimize for the first time a two-sided Ventcell condition. We illustrate our results with numerical experiments, both for situations covered by our analysis and situations that go beyond. △ Less

Submitted 20 April, 2022; originally announced April 2022.

A unified analysis framework for iterative parallel-in-time algorithms

Authors: M. J. Gander, T. Lunet, D. Ruprecht, R. Speck

Abstract: Parallel-in-time integration has been the focus of intensive research efforts over the past two decades due to the advent of massively parallel computer architectures and the scaling limits of purely spatial parallelization. Various iterative parallel-in-time (PinT) algorithms have been proposed, like Parareal, PFASST, MGRIT, and Space-Time Multi-Grid (STMG). These methods have been described usin… ▽ More Parallel-in-time integration has been the focus of intensive research efforts over the past two decades due to the advent of massively parallel computer architectures and the scaling limits of purely spatial parallelization. Various iterative parallel-in-time (PinT) algorithms have been proposed, like Parareal, PFASST, MGRIT, and Space-Time Multi-Grid (STMG). These methods have been described using different notations, and the convergence estimates that are available are difficult to compare. We describe Parareal, PFASST, MGRIT and STMG for the Dahlquist model problem using a common notation and give precise convergence estimates using generating functions. This allows us, for the first time, to directly compare their convergence. We prove that all four methods eventually converge super-linearly, and also compare them numerically. The generating function framework provides further opportunities to explore and analyze existing and new methods. △ Less

Submitted 28 April, 2023; v1 submitted 30 March, 2022; originally announced March 2022.

Journal ref: SIAM Journal on Scientific Computing 45(5), pp. A2275 - A2303, 2023

Low-rank Parareal: a low-rank parallel-in-time integrator

Authors: Benjamin Carrel, Martin J. Gander, Bart Vandereycken

Abstract: In this work, the Parareal algorithm is applied to evolution problems that admit good low-rank approximations and for which the dynamical low-rank approximation (DLRA) can be used as time stepper. Many discrete integrators for DLRA have recently been proposed, based on splitting the projected vector field or by applying projected Runge--Kutta methods. The cost and accuracy of these methods are mos… ▽ More In this work, the Parareal algorithm is applied to evolution problems that admit good low-rank approximations and for which the dynamical low-rank approximation (DLRA) can be used as time stepper. Many discrete integrators for DLRA have recently been proposed, based on splitting the projected vector field or by applying projected Runge--Kutta methods. The cost and accuracy of these methods are mostly governed by the rank chosen for the approximation. These properties are used in a new method, called low-rank Parareal, in order to obtain a time-parallel DLRA solver for evolution problems. The algorithm is analyzed on affine linear problems and the results are illustrated numerically. △ Less

Submitted 13 September, 2022; v1 submitted 16 March, 2022; originally announced March 2022.

MSC Class: 65L05; 65L20; 65L70; 68W10; 65F45; 65F55

Convergence of parallel overlapping domain decomposition methods for the Helmholtz equation

Authors: Shihua Gong, Martin J. Gander, Ivan G. Graham, David Lafontaine, Euan A. Spence

Abstract: We analyse parallel overlapping Schwarz domain decomposition methods for the Helmholtz equation, where the subdomain problems satisfy first-order absorbing (impedance) transmission conditions, and exchange of information between subdomains is achieved using a partition of unity. We provide a novel analysis of this method at the PDE level (without discretization). First, we formulate the method as… ▽ More We analyse parallel overlapping Schwarz domain decomposition methods for the Helmholtz equation, where the subdomain problems satisfy first-order absorbing (impedance) transmission conditions, and exchange of information between subdomains is achieved using a partition of unity. We provide a novel analysis of this method at the PDE level (without discretization). First, we formulate the method as a fixed point iteration, and show (in dimensions 1,2,3) that it is well-defined in a tensor product of appropriate local function spaces, each with $L^2$ impedance boundary data. Given this, we then obtain a bound on the norm of the fixed point operator in terms of the local norms of certain impedance-to-impedance maps arising from local interactions between subdomains. These bounds provide conditions under which (some power of) the fixed point operator is a contraction. In 2-d, for rectangular domains and strip-wise domain decompositions (with each subdomain only overlapping its immediate neighbours), we present two techniques for verifying the assumptions on the impedance-to-impedance maps which ensure power contractivity of the fixed point operator. The first is through semiclassical analysis, which gives rigorous estimates valid as the frequency tends to infinity. These results verify the required assumptions for sufficiently large overlap. For more realistic domain decompositions, we directly compute the norms of the impedance-to-impedance maps by solving certain canonical (local) eigenvalue problems. We give numerical experiments that illustrate the theory. These also show that the iterative method remains convergent and/or provides a good preconditioner in cases not covered by the theory, including for general domain decompositions, such as those obtained via automatic graph-partitioning software. △ Less

Submitted 6 September, 2022; v1 submitted 9 June, 2021; originally announced June 2021.

MSC Class: 65N22; 65N55; 65F08; 65F10; 35J05

Linear and nonlinear substructured Restricted Additive Schwarz iterations and preconditioning

Authors: Faycal Chaouqui, Martin J. Gander, Pratik M. Kumbhar, Tommaso Vanzan

Abstract: Substructured domain decomposition (DD) methods have been extensively studied, and they are usually associated with nonoverlapping decompositions. We introduce here a substructured version of Restricted Additive Schwarz (RAS) which we call SRAS, and we discuss its advantages compared to the standard volume formulation of the Schwarz method when they are used both as iterative solvers and precondit… ▽ More Substructured domain decomposition (DD) methods have been extensively studied, and they are usually associated with nonoverlapping decompositions. We introduce here a substructured version of Restricted Additive Schwarz (RAS) which we call SRAS, and we discuss its advantages compared to the standard volume formulation of the Schwarz method when they are used both as iterative solvers and preconditioners for a Krylov method. To extend SRAS to nonlinear problems, we introduce SRASPEN (Substructured Restricted Additive Schwarz Preconditioned Exact Newton), where SRAS is used as a preconditioner for Newton's method. We study carefully the impact of substructuring on the convergence and performance of these methods as well as their implementations. We finally introduce two-level versions of nonlinear SRAS and SRASPEN. Numerical experiments confirm the advantages of formulating a Schwarz method at the substructured level. △ Less

Submitted 31 March, 2021; originally announced March 2021.

On the nonlinear Dirichlet-Neumann method and preconditioner for Newton's method

Authors: Faycal Chaouqui, Martin J. Gander, Pratik M. Kumbhar, Tommaso Vanzan

Abstract: The Dirichlet-Neumann (DN) method has been extensively studied for linear partial differential equations, while little attention has been devoted to the nonlinear case. In this paper, we analyze the DN method both as a nonlinear iterative method and as a preconditioner for Newton's method. We discuss the nilpotent property and prove that under special conditions, there exists a relaxation paramete… ▽ More The Dirichlet-Neumann (DN) method has been extensively studied for linear partial differential equations, while little attention has been devoted to the nonlinear case. In this paper, we analyze the DN method both as a nonlinear iterative method and as a preconditioner for Newton's method. We discuss the nilpotent property and prove that under special conditions, there exists a relaxation parameter such that the DN method converges quadratically. We further prove that the convergence of Newton's method preconditioned by the DN method is independent of the relaxation parameter. Our numerical experiments further illustrate the mesh independent convergence of the DN method and compare it with other standard nonlinear preconditioners. △ Less

Submitted 12 April, 2022; v1 submitted 22 March, 2021; originally announced March 2021.

Comments: Proceeding paper for Domain Decomposition methods DDM26 conference

A variational interpretation of Restricted Additive Schwarz with impedance transmission condition for the Helmholtz problem

Authors: Shihua Gong, Martin J. Gander, Ivan G. Graham, Euan A. Spence

Abstract: In this paper we revisit the Restricted Additive Schwarz method for solving discretized Helmholtz problems, using impedance boundary conditions on subdomains (sometimes called ORAS). We present this method in its variational form and show that it can be seen as a finite element discretization of a parallel overlapping domain decomposition method defined at the PDE level. In a fourthcoming paper, t… ▽ More In this paper we revisit the Restricted Additive Schwarz method for solving discretized Helmholtz problems, using impedance boundary conditions on subdomains (sometimes called ORAS). We present this method in its variational form and show that it can be seen as a finite element discretization of a parallel overlapping domain decomposition method defined at the PDE level. In a fourthcoming paper, the authors have proved certain contractive properties of the error propagation operator for this method at the PDE level, under certain geometrical assumptions. We illustrate computationally that these properties are also enjoyed by its finite element approximation, i.e., the ORAS method. △ Less

Submitted 10 June, 2021; v1 submitted 21 March, 2021; originally announced March 2021.

Localized Reduced Basis Additive Schwarz Methods

Authors: Martin J. Gander, Stephan Rave

Abstract: Reduced basis methods build low-rank approximation spaces for the solution sets of parameterized PDEs by computing solutions of the given PDE for appropriately selected snapshot parameters. Localized reduced basis methods reduce the offline cost of computing these snapshot solutions by instead constructing a global space from spatially localized less expensive problems. In the case of online enric… ▽ More Reduced basis methods build low-rank approximation spaces for the solution sets of parameterized PDEs by computing solutions of the given PDE for appropriately selected snapshot parameters. Localized reduced basis methods reduce the offline cost of computing these snapshot solutions by instead constructing a global space from spatially localized less expensive problems. In the case of online enrichment, these local problems are iteratively solved in regions of high residual and correspond to subdomain solves in domain decomposition methods. We show in this note that indeed there is a close relationship between online-enriched localized reduced basis and domain decomposition methods by introducing a Localized Reduced Basis Additive Schwarz method (LRBAS), which can be interpreted as a locally adaptive multi-preconditioning scheme for the CG method. △ Less

Submitted 8 June, 2021; v1 submitted 19 March, 2021; originally announced March 2021.

A numerical algorithm based on probing to find optimized transmission conditions

Authors: Martin J. Gander, Roland Masson, Tommaso Vanzan

Abstract: Optimized Schwarz Methods (OSMs) are based on optimized transmission conditions along the interfaces between the subdomains. Optimized transmission conditions are derived at the theoretical level, using techniques developed in the last decades. The hypothesis behind these analyses are quite strong, so that the applicability of OSMs is still limited. In this manuscript, we present a numerical algor… ▽ More Optimized Schwarz Methods (OSMs) are based on optimized transmission conditions along the interfaces between the subdomains. Optimized transmission conditions are derived at the theoretical level, using techniques developed in the last decades. The hypothesis behind these analyses are quite strong, so that the applicability of OSMs is still limited. In this manuscript, we present a numerical algorithm to obtain optimized transmission conditions for any given problem at hand. This algorithm requires few subdomain solves to be performed in an offline phase. This additional cost is usually negligible due to the resulting faster convergence, even in a single-query context. △ Less

Submitted 19 August, 2021; v1 submitted 17 March, 2021; originally announced March 2021.

Comments: 8 pages

Optimizing transmission conditions for multiple subdomains in the Magnetotelluric Approximation of Maxwell's equations

Authors: Victorita Dolean, Martin J. Gander, Alexandros Kyriakis

Abstract: Classically transmission conditions between subdomains are optimized for a simplified two subdomain decomposition to obtain optimized Schwarz methods for many subdomains. We investigate here if such a simplified optimization suffices for the magnetotelluric approximation of Maxwell's equation which leads to a complex diffusion problem. We start with a direct analysis for 2 and 3 subdomains, and pr… ▽ More Classically transmission conditions between subdomains are optimized for a simplified two subdomain decomposition to obtain optimized Schwarz methods for many subdomains. We investigate here if such a simplified optimization suffices for the magnetotelluric approximation of Maxwell's equation which leads to a complex diffusion problem. We start with a direct analysis for 2 and 3 subdomains, and present asymptotically optimized transmission conditions in each case. We then optimize transmission conditions numerically for 4, 5 and 6 subdomains and observe the same asymptotic behavior of optimized transmission conditions. We finally use the technique of limiting spectra to optimize for a very large number of subdomains in a strip decomposition. Our analysis shows that the asymptotically best choice of transmission conditions is the same in all these situations, only the constants differ slightly. It is therefore enough for such diffusive type approximations of Maxwell's equations, which include the special case of the Laplace and screened Laplace equation, to optimize transmission parameters in the simplified two subdomain decomposition setting to obtain good transmission conditions for optimized Schwarz methods for more general decompositions. △ Less

Submitted 4 August, 2021; v1 submitted 14 March, 2021; originally announced March 2021.

Should multilevel methods for discontinuous Galerkin discretizations use discontinuous interpolation operators?

Authors: Jose Pablo Lucero Lorca, Martin Jakob Gander

Abstract: Multi-level preconditioners for Discontinuous Galerkin (DG) discretizations are widely used to solve elliptic equations, and a main ingredient of such solvers is the interpolation operator to transfer information from the coarse to the fine grid. Classical interpolation operators give continuous interpolated values, but since DG solutions are naturally discontinuous, one might wonder if one should… ▽ More Multi-level preconditioners for Discontinuous Galerkin (DG) discretizations are widely used to solve elliptic equations, and a main ingredient of such solvers is the interpolation operator to transfer information from the coarse to the fine grid. Classical interpolation operators give continuous interpolated values, but since DG solutions are naturally discontinuous, one might wonder if one should not use discontinuous interpolation operators for DG discretizations. We consider a discontinuous interpolation operator with a parameter that controls the discontinuity, and determine the optimal choice for the discontinuity, leading to the fastest solver for a specific 1D symmetric interior penalty DG discretization model problem. We show in addition that our optimization delivers a perfectly clustered spectrum with a high geometric multiplicity, which is very advantageous for a Krylov solver using the method as its preconditioner. Finally, we show the applicability of the optimal choice to higher dimensions. △ Less

Submitted 2 March, 2021; originally announced March 2021.

ParaDiag: parallel-in-time algorithms based on the diagonalization technique

Authors: Martin J. Gander, Jun Liu, Shu-Lin Wu, Xiaoqiang Yue, Tao Zhou

Abstract: In 2008, Maday and Ronquist introduced an interesting new approach for the direct parallel-in-time (PinT) solution of time-dependent PDEs. The idea is to diagonalize the time stepping matrix, keeping the matrices for the space discretization unchanged, and then to solve all time steps in parallel. Since then, several variants appeared, and we call these closely related algorithms ParaDiag algorith… ▽ More In 2008, Maday and Ronquist introduced an interesting new approach for the direct parallel-in-time (PinT) solution of time-dependent PDEs. The idea is to diagonalize the time stepping matrix, keeping the matrices for the space discretization unchanged, and then to solve all time steps in parallel. Since then, several variants appeared, and we call these closely related algorithms ParaDiag algorithms. ParaDiagalgorithms in the literature can be classified into two groups: ParaDiag-I: direct standalone solvers, ParaDiag-II: iterative solvers. We will explain the basic features of each group in this note. To have concrete examples, we will introduce ParaDiag-I and ParaDiag-II for the advection-diffusion equation. We will also introduce ParaDiag-II for the wave equation and an optimal control problem for the wave equation. We could have used the advection-diffusion equation as well to illustrate ParaDiag-II, but wave equations are known to cause problems for certain PinT algorithms and thus constitute an especially interesting example for which ParaDiag algorithms were tested. We show the main known theoretical results in each case, and also provide Matlab codes for testing. The goal of the Matlab codes is to help the interested reader understand the key features of the ParaDiag algorithms, without intention to be highly tuned for efficiency and/or low memory use. We also provide speedup measurements of ParaDiag algorithms for a 2D linear advection-diffusion equation. These results are obtained on the Tianhe-1 supercomputer in China and the SIUE Campus Cluster in the US and and we compare these results to the performance of parareal and MGRiT, two widely used PinT algorithms. △ Less

Submitted 13 April, 2021; v1 submitted 18 May, 2020; originally announced May 2020.

Optimization of two-level methods for DG discretizations of reaction-diffusion equations

Authors: José Pablo Lucero Lorca, Martin Jakob Gander

Abstract: We analyze and optimize two-level methods applied to a symmetric interior penalty discontinuous Galerkin finite element discretization of a singularly perturbed reaction-diffusion equation. Previous analyses of such methods have been performed numerically by Hemker et. al. for the Poisson problem. Our main innovation is that we obtain explicit formulas for the optimal relaxation parameter of the t… ▽ More We analyze and optimize two-level methods applied to a symmetric interior penalty discontinuous Galerkin finite element discretization of a singularly perturbed reaction-diffusion equation. Previous analyses of such methods have been performed numerically by Hemker et. al. for the Poisson problem. Our main innovation is that we obtain explicit formulas for the optimal relaxation parameter of the two-level method for the Poisson problem in 1D, and very accurate closed form approximation formulas for the optimal choice in the reaction-diffusion case in all regimes. Our Local Fourier Analysis, which we perform at the matrix level to make it more accessible to the linear algebra community, shows that for DG penalization parameter values used in practice, it is better to use cell block-Jacobi smoothers of Schwarz type, in contrast to earlier results suggesting that point block-Jacobi smoothers are preferable, based on a smoothing analysis alone. Our analysis also reveals how the performance of the iterative solver depends on the DG penalization parameter, and what value should be chosen to get the fastest iterative solver, providing a new, direct link between DG discretization and iterative solver performance. We illustrate our analysis with numerical experiments and comparisons in higher dimensions and different geometries. △ Less

Submitted 2 March, 2021; v1 submitted 29 April, 2020; originally announced April 2020.

MSC Class: 65T50; 35K57; 65N55; 65F08 ACM Class: G.1.8

Asymptotic Analysis for Overlap in Waveform Relaxation Methods for RC Type Circuits

Authors: Martin J. Gander, Pratik M. Kumbhar, Albert E. Ruehli

Abstract: Waveform relaxation (WR) methods are based on partitioning large circuits into sub-circuits which then are solved separately for multiple time steps in so-called time windows, and an iteration is used to converge to the global circuit solution in each time window. Classical WR converges quite slowly, especially when long time windows are used. To overcome this issue, optimized WR (OWR) was introdu… ▽ More Waveform relaxation (WR) methods are based on partitioning large circuits into sub-circuits which then are solved separately for multiple time steps in so-called time windows, and an iteration is used to converge to the global circuit solution in each time window. Classical WR converges quite slowly, especially when long time windows are used. To overcome this issue, optimized WR (OWR) was introduced which is based on optimized transmission conditions that transfer information between the sub-circuits more efficiently than classical WR. We study here for the first time the influence of overlapping sub-circuits in both WR and OWR applied to RC circuits. We give a circuit interpretation of the new transmission conditions in OWR and derive closed-form asymptotic expressions for the circuit elements representing the optimization parameter in OWR. Our analysis shows that the parameter is quite different in the overlapping case, compared to the nonoverlapping one. We then show numerically that our optimized choice performs well, also for cases not covered by our analysis. This paper provides a general methodology to derive optimized parameters and can be extended to other circuits or system of differential equations or space-time PDEs. △ Less

Submitted 14 January, 2020; originally announced January 2020.

Comments: 23 Pages, 15 Figures

MSC Class: 65N55; 65L05; 65M22; 47N70

Natural domain decomposition algorithms for the solution of time-harmonic elastic waves

Authors: Romain Brunet, Victorita Dolean, Martin J. Gander

Abstract: We study for the first time Schwarz domain decomposition methods for the solution of the Navier equations modeling the propagation of elastic waves. These equations in the time harmonic regime are difficult to solve by iterative methods, even more so than the Helmholtz equation. We first prove that the classical Schwarz method is not convergent when applied to the Navier equations, and can thus no… ▽ More We study for the first time Schwarz domain decomposition methods for the solution of the Navier equations modeling the propagation of elastic waves. These equations in the time harmonic regime are difficult to solve by iterative methods, even more so than the Helmholtz equation. We first prove that the classical Schwarz method is not convergent when applied to the Navier equations, and can thus not be used as an iterative solver, only as a preconditioner for a Krylov method. We then introduce more natural transmission conditions between the subdomains, and show that if the overlap is not too small, this new Schwarz method is convergent. We illustrate our results with numerical experiments, both for situations covered by our technical two subdomain analysis, and situations that go far beyond, including many subdomains, cross points, heterogeneous materials in a transmission problem, and Krylov acceleration. Our numerical results show that the Schwarz method with adapted transmission conditions leads systematically to a better solver for the Navier equations than the classical Schwarz method. △ Less

Submitted 27 April, 2019; originally announced April 2019.

A Schwarz Method for the Magnetotelluric Approximation of Maxwell's equations

Authors: Fabrizio Donzelli, Martin J. Gander, Ronald D. Haynes

Abstract: The magnetotelluric approximation of the Maxwell's equations is used to model the propagation of low frequency electro-magnetic waves in the Earth's subsurface, with the purpose of reconstructing the presence of mineral or oil deposits. We propose a classical Schwarz method for solving this magnetotelluric approximation of the Maxwell equations, and prove its convergence using maximum principle te… ▽ More The magnetotelluric approximation of the Maxwell's equations is used to model the propagation of low frequency electro-magnetic waves in the Earth's subsurface, with the purpose of reconstructing the presence of mineral or oil deposits. We propose a classical Schwarz method for solving this magnetotelluric approximation of the Maxwell equations, and prove its convergence using maximum principle techniques. This is not trivial, since solutions are complex valued, and we need a new result that the magnetotelluric approximations satisfy a maximum modulus principle for our proof. We illustrate our analysis with numerical experiments. △ Less

Submitted 9 March, 2019; originally announced March 2019.

Comments: 9 pages, 3 figures

Can classical Schwarz methods for time-harmonic elastic waves converge?

Authors: Romain Brunet, Victorita Dolean, Martin J. Gander

Abstract: We show that applying a classical Schwarz method to the time harmonic Navier equations, which are an important model for linear elasticity, leads in general to a divergent method for low to intermediate frequencies. This is even worse than for Helmholtz and time harmonic Maxwell's equations, where the classical Schwarz method is also not convergent, but low frequencies only stagnate, they do not d… ▽ More We show that applying a classical Schwarz method to the time harmonic Navier equations, which are an important model for linear elasticity, leads in general to a divergent method for low to intermediate frequencies. This is even worse than for Helmholtz and time harmonic Maxwell's equations, where the classical Schwarz method is also not convergent, but low frequencies only stagnate, they do not diverge. We illustrate the divergent modes by numerical examples, and also show that when using the classical Schwarz method as a preconditioner for a Krylov method, convergence difficulties remain. △ Less

Submitted 31 October, 2018; originally announced October 2018.

Comments: Submitted for publication in the Proceedings of the 25th International Conference on Domain Decomposition Methods

A New Parareal Algorithm for Time-Periodic Problems with Discontinuous Inputs

Authors: Martin J. Gander, Iryna Kulchytska-Ruchka, Sebastian Schöps

Abstract: The Parareal algorithm, which is related to multiple shooting, was introduced for solving evolution problems in a time-parallel manner. The algorithm was then extended to solve time-periodic problems. We are interested here in time-periodic systems which are forced with quickly-switching discontinuous inputs. Such situations occur, e.g., in power engineering when electric devices are excited with… ▽ More The Parareal algorithm, which is related to multiple shooting, was introduced for solving evolution problems in a time-parallel manner. The algorithm was then extended to solve time-periodic problems. We are interested here in time-periodic systems which are forced with quickly-switching discontinuous inputs. Such situations occur, e.g., in power engineering when electric devices are excited with a pulse-width-modulated signal. In order to solve those problems numerically we consider a recently introduced modified Parareal method with reduced coarse dynamics. Its main idea is to use a low-frequency smooth input for the coarse problem, which can be obtained, e.g., from Fourier analysis. Based on this approach, we present and analyze a new Parareal algorithm for time-periodic problems with highly-oscillatory discontinuous sources. We illustrate the performance of the method via its application to the simulation of an induction machine. △ Less

Submitted 29 October, 2018; originally announced October 2018.

Journal ref: Domain Decomposition Methods in Science and Engineering XXV, vol. 138 of Lecture Notes in Computational Science and Engineering. Springer, 2020

A New Parareal Algorithm for Problems with Discontinuous Sources

Authors: Martin J. Gander, Iryna Kulchytska-Ruchka, Innocent Niyonzima, Sebastian Schöps

Abstract: The Parareal algorithm allows to solve evolution problems exploiting parallelization in time. Its convergence and stability have been proved under the assumption of regular (smooth) inputs. We present and analyze here a new Parareal algorithm for ordinary differential equations which involve discontinuous right-hand sides. Such situations occur in various applications, e.g., when an electric devic… ▽ More The Parareal algorithm allows to solve evolution problems exploiting parallelization in time. Its convergence and stability have been proved under the assumption of regular (smooth) inputs. We present and analyze here a new Parareal algorithm for ordinary differential equations which involve discontinuous right-hand sides. Such situations occur in various applications, e.g., when an electric device is supplied with a pulse-width-modulated signal. Our new Parareal algorithm uses a smooth input for the coarse problem with reduced dynamics. We derive error estimates that show how the input reduction influences the overall convergence rate of the algorithm. We support our theoretical results by numerical experiments, and also test our new Parareal algorithm in an eddy current simulation of an induction machine. △ Less

Submitted 14 March, 2018; originally announced March 2018.

MSC Class: 65L05; 65L20; 65L70; 65L80; 65M12

Journal ref: SIAM Journal on Scientific Computing 2019 41:2, B375-B395

A Class of Iterative Solvers for the Helmholtz Equation: Factorizations, Sweeping Preconditioners, Source Transfer, Single Layer Potentials, Polarized Traces, and Optimized Schwarz Methods

Authors: Martin J. Gander, Hui Zhang

Abstract: Solving time-harmonic wave propagation problems by iterative methods is a difficult task, and over the last two decades, an important research effort has gone into developing preconditioners for the simplest representative of such wave propagation problems, the Helmholtz equation. A specific class of these new preconditioners are considered here. They were developed by researchers with various bac… ▽ More Solving time-harmonic wave propagation problems by iterative methods is a difficult task, and over the last two decades, an important research effort has gone into developing preconditioners for the simplest representative of such wave propagation problems, the Helmholtz equation. A specific class of these new preconditioners are considered here. They were developed by researchers with various backgrounds using formulations and notations that are very different, and all are among the most promising preconditioners for the Helmholtz equation. The goal of the present manuscript is to show that this class of preconditioners are based on a common mathematical principle, and they can all be formulated in the context of domain decomposition methods called optimized Schwarz methods. This common formulation allows us to explain in detail how and why all these methods work. The domain decomposition formulation also allows us to avoid technicalities in the implementation description we give of these recent methods. The equivalence of these methods with optimized Schwarz methods translates at the discrete level into equivalence with approximate block LU decomposition preconditioners, and we give in each case the algebraic version, including a detailed description of the approximations used. While we chose to use the Helmholtz equation for which these methods were developed, our notation is completely general and the algorithms we give are written for an arbitrary second order elliptic operator. The algebraic versions are even more general, assuming only a connectivity pattern in the discretization matrix. △ Less

Submitted 21 February, 2018; v1 submitted 7 October, 2016; originally announced October 2016.

Comments: 71 pages, final version, accepted by SIAM Review

MSC Class: 65N55; 65N22; 65F10

An introduction to Multitrace Formulations and Associated Domain Decomposition Solvers

Authors: X. Claeys, V. Dolean, M. J. Gander

Abstract: Multitrace formulations (MTFs) are based on a decomposition of the problem domain into subdomains, and thus domain decomposition solvers are of interest. The fully rigorous mathematical MTF can however be daunting for the non-specialist. We introduce in this paper MTFs on a simple model problem using concepts familiar to researchers in domain decomposition. This allows us to get a new understandin… ▽ More Multitrace formulations (MTFs) are based on a decomposition of the problem domain into subdomains, and thus domain decomposition solvers are of interest. The fully rigorous mathematical MTF can however be daunting for the non-specialist. We introduce in this paper MTFs on a simple model problem using concepts familiar to researchers in domain decomposition. This allows us to get a new understanding of MTFs and a natural block Jacobi iteration, for which we determine optimal relaxation parameters. We then show how iterative multitrace formulation solvers are related to a well known domain decomposition method called optimal Schwarz method: a method which used Dirichlet to Neumann maps in the transmission condition. We finally show that the insight gained from the simple model problem leads to remarkable identities for Calderon projectors and related operators, and the convergence results and optimal choice of the relaxation parameter we obtained is independent of the geometry, the space dimension of the problem{\color{black}, and the precise form of the spatial elliptic operator, like for optimal Schwarz methods. We illustrate our analysis with numerical experiments. △ Less

Submitted 14 May, 2016; originally announced May 2016.

Nonlinear Preconditioning: How to use a Nonlinear Schwarz Method to Precondition Newton's Method

Authors: V. Dolean, M. J. Gander, F. Kwok, R. Masson, W. Kheriji

Abstract: For linear problems, domain decomposition methods can be used directly as iterative solvers, but also as preconditioners for Krylov methods. In practice, Krylov acceleration is almost always used, since the Krylov method finds a much better residual polynomial than the stationary iteration, and thus converges much faster. We show in this paper that also for non-linear problems, domain decompositio… ▽ More For linear problems, domain decomposition methods can be used directly as iterative solvers, but also as preconditioners for Krylov methods. In practice, Krylov acceleration is almost always used, since the Krylov method finds a much better residual polynomial than the stationary iteration, and thus converges much faster. We show in this paper that also for non-linear problems, domain decomposition methods can either be used directly as iterative solvers, or one can use them as preconditioners for Newton's method. For the concrete case of the parallel Schwarz method, we show that we obtain a preconditioner we call RASPEN (Restricted Additive Schwarz Preconditioned Exact Newton) which is similar to ASPIN (Additive Schwarz Preconditioned Inexact Newton), but with all components directly defined by the iterative method. This has the advantage that RASPEN already converges when used as an iterative solver, in contrast to ASPIN, and we thus get a substantially better preconditioner for Newton's method. The iterative construction also allows us to naturally define a coarse correction using the multigrid full approximation scheme, which leads to a convergent two level non-linear iterative domain decomposition method and a two level RASPEN non-linear preconditioner. We illustrate our findings with numerical results on the Forchheimer equation and a non-linear diffusion problem. △ Less

Submitted 14 May, 2016; originally announced May 2016.

Analysis of Schwarz methods for a hybridizable discontinuous Galerkin discretization: the many subdomain case

Authors: Martin J. Gander, Soheil Hajian

Abstract: Schwarz methods are attractive parallel solution techniques for solving large-scale linear systems obtained from discretizations of partial differential equations (PDEs). Due to the iterative nature of Schwarz methods, convergence rates are an important criterion to quantify their performance. Optimized Schwarz methods (OSM) form a class of Schwarz methods that are designed to achieve faster conve… ▽ More Schwarz methods are attractive parallel solution techniques for solving large-scale linear systems obtained from discretizations of partial differential equations (PDEs). Due to the iterative nature of Schwarz methods, convergence rates are an important criterion to quantify their performance. Optimized Schwarz methods (OSM) form a class of Schwarz methods that are designed to achieve faster convergence rates by employing optimized transmission conditions between subdomains. It has been shown recently that for a two-subdomain case, OSM is a natural solver for hybridizable discontinuous Galerkin (HDG) discretizations of elliptic PDEs. In this paper, we generalize the preceding result to the many-subdomain case and obtain sharp convergence rates with respect to the mesh size and polynomial degree, the subdomain diameter, and the zeroth-order term of the underlying PDE, which allows us for the first time to give precise convergence estimates for OSM used to solve parabolic problems by implicit time stepping. We illustrate our theoretical results with numerical experiments. △ Less

Submitted 11 May, 2017; v1 submitted 13 March, 2016; originally announced March 2016.

Comments: 23 pages, 4 figures, 5 tables, accepted for publication in Mathematics of Computation

MSC Class: 65N22; 65F10; 65F08; 65N55; 65H10

Analysis of a New Harmonically Enriched Multiscale Coarse Space for Domain Decomposition Methods

Authors: Martin J. Gander, Atle Loneland, Talal Rahman

Abstract: We propose a new, harmonically enriched multiscale coarse space (HEM) for domain decomposition methods. For a coercive high contrast model problem, we show how to enrich the coarse space so that the method is robust against any variations and discontinuities in the problem parameters both inside subdomains and across and along subdomain boundaries. We prove our results for an enrichment strategy b… ▽ More We propose a new, harmonically enriched multiscale coarse space (HEM) for domain decomposition methods. For a coercive high contrast model problem, we show how to enrich the coarse space so that the method is robust against any variations and discontinuities in the problem parameters both inside subdomains and across and along subdomain boundaries. We prove our results for an enrichment strategy based on solving simple, lower dimensional eigenvalue problems on the interfaces between subdomains, and we call the resulting coarse space the spectral harmonically enriched multiscale coarse space (SHEM). We then also give a variant that performs equally well in practice, and does not require the solve of eigenvalue problems, which we call non-spectral harmonically enriched multiscale coarse space (NSHEM). Our enrichment process naturally reaches the optimal coarse space represented by the full discrete harmonic space, which enables us to turn the method into a direct solver (OHEM). We also extensively test our new coarse spaces numerically, and the results confirm our analysis △ Less

Submitted 16 December, 2015; originally announced December 2015.

MSC Class: 65F10; 65N22; 65N30; 63N55

Dirichlet-Neumann Waveform Relaxation Method for the 1D and 2D Heat and Wave Equations in Multiple subdomains

Authors: Martin J. Gander, Felix Kwok, Bankim C. Mandal

Abstract: We present a Waveform Relaxation (WR) version of the Dirichlet-Neumann algorithm, formulated specially for multiple subdomains splitting for general parabolic and hyperbolic problems. This method is based on a non-overlapping spatial domain decomposition, and the iteration involves subdomain solves in space-time with corresponding interface condition, and finally organize an exchange of informatio… ▽ More We present a Waveform Relaxation (WR) version of the Dirichlet-Neumann algorithm, formulated specially for multiple subdomains splitting for general parabolic and hyperbolic problems. This method is based on a non-overlapping spatial domain decomposition, and the iteration involves subdomain solves in space-time with corresponding interface condition, and finally organize an exchange of information between neighboring subdomains. Using a Fourier-Laplace transform argument, for a particular relaxation parameter, we present convergence analysis of the algorithm for the heat and wave equations. We prove superlinear convergence for finite time window in case of the heat equation, and finite step convergence for the wave equation. The convergence behavior however depends on the size of the subdomains and the time window length on which the algorithm is employed. We illustrate the performance of the algorithm with numerical results, and show a comparison with classical and optimized Schwarz WR methods. △ Less

Submitted 14 July, 2015; originally announced July 2015.

Comments: 28 pages, 30 figures. arXiv admin note: text overlap with arXiv:1507.04008

Analysis of a New Space-Time Parallel Multigrid Algorithm for Parabolic Problems

Authors: Martin J. Gander, Martin Neumüller

Abstract: We present and analyze a new space-time parallel multigrid method for parabolic equations. The method is based on arbitrarily high order discontinuous Galerkin discretizations in time, and a finite element discretization in space. The key ingredient of the new algorithm is a block Jacobi smoother. We present a detailed convergence analysis when the algorithm is applied to the heat equation, and de… ▽ More We present and analyze a new space-time parallel multigrid method for parabolic equations. The method is based on arbitrarily high order discontinuous Galerkin discretizations in time, and a finite element discretization in space. The key ingredient of the new algorithm is a block Jacobi smoother. We present a detailed convergence analysis when the algorithm is applied to the heat equation, and determine asymptotically optimal smoothing parameters, a precise criterion for semi-coarsening in time or full coarsening, and give an asymptotic two grid contraction factor estimate. We then explain how to implement the new multigrid algorithm in parallel, and show with numerical experiments its excellent strong and weak scalability properties. △ Less

Submitted 3 November, 2014; originally announced November 2014.

Analysis of a Time Multigrid Algorithm for DG-Discretizations in Time

Authors: Martin J. Gander, Martin Neumüller

Abstract: We present and analyze for a scalar linear evolution model problem a time multigrid algorithm for DG-discretizations in time. We derive asymptotically optimized parameters for the smoother, and also an asymptotically sharp convergence estimate for the two grid cycle. Our results hold for any A-stable time stepping scheme and represent the core component for space-time multigrid methods for parabol… ▽ More We present and analyze for a scalar linear evolution model problem a time multigrid algorithm for DG-discretizations in time. We derive asymptotically optimized parameters for the smoother, and also an asymptotically sharp convergence estimate for the two grid cycle. Our results hold for any A-stable time stepping scheme and represent the core component for space-time multigrid methods for parabolic partial differential equations. Our time multigrid method has excellent strong and weak scaling properties for parallelization in time, which we show with numerical experiments. △ Less

Submitted 30 September, 2014; v1 submitted 18 September, 2014; originally announced September 2014.

A new Algorithm Based on Factorization for Heterogeneous Domain Decomposition

Authors: Martin J. Gander, Laurence Halpern, Véronique Martin

Abstract: Often computational models are too expensive to be solved in the entire domain of simulation, and a cheaper model would suffice away from the main zone of interest. We present for the concrete example of an evolution problem of advection reaction diffusion type a heterogeneous domain decomposition algorithm which allows us to recover a solution that is very close to the solution of the fully visco… ▽ More Often computational models are too expensive to be solved in the entire domain of simulation, and a cheaper model would suffice away from the main zone of interest. We present for the concrete example of an evolution problem of advection reaction diffusion type a heterogeneous domain decomposition algorithm which allows us to recover a solution that is very close to the solution of the fully viscous problem, but solves only an inviscid problem in parts of the domain. Our new algorithm is based on the factorization of the underlying differential operator, and we therefore call it factorization algorithm. We give a detailed error analysis, and show that we can obtain approximations in the viscous region which are much closer to the viscous solution in the entire domain of simulation than approximations obtained by other heterogeneous domain decomposition algorithms from the literature. △ Less

Submitted 12 September, 2014; originally announced September 2014.

Comments: 23 pages

Optimized Schwarz Waveform Relaxation for Advection Reaction Diffusion Equations in Two Dimensions

Authors: Daniel Bennequin, Martin J. Gander, Loic Gouarin, Laurence Halpern

Abstract: Optimized Schwarz Waveform Relaxation methods have been developed over the last decade for the parallel solution of evolution problems. They are based on a decomposition in space and an iteration, where only subproblems in space-time need to be solved. Each subproblem can be simulated using an adapted numerical method, for example with local time stepping, or one can even use a different model in… ▽ More Optimized Schwarz Waveform Relaxation methods have been developed over the last decade for the parallel solution of evolution problems. They are based on a decomposition in space and an iteration, where only subproblems in space-time need to be solved. Each subproblem can be simulated using an adapted numerical method, for example with local time stepping, or one can even use a different model in different subdomains, which makes these methods very suitable also from a modeling point of view. For rapid convergence however, it is important to use effective transmission conditions between the space-time subdomains, and for best performance, these transmission conditions need to take the physics of the underlying evolution problem into account. The optimization of these transmission conditions leads to a mathematically hard best approximation problem of homographic type. We study in this paper in detail this problem for the case of linear advection reaction diffusion equations in two spatial dimensions. We prove comprehensively best approximation results for transmission conditions of Robin and Ventcel type. We give for each case closed form asymptotic values for the parameters, which guarantee asymptotically best performance of the iterative methods. We finally show extensive numerical experiments, and we measure performance corresponding to our analysis △ Less

Submitted 4 July, 2014; originally announced July 2014.

Comments: 42 pages

Cross-Points in Domain Decomposition Methods with a Finite Element Discretization

Authors: Martin J. Gander, Kévin Santugini-Repiquet

Abstract: Non-overlapping domain decomposition methods necessarily have to exchange Dirichlet and Neumann traces at interfaces in order to be able to converge to the underlying mono-domain solution. Well known such non-overlapping methods are the Dirichlet-Neumann method, the FETI and Neumann-Neumann methods, and optimized Schwarz methods. For all these methods, cross-points in the domain decomposition conf… ▽ More Non-overlapping domain decomposition methods necessarily have to exchange Dirichlet and Neumann traces at interfaces in order to be able to converge to the underlying mono-domain solution. Well known such non-overlapping methods are the Dirichlet-Neumann method, the FETI and Neumann-Neumann methods, and optimized Schwarz methods. For all these methods, cross-points in the domain decomposition configuration where more than two subdomains meet do not pose any problem at the continuous level, but care must be taken when the methods are discretized. We show in this paper two possible approaches for the consistent discretization of Neumann conditions at cross-points in a Finite Element setting. △ Less

Submitted 18 April, 2014; originally announced April 2014.

Analysis of Schwarz methods for a hybridizable discontinuous Galerkin discretization

Authors: Martin J. Gander, Soheil Hajian

Abstract: Schwarz methods are attractive parallel solvers for large scale linear systems obtained when partial differential equations are discretized. For hybridizable discontinuous Galerkin (HDG) methods, this is a relatively new field of research, because HDG methods impose continuity across elements using a Robin condition, while classical Schwarz solvers use Dirichlet transmission conditions. Robin cond… ▽ More Schwarz methods are attractive parallel solvers for large scale linear systems obtained when partial differential equations are discretized. For hybridizable discontinuous Galerkin (HDG) methods, this is a relatively new field of research, because HDG methods impose continuity across elements using a Robin condition, while classical Schwarz solvers use Dirichlet transmission conditions. Robin conditions are used in optimized Schwarz methods to get faster convergence compared to classical Schwarz methods, and this even without overlap, when the Robin parameter is well chosen. We present in this paper a rigorous convergence analysis of Schwarz methods for the concrete case of hybridizable interior penalty (IPH) method. We show that the penalization parameter needed for convergence of IPH leads to slow convergence of the classical additive Schwarz method, and propose a modified solver which leads to much faster convergence. Our analysis is entirely at the discrete level, and thus holds for arbitrary interfaces between two subdomains. We then generalize the method to the case of many subdomains, including cross points, and obtain a new class of preconditioners for Krylov subspace methods which exhibit better convergence properties than the classical additive Schwarz preconditioner. We illustrate our results with numerical experiments. △ Less

Submitted 10 December, 2014; v1 submitted 17 April, 2014; originally announced April 2014.

Comments: 25 pages, 5 figures, 3 tables, accepted for publication in SINUM

MSC Class: 65N22; 65F10; 65F08; 65N55; 65H10

Dirichlet-Neumann and Neumann-Neumann Waveform Relaxation for the Wave Equation

Authors: Martin J. Gander, Felix Kwok, Bankim C. Mandal

Abstract: We present a Waveform Relaxation (WR) version of the Dirichlet-Neumann and Neumann-Neumann algorithms for the wave equation in space time. Each method is based on a non-overlapping spatial domain decomposition, and the iteration involves subdomain solves in space time with corresponding interface condition, followed by a correction step. Using a Laplace transform argument, for a particular relaxat… ▽ More We present a Waveform Relaxation (WR) version of the Dirichlet-Neumann and Neumann-Neumann algorithms for the wave equation in space time. Each method is based on a non-overlapping spatial domain decomposition, and the iteration involves subdomain solves in space time with corresponding interface condition, followed by a correction step. Using a Laplace transform argument, for a particular relaxation parameter, we prove convergence of both algorithms in a finite number of steps for finite time intervals. The number of steps depends on the size of the subdomains and the time window length on which the algorithms are employed. We illustrate the performance of the algorithms with numerical results, and also show a comparison with classical and optimized Schwarz WR methods. △ Less

Submitted 21 May, 2014; v1 submitted 18 February, 2014; originally announced February 2014.

Comments: 8 pages, 6 figures, presented in 22nd International conference on Domain Decomposition Methods, to appear in Domain Decomposition in Science and Engineering XXII, LNCSE, Springer-Verlag 2014

Dirichlet-Neumann and Neumann-Neumann Waveform Relaxation Algorithms for Parabolic Problems

Authors: Martin J. Gander, Felix Kwok, Bankim C. Mandal

Abstract: We present a waveform relaxation version of the Dirichlet-Neumann and Neumann-Neumann methods for parabolic problems. Like the Dirichlet-Neumann method for steady problems, the method is based on a non-overlapping spatial domain decomposition, and the iteration involves subdomain solves with Dirichlet boundary conditions followed by subdomain solves with Neumann boundary conditions. For the Neuman… ▽ More We present a waveform relaxation version of the Dirichlet-Neumann and Neumann-Neumann methods for parabolic problems. Like the Dirichlet-Neumann method for steady problems, the method is based on a non-overlapping spatial domain decomposition, and the iteration involves subdomain solves with Dirichlet boundary conditions followed by subdomain solves with Neumann boundary conditions. For the Neumann-Neumann method, one step of the method consists of solving the subdomain problems using Dirichlet interface conditions, followed by a correction step involving Neumann interface conditions. However, each subdomain problem is now in space and time, and the interface conditions are also time-dependent. Using Laplace transforms, we show for the heat equation that when we consider finite time intervals, the Dirichlet-Neumann and Neumann-Neumann methods converge superlinearly for an optimal choice of the relaxation parameter, similar to the case of Schwarz waveform relaxation algorithms. The convergence rate depends on the size of the subdomains as well as the length of the time window. For any other choice of the relaxation parameter, convergence is only linear. We illustrate our results with numerical experiments. △ Less

Submitted 21 May, 2014; v1 submitted 12 November, 2013; originally announced November 2013.

Comments: 25 pages, 17 figures, Presented at 21st International Conference on Domain Decomposition Methods, INRIA, Rennes

Multiplicative, Additive and Restricted Additive Optimized Schwarz Preconditioning

Authors: Amik St-Cyr, Martin J. Gander, Stephen J. Thomas

Abstract: We demonstrate that a small modification of the multiplicative, additive and restricted additive Schwarz preconditioner at the algebraic level, motivated by optimized Schwarz methods defined at the continuous level, leads to a significant reduction in the iteration count of the iterative solver. Numerical experiments using finite difference and spectral element discretizations of the positive de… ▽ More We demonstrate that a small modification of the multiplicative, additive and restricted additive Schwarz preconditioner at the algebraic level, motivated by optimized Schwarz methods defined at the continuous level, leads to a significant reduction in the iteration count of the iterative solver. Numerical experiments using finite difference and spectral element discretizations of the positive definite Helmholtz problem and an idealized climate simulation illustrate the effectiveness of the new approach. △ Less

Submitted 2 March, 2007; v1 submitted 1 February, 2007; originally announced February 2007.

Comments: 25 pages

MSC Class: 65M55; 65M06; 65M70