-
A Parallel in Time Algorithm Based on ParaExp for Optimal Control Problems
Authors:
Felix Kwok,
Djahou N Tognon
Abstract:
We propose a new parallel-in-time algorithm for solving optimal control problems constrained by discretized partial differential equations. Our approach, which is based on a deeper understanding of ParaExp, considers an overlapping time-domain decomposition in which we combine the solution of homogeneous problems using exponential propagation with the local solutions of inhomogeneous problems. The…
▽ More
We propose a new parallel-in-time algorithm for solving optimal control problems constrained by discretized partial differential equations. Our approach, which is based on a deeper understanding of ParaExp, considers an overlapping time-domain decomposition in which we combine the solution of homogeneous problems using exponential propagation with the local solutions of inhomogeneous problems. The algorithm yields a linear system whose matrix-vector product can be fully performed in parallel. We then propose a preconditioner to speed up the convergence of GMRES in the special cases of the heat and wave equations. Numerical experiments are provided to illustrate the efficiency of our preconditioners.
△ Less
Submitted 5 September, 2024; v1 submitted 17 June, 2024;
originally announced June 2024.
-
Time-parallelization of sequential data assimilation problems
Authors:
Sebastián Riffo,
Félix Kwok,
Julien Salomon
Abstract:
This paper is devoted to the problem of time parallelization of assimilation methods applying on unbounded time domain. In this way, we present a general procedure to couple the Luenberger observer with time parallelization algorithm. Our approach is based on a posteriori error estimates of the latter and preserves the rate of the non-parallelized observer. We then focus on the case where the Para…
▽ More
This paper is devoted to the problem of time parallelization of assimilation methods applying on unbounded time domain. In this way, we present a general procedure to couple the Luenberger observer with time parallelization algorithm. Our approach is based on a posteriori error estimates of the latter and preserves the rate of the non-parallelized observer. We then focus on the case where the Parareal algorithm is used as time parallelization algorithm, and derive a bound of the efficiency of our procedure. A variant devoted to the case a large number of processors is also proposed. We illustrate the performance of our approach with numerical experiments.
△ Less
Submitted 5 December, 2022;
originally announced December 2022.
-
Convergence analysis of the Schwarz alternating method for unconstrained elliptic optimal control problems
Authors:
Wei Gong,
Felix Kwok,
Zhiyu Tan
Abstract:
In this paper we analyze the Schwarz alternating method for unconstrained elliptic optimal control problems. We discuss the convergence properties of the method in the continuous case first and then apply the arguments to the finite difference discretization case. In both cases, we prove that the Schwarz alternating method is convergent if its counterpart for an elliptic equation is convergent. Me…
▽ More
In this paper we analyze the Schwarz alternating method for unconstrained elliptic optimal control problems. We discuss the convergence properties of the method in the continuous case first and then apply the arguments to the finite difference discretization case. In both cases, we prove that the Schwarz alternating method is convergent if its counterpart for an elliptic equation is convergent. Meanwhile, the convergence rate of the method for the elliptic equation under the maximum norm also gives a uniform upper bound (with respect to the regularization parameter $α$) of the convergence rate of the method for the optimal control problem under the maximum norm of proper error merit functions in the continuous case or vectors in the discrete case. Our numerical results corroborate our theoretical results and show that with $α$ decreasing to zero, the method will converge faster. We also give some exposition of this phenomenon.
△ Less
Submitted 3 January, 2022;
originally announced January 2022.
-
Nonlinear optimized Schwarz preconditioner for elliptic optimal control problems
Authors:
Gabriele Ciaramella,
Felix Kwok,
Georg Müller
Abstract:
We introduce a domain decomposition-based nonlinear preconditioned iteration for solving nonlinear, nonsmooth elliptic optimal control problems, with a nonlinear reaction term, $L^1$ regularization and box constraints on the control function. The method is obtained by applying semismooth Newton to the fixed-point equation of the parallel optimized Schwarz iteration. As a proof of concept, numerica…
▽ More
We introduce a domain decomposition-based nonlinear preconditioned iteration for solving nonlinear, nonsmooth elliptic optimal control problems, with a nonlinear reaction term, $L^1$ regularization and box constraints on the control function. The method is obtained by applying semismooth Newton to the fixed-point equation of the parallel optimized Schwarz iteration. As a proof of concept, numerical experiments are performed on two subdomains, as well as on a multi-subdomain test case. The results show that it is possible to obtain substantial improvements in robustness and efficiency with the new method, relative to semismooth Newton applied directly to the full optimization problem, provided appropriate Robin parameters and a good continuation strategy are chosen.
△ Less
Submitted 1 April, 2021;
originally announced April 2021.
-
PARAOPT: A parareal algorithm for optimality systems
Authors:
Martin Gander,
Félix Kwok,
Julien Salomon
Abstract:
The time parallel solution of optimality systems arising in PDE constraint optimization could be achieved by simply applying any time parallel algorithm, such as Parareal, to solve the forward and backward evolution problems arising in the optimization loop. We propose here a different strategy by devising directly a new time parallel algorithm, which we call ParaOpt, for the coupled forward and b…
▽ More
The time parallel solution of optimality systems arising in PDE constraint optimization could be achieved by simply applying any time parallel algorithm, such as Parareal, to solve the forward and backward evolution problems arising in the optimization loop. We propose here a different strategy by devising directly a new time parallel algorithm, which we call ParaOpt, for the coupled forward and backward non-linear partial differential equations. ParaOpt is inspired by the Parareal algorithm for evolution equations, and thus is automatically a two-level method. We provide a detailed convergence analysis for the case of linear parabolic PDE constraints. We illustrate the performance of ParaOpt with numerical experiments both for linear and nonlinear optimality systems.
△ Less
Submitted 24 July, 2020; v1 submitted 5 November, 2019;
originally announced November 2019.
-
Nonlinear Preconditioning: How to use a Nonlinear Schwarz Method to Precondition Newton's Method
Authors:
V. Dolean,
M. J. Gander,
F. Kwok,
R. Masson,
W. Kheriji
Abstract:
For linear problems, domain decomposition methods can be used directly as iterative solvers, but also as preconditioners for Krylov methods. In practice, Krylov acceleration is almost always used, since the Krylov method finds a much better residual polynomial than the stationary iteration, and thus converges much faster. We show in this paper that also for non-linear problems, domain decompositio…
▽ More
For linear problems, domain decomposition methods can be used directly as iterative solvers, but also as preconditioners for Krylov methods. In practice, Krylov acceleration is almost always used, since the Krylov method finds a much better residual polynomial than the stationary iteration, and thus converges much faster. We show in this paper that also for non-linear problems, domain decomposition methods can either be used directly as iterative solvers, or one can use them as preconditioners for Newton's method. For the concrete case of the parallel Schwarz method, we show that we obtain a preconditioner we call RASPEN (Restricted Additive Schwarz Preconditioned Exact Newton) which is similar to ASPIN (Additive Schwarz Preconditioned Inexact Newton), but with all components directly defined by the iterative method. This has the advantage that RASPEN already converges when used as an iterative solver, in contrast to ASPIN, and we thus get a substantially better preconditioner for Newton's method. The iterative construction also allows us to naturally define a coarse correction using the multigrid full approximation scheme, which leads to a convergent two level non-linear iterative domain decomposition method and a two level RASPEN non-linear preconditioner. We illustrate our findings with numerical results on the Forchheimer equation and a non-linear diffusion problem.
△ Less
Submitted 14 May, 2016;
originally announced May 2016.
-
Dirichlet-Neumann Waveform Relaxation Method for the 1D and 2D Heat and Wave Equations in Multiple subdomains
Authors:
Martin J. Gander,
Felix Kwok,
Bankim C. Mandal
Abstract:
We present a Waveform Relaxation (WR) version of the Dirichlet-Neumann algorithm, formulated specially for multiple subdomains splitting for general parabolic and hyperbolic problems. This method is based on a non-overlapping spatial domain decomposition, and the iteration involves subdomain solves in space-time with corresponding interface condition, and finally organize an exchange of informatio…
▽ More
We present a Waveform Relaxation (WR) version of the Dirichlet-Neumann algorithm, formulated specially for multiple subdomains splitting for general parabolic and hyperbolic problems. This method is based on a non-overlapping spatial domain decomposition, and the iteration involves subdomain solves in space-time with corresponding interface condition, and finally organize an exchange of information between neighboring subdomains. Using a Fourier-Laplace transform argument, for a particular relaxation parameter, we present convergence analysis of the algorithm for the heat and wave equations. We prove superlinear convergence for finite time window in case of the heat equation, and finite step convergence for the wave equation. The convergence behavior however depends on the size of the subdomains and the time window length on which the algorithm is employed. We illustrate the performance of the algorithm with numerical results, and show a comparison with classical and optimized Schwarz WR methods.
△ Less
Submitted 14 July, 2015;
originally announced July 2015.
-
Dirichlet-Neumann and Neumann-Neumann Waveform Relaxation for the Wave Equation
Authors:
Martin J. Gander,
Felix Kwok,
Bankim C. Mandal
Abstract:
We present a Waveform Relaxation (WR) version of the Dirichlet-Neumann and Neumann-Neumann algorithms for the wave equation in space time. Each method is based on a non-overlapping spatial domain decomposition, and the iteration involves subdomain solves in space time with corresponding interface condition, followed by a correction step. Using a Laplace transform argument, for a particular relaxat…
▽ More
We present a Waveform Relaxation (WR) version of the Dirichlet-Neumann and Neumann-Neumann algorithms for the wave equation in space time. Each method is based on a non-overlapping spatial domain decomposition, and the iteration involves subdomain solves in space time with corresponding interface condition, followed by a correction step. Using a Laplace transform argument, for a particular relaxation parameter, we prove convergence of both algorithms in a finite number of steps for finite time intervals. The number of steps depends on the size of the subdomains and the time window length on which the algorithms are employed. We illustrate the performance of the algorithms with numerical results, and also show a comparison with classical and optimized Schwarz WR methods.
△ Less
Submitted 21 May, 2014; v1 submitted 18 February, 2014;
originally announced February 2014.
-
Dirichlet-Neumann and Neumann-Neumann Waveform Relaxation Algorithms for Parabolic Problems
Authors:
Martin J. Gander,
Felix Kwok,
Bankim C. Mandal
Abstract:
We present a waveform relaxation version of the Dirichlet-Neumann and Neumann-Neumann methods for parabolic problems. Like the Dirichlet-Neumann method for steady problems, the method is based on a non-overlapping spatial domain decomposition, and the iteration involves subdomain solves with Dirichlet boundary conditions followed by subdomain solves with Neumann boundary conditions. For the Neuman…
▽ More
We present a waveform relaxation version of the Dirichlet-Neumann and Neumann-Neumann methods for parabolic problems. Like the Dirichlet-Neumann method for steady problems, the method is based on a non-overlapping spatial domain decomposition, and the iteration involves subdomain solves with Dirichlet boundary conditions followed by subdomain solves with Neumann boundary conditions. For the Neumann-Neumann method, one step of the method consists of solving the subdomain problems using Dirichlet interface conditions, followed by a correction step involving Neumann interface conditions. However, each subdomain problem is now in space and time, and the interface conditions are also time-dependent. Using Laplace transforms, we show for the heat equation that when we consider finite time intervals, the Dirichlet-Neumann and Neumann-Neumann methods converge superlinearly for an optimal choice of the relaxation parameter, similar to the case of Schwarz waveform relaxation algorithms. The convergence rate depends on the size of the subdomains as well as the length of the time window. For any other choice of the relaxation parameter, convergence is only linear. We illustrate our results with numerical experiments.
△ Less
Submitted 21 May, 2014; v1 submitted 12 November, 2013;
originally announced November 2013.
