-
Variable-Stepsize Implicit Peer Triplets in ODE Constrained Optimal Control
Authors:
Jens Lang,
Bernhard A. Schmitt
Abstract:
This paper is concerned with the theory, construction and application of implicit Peer two-step methods that are super-convergent for variable stepsizes, i.e., preserve their classical order achieved for uniform stepsizes when applied to ODE constrained optimal control problems in a first-discretize-then-optimize setting. We upgrade our former implicit two-step Peer triplets constructed in [Algori…
▽ More
This paper is concerned with the theory, construction and application of implicit Peer two-step methods that are super-convergent for variable stepsizes, i.e., preserve their classical order achieved for uniform stepsizes when applied to ODE constrained optimal control problems in a first-discretize-then-optimize setting. We upgrade our former implicit two-step Peer triplets constructed in [Algorithms, 15:310, 2022] to get ready for dynamical systems with varying time scales without loosing efficiency. Peer triplets consist of a standard Peer method for interior time steps supplemented by matching methods for the starting and end steps. A decisive advantage of Peer methods is their absence of order reduction since they use stages of the same high stage order. The consistency analysis of variable-stepsize implicit Peer methods results in additional order conditions and severe new difficulties for uniform zero-stability, which intensifies the demands on the Peer triplet. Further, we discuss the construction of 4-stage methods with order pairs (4,3) and (3,3) for state and adjoint variables in detail and provide four Peer triplets of practical interest. We rigorously prove convergence of order $s-1$ for $s$-stage Peer methods applied on grids with bounded or smoothly changing stepsize ratios. Numerical tests show the expected order of convergence for the new variable-stepsize Peer triplets.
△ Less
Submitted 21 April, 2024;
originally announced April 2024.
-
Implicit Peer Triplets in Gradient-Based Solution Algorithms for ODE Constrained Optimal Control
Authors:
Jens Lang,
Bernhard A. Schmitt
Abstract:
It is common practice to apply gradient-based optimization algorithms to numerically solve large-scale ODE constrained optimal control problems. Gradients of the objective function are most efficiently computed by approximate adjoint variables. High accuracy with moderate computing time can be achieved by such time integration methods that satisfy a sufficiently large number of adjoint order condi…
▽ More
It is common practice to apply gradient-based optimization algorithms to numerically solve large-scale ODE constrained optimal control problems. Gradients of the objective function are most efficiently computed by approximate adjoint variables. High accuracy with moderate computing time can be achieved by such time integration methods that satisfy a sufficiently large number of adjoint order conditions and supply gradients with higher orders of consistency. In this paper, we upgrade our former implicit two-step Peer triplets constructed in [Algorithms, 15:310, 2022] to meet those new requirements. Since Peer methods use several stages of the same high stage order, a decisive advantage is their lack of order reduction as for semi-discretized PDE problems with boundary control. Additional order conditions for the control and certain positivity requirements now intensify the demands on the Peer triplet. We discuss the construction of $4$-stage methods with order pairs $(3,3)$ and $(4,3)$ in detail and provide three Peer triplets of practical interest. We prove convergence of order $s-1$, at least, for $s$-stage methods if state, adjoint and control satisfy the corresponding order conditions. Numerical tests show the expected order of convergence for the new Peer triplets.
△ Less
Submitted 1 July, 2024; v1 submitted 31 March, 2023;
originally announced March 2023.
-
A Stiff MOL Boundary Control Problem for the 1D Heat Equation with Exact Discrete Solution
Authors:
Jens Lang,
Bernhard A. Schmitt
Abstract:
Method-of-lines discretizations are demanding test problems for stiff integration methods. However, for PDE problems with known analytic solution the presence of space discretization errors or the need to use codes to compute reference solutions may limit the validity of numerical test results. To overcome these drawbacks we present in this short note a simple test problem with boundary control, a…
▽ More
Method-of-lines discretizations are demanding test problems for stiff integration methods. However, for PDE problems with known analytic solution the presence of space discretization errors or the need to use codes to compute reference solutions may limit the validity of numerical test results. To overcome these drawbacks we present in this short note a simple test problem with boundary control, a situation where one-step methods may suffer from order reduction. We derive exact formulas for the solution of an optimal boundary control problem governed by a one dimensional discrete heat equation and an objective function that measures the distance of the final state from the target and the control costs. This analytical setting is used to compare the numerically observed convergence orders for selected implicit Runge-Kutta and Peer two-step methods of classical order four which are suitable for optimal control problems.
△ Less
Submitted 28 September, 2022;
originally announced September 2022.
-
Krylov Methods for Adjoint-Free Singular Vector Based Perturbations in Dynamical Systems
Authors:
Jens Winkler,
Michael Denhard,
Bernhard A. Schmitt
Abstract:
The estimation of weather forecast uncertainty with ensemble systems requires a careful selection of perturbations to establish a reliable sampling of the error growth potential in the phase space of the model. Usually, the singular vectors of the tangent linear model propagator are used to identify the fastest growing modes (classical singular vector perturbation (SV) method). In this paper we pr…
▽ More
The estimation of weather forecast uncertainty with ensemble systems requires a careful selection of perturbations to establish a reliable sampling of the error growth potential in the phase space of the model. Usually, the singular vectors of the tangent linear model propagator are used to identify the fastest growing modes (classical singular vector perturbation (SV) method). In this paper we present an efficient matrix-free block Krylov method for generating fast growing perturbations in high dimensional dynamical systems. A specific matrix containing the non-linear evolution of perturbations is introduced, which we call Evolved Increment Matrix (EIM). Instead of solving an equivalent eigenvalue problem, we use the Arnoldi method for a direct approximation of the leading singular vectors of this matrix, which however is never computed explicitly. This avoids linear and adjoint models but requires forecasts with the full non-linear system. The performance of the approximated perturbations is compared with singular vectors of a full EIM (not with the classical SV method). We show promising results for the Lorenz96 differential equations and a shallow water model, where we obtain good approximations of the fastest growing perturbations by using only a small number of Arnoldi iterations.
△ Less
Submitted 13 September, 2022;
originally announced September 2022.
-
Implicit A-Stable Peer Triplets for ODE Constrained Optimal Control Problems
Authors:
Jens Lang,
Bernhard A. Schmitt
Abstract:
This paper is concerned with the construction and convergence analysis of novel implicit Peer triplets of two-step nature with four stages for nonlinear ODE constrained optimal control problems. We combine the property of superconvergence of some standard Peer method for inner grid points with carefully designed starting and end methods to achieve order four for the state variables and order three…
▽ More
This paper is concerned with the construction and convergence analysis of novel implicit Peer triplets of two-step nature with four stages for nonlinear ODE constrained optimal control problems. We combine the property of superconvergence of some standard Peer method for inner grid points with carefully designed starting and end methods to achieve order four for the state variables and order three for the adjoint variables in a first-discretize-then-optimize approach together with A-stability. The notion triplets emphasizes that these three different Peer methods have to satisfy additional matching conditions. Four such Peer triplets of practical interest are constructed. Also as a benchmark method, the well-known backward differentiation formula BDF4, which is only $A(73.35^o)$-stable, is extended to a special Peer triplet to supply an adjoint consistent method of higher order and BDF type with equidistant nodes. Within the class of Peer triplets, we found a diagonally implicit $A(84^o)$-stable method with nodes symmetric in $[0,1]$ to a common center that performs equally well. Numerical tests with three well established optimal control problems confirm the theoretical findings also concerning A-stability.
△ Less
Submitted 11 June, 2022; v1 submitted 23 January, 2022;
originally announced January 2022.
-
Tensor numerical method for optimal control problems constrained by an elliptic operator with general rank-structured coefficients
Authors:
Boris N. Khoromskij,
Britta Schmitt,
Volker Schulz
Abstract:
We introduce tensor numerical techniques for solving optimal control problems constrained by elliptic operators in $\mathbb{R}^d$, $d=2,3$, with variable coefficients, which can be represented in a low rank separable form. We construct a preconditioned iterative method with an adaptive rank truncation for solving the equation for the control function, governed by a sum of the elliptic operator and…
▽ More
We introduce tensor numerical techniques for solving optimal control problems constrained by elliptic operators in $\mathbb{R}^d$, $d=2,3$, with variable coefficients, which can be represented in a low rank separable form. We construct a preconditioned iterative method with an adaptive rank truncation for solving the equation for the control function, governed by a sum of the elliptic operator and its inverse $M=A + A^{-1}$, both discretized over large $n^{\otimes d}$, $d=2,3$, spatial grids. Two basic solution schemes are proposed and analyzed. In the first approach, one solves iteratively the initial linear system of equations with the matrix $M$ such that the matrix vector multiplication with the elliptic operator inverse, $y=A^{-1} u,$ is performed as an embedded iteration by using a rank-structured solver for the equation of the form $A y=u$. The second numerical scheme avoids the embedded iteration by reducing the initial equation to an equivalent one with the polynomial system matrix of the form $A^2 +I$. For both schemes, a low Kronecker rank spectrally equivalent preconditioner is constructed by using the corresponding matrix valued function of the anisotropic Laplacian diagonalized in the Fourier basis. Numerical tests for control problems in 2D setting confirm the linear-quadratic complexity scaling of the proposed method in the univariate grid size $n$. Further, we numerically demonstrate that for our low rank solution method, a cascadic multigrid approach reduces the number of PCG iterations considerably, however the total CPU time remains merely the same as for the unigrid iteration.
△ Less
Submitted 27 May, 2021;
originally announced May 2021.
-
Tensor Method for Optimal Control Problems Constrained by Fractional 3D Elliptic Operator with Variable Coefficients
Authors:
Britta Schmitt,
Boris N. Khoromskij,
Venera Khoromskaia,
Volker Schulz
Abstract:
We introduce the tensor numerical method for solving optimal control problems that are constrained by fractional 2D and 3D elliptic operators with variable coefficients. We solve the governing equation for the control function which includes a sum of the fractional operator and its inverse, both discretized over large 3D $n\times n \times n$ spacial grids. Using the diagonalization of the arising…
▽ More
We introduce the tensor numerical method for solving optimal control problems that are constrained by fractional 2D and 3D elliptic operators with variable coefficients. We solve the governing equation for the control function which includes a sum of the fractional operator and its inverse, both discretized over large 3D $n\times n \times n$ spacial grids. Using the diagonalization of the arising matrix valued functions in the eigenbasis of the 1D Sturm-Liouville operators, we construct the rank-structured tensor approximation with controllable precision for the discretized fractional elliptic operators and the respective preconditioner. The right-hand side in the constraining equation (the optimal design function) is supposed to be represented in a form of a low-rank canonical tensor. Then the equation for the control function is solved in a tensor structured format by using preconditioned CG iteration with the adaptive rank truncation procedure that also ensures the accuracy of calculations, given an $\varepsilon$-threshold. This method reduces the numerical cost for solving the control problem to $O(n \log n)$ (plus the quadratic term $O(n^2)$ with a small weight), which is superior to the approaches based on the traditional linear algebra tools that yield at least $O(n^3 \log n)$ complexity in the 3D case. The storage for the representation of all 3D nonlocal operators and functions involved is also estimated by $O(n \log n)$. This essentially outperforms the traditional methods operating with fully populated $n^3 \times n^3$ matrices and vectors in $\mathbb{R}^{n^3}$. Numerical tests for 2D/3D control problems indicate the almost linear complexity scaling of the rank truncated PCG iteration in the univariate grid size $n$.
△ Less
Submitted 6 July, 2020; v1 submitted 16 June, 2020;
originally announced June 2020.
-
Discrete Adjoint Implicit Peer Methods in Optimal Control
Authors:
Jens Lang,
Bernhard A. Schmitt
Abstract:
It is well known that in the first-discretize-then-optimize approach in the control of ordinary differential equations the adjoint method may converge under additional order conditions only. For Peer two-step methods we derive such adjoint order conditions and pay special attention to the boundary steps. For $s$-stage methods, we prove convergence of order $s$ for the state variables if the adjoin…
▽ More
It is well known that in the first-discretize-then-optimize approach in the control of ordinary differential equations the adjoint method may converge under additional order conditions only. For Peer two-step methods we derive such adjoint order conditions and pay special attention to the boundary steps. For $s$-stage methods, we prove convergence of order $s$ for the state variables if the adjoint method satisfies the conditions for order $s\!-\!1$, at least. We remove some bottlenecks at the boundaries encountered in an earlier paper of the first author et al. [J. Comput. Appl. Math., 262:73-86, 2014] and discuss the construction of 3-stage methods for the order pair (3,2) in detail including some matrix background for the combined forward and adjoint order conditions. The impact of nodes having equal differences is highlighted. It turns out that the most attractive methods are related to BDF. Three 3-stage methods are constructed which show the expected orders in numerical tests.
△ Less
Submitted 27 February, 2020;
originally announced February 2020.
-
Algebraic criteria for A-stability of peer two-step methods
Authors:
Bernhard A. Schmitt
Abstract:
A new criterion for A-stability of peer two-step methods is presented which is verifiable exactly in exact arithmetic by checking semi-definiteness of a certain test matrix. It depends on the existence of two positive definite weight matrices for a given method. Although the initial approach is different using properties of the numerical radius the criterion itself resembles the one from algebraic…
▽ More
A new criterion for A-stability of peer two-step methods is presented which is verifiable exactly in exact arithmetic by checking semi-definiteness of a certain test matrix. It depends on the existence of two positive definite weight matrices for a given method. Although the initial approach is different using properties of the numerical radius the criterion itself resembles the one from algebraic stability of General Linear Methods. Known numerical algorithms for the computation of the unknown weight matrices suffer from rank deficiencies of the test matrix. For $s$-stage peer methods of order $s-1$ this rank defect is identified with an explicit block diagonal decomposition of the test matrix in trivial and definite blocks. In the design of methods its coefficients are unknown and an explicit parametrization of A-stable peer methods of order $s-1$ is presented with a weight matrix as parameter. This leads to a general existence result for any number of stages. The restrictions for efficient L-stable peer methods like diagonally-implicit and parallel ones are also discussed and such methods with $3$ and $4$ stages are constructed.
△ Less
Submitted 18 June, 2015;
originally announced June 2015.
-
A Graph Theoretical Analysis of the Number of Edges in k-dense Graphs
Authors:
Linda Eroh,
Henry Escuardo,
Ralucca Gera,
Samuel Prahlow,
Karl R. B. Schmitt
Abstract:
Due to the increasing discovery and implementation of networks within all disciplines of life, the study of subgraph connectivity has become increasingly important. Motivated by the idea of community (or sub-graph) detection within a network/graph, we focused on finding characterizations of k-dense communities. For each edge $uv\in E(G)$, the {\bf edge multiplicity} of $uv$ in $G$ is given by…
▽ More
Due to the increasing discovery and implementation of networks within all disciplines of life, the study of subgraph connectivity has become increasingly important. Motivated by the idea of community (or sub-graph) detection within a network/graph, we focused on finding characterizations of k-dense communities. For each edge $uv\in E(G)$, the {\bf edge multiplicity} of $uv$ in $G$ is given by $m_G(uv)=|N_{G}(u)\cap N_{G}(v)|.$ For an integer $k$ with $k\ge 2$, a {\bf $k$-dense community} of a graph $G$, denoted by $DC_k(G)$, is a maximal connected subgraph of $G$ induced by the vertex set $$V_{DC_k(G)} = \{v\in V(G) : \exists u\in V(G)\ {\rm such\ that\} uv\in E(G)\ {\rm and\} m_{DC_{k(G)}}(uv)\ge k-2\}.$$ In this research, we characterize which graphs are $k$-dense but not $(k+1)$-dense for some values of $k$ and study the minimum and maximum number of edges such graphs can have. A better understanding of $k$-dense sub-graphs (or communities) helps in the study of the connectivity of large complex graphs (or networks) in the real world.
△ Less
Submitted 16 May, 2015;
originally announced May 2015.
-
Statistical Consequences of Devroye Inequality for Processes. Applications to a Class of Non-Uniformly Hyperbolic Dynamical Systems
Authors:
J. -R. Chazottes,
P. Collet,
B. Schmitt
Abstract:
In this paper, we apply Devroye inequality to study various statistical estimators and fluctuations of observables for processes. Most of these observables are suggested by dynamical systems. These applications concern the co-variance function, the integrated periodogram, the correlation dimension, the kernel density estimator, the speed of convergence of empirical measure, the shadowing propert…
▽ More
In this paper, we apply Devroye inequality to study various statistical estimators and fluctuations of observables for processes. Most of these observables are suggested by dynamical systems. These applications concern the co-variance function, the integrated periodogram, the correlation dimension, the kernel density estimator, the speed of convergence of empirical measure, the shadowing property and the almost-sure central limit theorem. We proved in \cite{CCS} that Devroye inequality holds for a class of non-uniformly hyperbolic dynamical systems introduced in \cite{young}. In the second appendix we prove that, if the decay of correlations holds with a common rate for all pairs of functions, then it holds uniformly in the function spaces. In the last appendix we prove that for the subclass of one-dimensional systems studied in \cite{young} the density of the absolutely continuous invariant measure belongs to a Besov space.
△ Less
Submitted 17 June, 2005; v1 submitted 8 December, 2004;
originally announced December 2004.
-
Devroye Inequality for a Class of Non-Uniformly Hyperbolic Dynamical Systems
Authors:
J. -R. Chazottes,
P. Collet,
B. Schmitt
Abstract:
In this paper, we prove an inequality, which we call "Devroye inequality", for a large class of non-uniformly hyperbolic dynamical systems (M,f). This class, introduced by L.-S. Young, includes families of piece-wise hyperbolic maps (Lozi-like maps), scattering billiards (e.g., planar Lorentz gas), unimodal and H{é}non-like maps. Devroye inequality provides an upper bound for the variance of obs…
▽ More
In this paper, we prove an inequality, which we call "Devroye inequality", for a large class of non-uniformly hyperbolic dynamical systems (M,f). This class, introduced by L.-S. Young, includes families of piece-wise hyperbolic maps (Lozi-like maps), scattering billiards (e.g., planar Lorentz gas), unimodal and H{é}non-like maps. Devroye inequality provides an upper bound for the variance of observables of the form K(x,f(x),...,f^{n-1}(x)), where K is any separately Holder continuous function of n variables. In particular, we can deal with observables which are not Birkhoff averages. We will show in \cite{CCS} some applications of Devroye inequality to statistical properties of this class of dynamical systems.
△ Less
Submitted 17 June, 2005; v1 submitted 8 December, 2004;
originally announced December 2004.
