-
Randomized methods for dynamical low-rank approximation
Authors:
Benjamin Carrel
Abstract:
We introduce novel dynamical low-rank methods for solving large-scale matrix differential equations, motivated by algorithms from randomized numerical linear algebra. In terms of performance (cost and accuracy), our methods overperform existing dynamical low-rank techniques. Several applications to stiff differential equations demonstrate the robustness, accuracy and low variance of the new method…
▽ More
We introduce novel dynamical low-rank methods for solving large-scale matrix differential equations, motivated by algorithms from randomized numerical linear algebra. In terms of performance (cost and accuracy), our methods overperform existing dynamical low-rank techniques. Several applications to stiff differential equations demonstrate the robustness, accuracy and low variance of the new methods, despite their inherent randomness. Allowing augmentation of the range and corange, the new methods have a good potential for preserving critical physical quantities such as the energy, mass and momentum. Numerical experiments on the Vlasov-Poisson equation are particularly encouraging.
The new methods comprise two essential steps: a range estimation step followed by a post-processing step. The range estimation is achieved through a novel dynamical rangefinder method. Subsequently, we propose two methods for post-processing, leading to two time-stepping methods: dynamical randomized singular value decomposition (DRSVD) and dynamical generalized Nyström (DGN). The new methods naturally extend to the rank-adaptive framework by estimating the error via Gaussian sampling.
△ Less
Submitted 20 June, 2025; v1 submitted 22 October, 2024;
originally announced October 2024.
-
Projected exponential methods for stiff dynamical low-rank approximation problems
Authors:
Benjamin Carrel,
Bart Vandereycken
Abstract:
The numerical integration of stiff equations is a challenging problem that needs to be approached by specialized numerical methods. Exponential integrators form a popular class of such methods since they are provably robust to stiffness and have been successfully applied to a variety of problems. The dynamical low- \rank approximation is a recent technique for solving high-dimensional differential…
▽ More
The numerical integration of stiff equations is a challenging problem that needs to be approached by specialized numerical methods. Exponential integrators form a popular class of such methods since they are provably robust to stiffness and have been successfully applied to a variety of problems. The dynamical low- \rank approximation is a recent technique for solving high-dimensional differential equations by means of low-rank approximations. However, the domain is lacking numerical methods for stiff equations since existing methods are either not robust-to-stiffness or have unreasonably large hidden constants. In this paper, we focus on solving large-scale stiff matrix differential equations with a Sylvester-like structure, that admit good low-rank approximations. We propose two new methods that have good convergence properties, small memory footprint and that are fast to compute. The theoretical analysis shows that the new methods have order one and two, respectively. We also propose a practical implementation based on Krylov techniques. The approximation error is analyzed, leading to a priori error bounds and, therefore, a mean for choosing the size of the Krylov space. Numerical experiments are performed on several examples, confirming the theory and showing good speedup in comparison to existing techniques.
△ Less
Submitted 14 May, 2024; v1 submitted 30 November, 2023;
originally announced December 2023.
-
Low-rank Parareal: a low-rank parallel-in-time integrator
Authors:
Benjamin Carrel,
Martin J. Gander,
Bart Vandereycken
Abstract:
In this work, the Parareal algorithm is applied to evolution problems that admit good low-rank approximations and for which the dynamical low-rank approximation (DLRA) can be used as time stepper. Many discrete integrators for DLRA have recently been proposed, based on splitting the projected vector field or by applying projected Runge--Kutta methods. The cost and accuracy of these methods are mos…
▽ More
In this work, the Parareal algorithm is applied to evolution problems that admit good low-rank approximations and for which the dynamical low-rank approximation (DLRA) can be used as time stepper. Many discrete integrators for DLRA have recently been proposed, based on splitting the projected vector field or by applying projected Runge--Kutta methods. The cost and accuracy of these methods are mostly governed by the rank chosen for the approximation. These properties are used in a new method, called low-rank Parareal, in order to obtain a time-parallel DLRA solver for evolution problems. The algorithm is analyzed on affine linear problems and the results are illustrated numerically.
△ Less
Submitted 13 September, 2022; v1 submitted 16 March, 2022;
originally announced March 2022.
