-
The RQR algorithm
Authors:
Daan Camps,
Thomas Mach,
Raf Vandebril,
David S. Watkins
Abstract:
Pole-swapping algorithms, generalizations of bulge-chasing algorithms, have been shown to be a viable alternative to the bulge-chasing QZ algorithm for solving the generalized eigenvalue problem for a matrix pencil A - λB. It is natural to try to devise a pole-swapping algorithm that solves the standard eigenvalue problem for a single matrix A. This paper introduces such an algorithm and shows tha…
▽ More
Pole-swapping algorithms, generalizations of bulge-chasing algorithms, have been shown to be a viable alternative to the bulge-chasing QZ algorithm for solving the generalized eigenvalue problem for a matrix pencil A - λB. It is natural to try to devise a pole-swapping algorithm that solves the standard eigenvalue problem for a single matrix A. This paper introduces such an algorithm and shows that it is competitive with Francis's bulge-chasing QR algorithm.
△ Less
Submitted 28 April, 2025; v1 submitted 26 November, 2024;
originally announced November 2024.
-
Solving the Parametric Eigenvalue Problem by Taylor Series and Chebyshev Expansion
Authors:
Thomas Mach,
Melina A. Freitag
Abstract:
We discuss two approaches to solving the parametric (or stochastic) eigenvalue problem. One of them uses a Taylor expansion and the other a Chebyshev expansion. The parametric eigenvalue problem assumes that the matrix $A$ depends on a parameter $μ$, where $μ$ might be a random variable. Consequently, the eigenvalues and eigenvectors are also functions of $μ$. We compute a Taylor approximation of…
▽ More
We discuss two approaches to solving the parametric (or stochastic) eigenvalue problem. One of them uses a Taylor expansion and the other a Chebyshev expansion. The parametric eigenvalue problem assumes that the matrix $A$ depends on a parameter $μ$, where $μ$ might be a random variable. Consequently, the eigenvalues and eigenvectors are also functions of $μ$. We compute a Taylor approximation of these functions about $μ_{0}$ by iteratively computing the Taylor coefficients. The complexity of this approach is $O(n^{3})$ for all eigenpairs, if the derivatives of $A(μ)$ at $μ_{0}$ are given. The Chebyshev expansion works similarly. We first find an initial approximation iteratively which we then refine with Newton's method. This second method is more expensive but provides a good approximation over the whole interval of the expansion instead around a single point.
We present numerical experiments confirming the complexity and demonstrating that the approaches are capable of tracking eigenvalues at intersection points. Further experiments shed light on the limitations of the Taylor expansion approach with respect to the distance from the expansion point $μ_{0}$.
△ Less
Submitted 7 February, 2023;
originally announced February 2023.
-
Adaptive cross approximation for Tikhonov regularization in general form
Authors:
Thomas Mach,
Lothar Reichel,
Marc Van Barel
Abstract:
Many problems in Science and Engineering give rise to linear integral equations of the first kind with a smooth kernel. Discretization of the integral operator yields a matrix, whose singular values cluster at the origin. We describe the approximation of such matrices by adaptive cross approximation, which avoids forming the entire matrix. The choice of the number of steps of adaptive cross approx…
▽ More
Many problems in Science and Engineering give rise to linear integral equations of the first kind with a smooth kernel. Discretization of the integral operator yields a matrix, whose singular values cluster at the origin. We describe the approximation of such matrices by adaptive cross approximation, which avoids forming the entire matrix. The choice of the number of steps of adaptive cross approximation is discussed. The discretized right-hand side represents data that commonly are contaminated by measurement error. Solution of the linear system of equations so obtained is not meaningful because the matrix determined by adaptive cross approximation is rank-deficient. We remedy this difficulty by using Tikhonov regularization and discuss how a fairly general regularization matrix can be used. Computed examples illustrate that the use of a regularization matrix different from the identity can improve the quality of the computed approximate solutions significantly.
△ Less
Submitted 12 April, 2022;
originally announced April 2022.
-
Continuous Adaptive Cross Approximation for Ill-posed Problems with Chebfun
Authors:
Abdulaziz Alqahtani,
Thomas Mach,
Lothar Reichel
Abstract:
The analysis of linear ill-posed problems often is carried out in function spaces using tools from functional analysis. However, the numerical solution of these problems typically is computed by first discretizing the problem and then applying tools from (finite-dimensional) linear algebra. The present paper explores the feasibility of applying the Chebfun package to solve ill-posed problems. This…
▽ More
The analysis of linear ill-posed problems often is carried out in function spaces using tools from functional analysis. However, the numerical solution of these problems typically is computed by first discretizing the problem and then applying tools from (finite-dimensional) linear algebra. The present paper explores the feasibility of applying the Chebfun package to solve ill-posed problems. This approach allows a user to work with functions instead of matrices. The solution process therefore is much closer to the analysis of ill-posed problems than standard linear algebra-based solution methods.
△ Less
Submitted 31 July, 2020;
originally announced July 2020.
-
Pole-swapping algorithms for alternating and palindromic eigenvalue problems
Authors:
Thomas Mach,
Thijs Steel,
Raf Vandebril,
David S. Watkins
Abstract:
Pole-swapping algorithms are generalizations of bulge-chasing algorithms for the generalized eigenvalue problem. Structure-preserving pole-swapping algorithms for the palindromic and alternating eigenvalue problems, which arise in control theory, are derived. A refinement step that guarantees backward stability of the algorithms is included. This refinement can also be applied to bulge-chasing alg…
▽ More
Pole-swapping algorithms are generalizations of bulge-chasing algorithms for the generalized eigenvalue problem. Structure-preserving pole-swapping algorithms for the palindromic and alternating eigenvalue problems, which arise in control theory, are derived. A refinement step that guarantees backward stability of the algorithms is included. This refinement can also be applied to bulge-chasing algorithms that had been introduced previously, thereby guaranteeing their backward stability in all cases.
△ Less
Submitted 9 December, 2019; v1 submitted 24 June, 2019;
originally announced June 2019.
-
On pole-swapping algorithms for the eigenvalue problem
Authors:
Daan Camps,
Thomas Mach,
Raf Vandebril,
David S. Watkins
Abstract:
Pole-swapping algorithms, which are generalizations of the QZ algorithm for the generalized eigenvalue problem, are studied. A new modular (and therefore more flexible) convergence theory that applies to all pole-swapping algorithms is developed. A key component of all such algorithms is a procedure that swaps two adjacent eigenvalues in a triangular pencil. An improved swapping routine is develop…
▽ More
Pole-swapping algorithms, which are generalizations of the QZ algorithm for the generalized eigenvalue problem, are studied. A new modular (and therefore more flexible) convergence theory that applies to all pole-swapping algorithms is developed. A key component of all such algorithms is a procedure that swaps two adjacent eigenvalues in a triangular pencil. An improved swapping routine is developed, and its superiority over existing methods is demonstrated by a backward error analysis and numerical tests. The modularity of the new convergence theory and the generality of the pole-swapping approach shed new light on bi-directional chasing algorithms, optimally packed shifts, and bulge pencils, and allow the design of novel algorithms.
△ Less
Submitted 11 May, 2020; v1 submitted 20 June, 2019;
originally announced June 2019.
-
Recursive tree processes and the mean-field limit of stochastic flows
Authors:
Tibor Mach,
Anja Sturm,
Jan M. Swart
Abstract:
Interacting particle systems can often be constructed from a graphical representation, by applying local maps at the times of associated Poisson processes. This leads to a natural coupling of systems started in different initial states. We consider interacting particle systems on the complete graph in the mean-field limit, i.e., as the number of vertices tends to infinity. We are not only interest…
▽ More
Interacting particle systems can often be constructed from a graphical representation, by applying local maps at the times of associated Poisson processes. This leads to a natural coupling of systems started in different initial states. We consider interacting particle systems on the complete graph in the mean-field limit, i.e., as the number of vertices tends to infinity. We are not only interested in the mean-field limit of a single process, but mainly in how several coupled processes behave in the limit. This turns out to be closely related to recursive tree processes as studied by Aldous and Bandyopadyay in discrete time. We here develop an analogue theory for recursive tree processes in continuous time. We illustrate the abstract theory on an example of a particle system with cooperative branching. This yields an interesting new example of a recursive tree process that is not endogenous.
△ Less
Submitted 18 March, 2020; v1 submitted 27 December, 2018;
originally announced December 2018.
-
A new characterization of endogeny
Authors:
Tibor Mach,
Anja Sturm,
Jan M. Swart
Abstract:
Aldous and Bandyopadhyay have shown that each solution to a recursive distributional equation (RDE) gives rise to recursive tree process (RTP), which is a sort of Markov chain in which time has a tree-like structure and in which the state of each vertex is a random function of its descendants. If the state at the root is measurable with respect to the sigma field generated by the random functions…
▽ More
Aldous and Bandyopadhyay have shown that each solution to a recursive distributional equation (RDE) gives rise to recursive tree process (RTP), which is a sort of Markov chain in which time has a tree-like structure and in which the state of each vertex is a random function of its descendants. If the state at the root is measurable with respect to the sigma field generated by the random functions attached to all vertices, then the RTP is said to be endogenous. For RTPs defined by continuous maps, Aldous and Bandyopadhyay showed that endogeny is equivalent to bivariate uniqueness, and they asked if the continuity hypothesis can be removed. We introduce a higher-level RDE that through its $n$-th moment measures contains all $n$-variate RDEs. We show that this higher-level RDE has minimal and maximal fixed points with respect to the convex order, and that these coincide if and only if the corresponding RTP is endogenous. As a side result, this allows us to answer the question of Aldous and Bandyopadhyay positively.
△ Less
Submitted 1 October, 2018; v1 submitted 16 January, 2018;
originally announced January 2018.
-
Fast and backward stable computation of the eigenvalues and eigenvectors of matrix polynomials
Authors:
Jared Aurentz,
Thomas Mach,
Leonardo Robol,
Raf Vandebril,
David S. Watkins
Abstract:
In the last decade matrix polynomials have been investigated with the primary focus on adequate linearizations and good scaling techniques for computing their eigenvalues and eigenvectors. In this article we propose a new method for computing a factored Schur form of the associated companion pencil. The algorithm has a quadratic cost in the degree of the polynomial and a cubic one in the size of t…
▽ More
In the last decade matrix polynomials have been investigated with the primary focus on adequate linearizations and good scaling techniques for computing their eigenvalues and eigenvectors. In this article we propose a new method for computing a factored Schur form of the associated companion pencil. The algorithm has a quadratic cost in the degree of the polynomial and a cubic one in the size of the coefficient matrices. Also the eigenvectors can be computed at the same cost.
The algorithm is a variant of Francis's implicitly shifted QR algorithm applied on the companion pencil. A preprocessing unitary equivalence is executed on the matrix polynomial to simultaneously bring the leading matrix coefficient and the constant matrix term to triangular form before forming the companion pencil. The resulting structure allows us to stably factor each matrix of the pencil as a product of $k$ matrices of unitary-plus-rank-one form, admitting cheap and numerically reliable storage. The problem is then solved as a product core chasing eigenvalue problem. A backward error analysis is included, implying normwise backward stability after a proper scaling. Computing the eigenvectors via reordering the Schur form is discussed as well.
Numerical experiments illustrate stability and efficiency of the proposed methods.
△ Less
Submitted 16 June, 2017; v1 submitted 30 November, 2016;
originally announced November 2016.
-
Fast and backward stable computation of roots of polynomials, Part II: backward error analysis; companion matrix and companion pencil
Authors:
Jared L. Aurentz,
Thomas Mach,
Leonardo Robol,
Raf Vandebril,
David S. Watkins
Abstract:
This work is a continuation of "Fast and backward stable computation of roots of polynomials" by J.L. Aurentz, T. Mach, R. Vandebril, and D.S. Watkins, SIAM Journal on Matrix Analysis and Applications, 36(3): 942--973, 2015. In that paper we introduced a companion QR algorithm that finds the roots of a polynomial by computing the eigenvalues of the companion matrix in $O(n^{2})$ time using $O(n)$…
▽ More
This work is a continuation of "Fast and backward stable computation of roots of polynomials" by J.L. Aurentz, T. Mach, R. Vandebril, and D.S. Watkins, SIAM Journal on Matrix Analysis and Applications, 36(3): 942--973, 2015. In that paper we introduced a companion QR algorithm that finds the roots of a polynomial by computing the eigenvalues of the companion matrix in $O(n^{2})$ time using $O(n)$ memory. We proved that the method is backward stable. Here we introduce, as an alternative, a companion QZ algorithm that solves a generalized eigenvalue problem for a companion pencil. More importantly, we provide an improved backward error analysis that takes advantage of the special structure of the problem. The improvement is also due, in part, to an improvement in the accuracy (in both theory and practice) of the turnover operation, which is the key component of our algorithms.
We prove that for the companion QR algorithm, the backward error on the polynomial coefficients varies linearly with the norm of the polynomial's vector of coefficients. Thus the companion QR algorithm has a smaller backward error than the unstructured QR algorithm (used by MATLAB's \texttt{roots} command, for example), for which the backward error on the polynomial coefficients grows quadratically with the norm of the coefficient vector. The companion QZ algorithm has the same favorable backward error as companion QR, provided that the polynomial coefficients are properly scaled.
△ Less
Submitted 19 July, 2018; v1 submitted 8 November, 2016;
originally announced November 2016.
-
Computing the eigenvalues of symmetric H2-matrices by slicing the spectrum
Authors:
Peter Benner,
Steffen Börm,
Thomas Mach,
Knut Reimer
Abstract:
The computation of eigenvalues of large-scale matrices arising from finite element discretizations has gained significant interest in the last decade. Here we present a new algorithm based on slicing the spectrum that takes advantage of the rank structure of resolvent matrices in order to compute m eigenvalues of the generalized symmetric eigenvalue problem in $\mathcal{O}(n m \log^αn)$ operations…
▽ More
The computation of eigenvalues of large-scale matrices arising from finite element discretizations has gained significant interest in the last decade. Here we present a new algorithm based on slicing the spectrum that takes advantage of the rank structure of resolvent matrices in order to compute m eigenvalues of the generalized symmetric eigenvalue problem in $\mathcal{O}(n m \log^αn)$ operations, where $α>0$ is a small constant.
△ Less
Submitted 15 July, 2014; v1 submitted 17 March, 2014;
originally announced March 2014.
