-
Mixed-precision algorithms for solving the Sylvester matrix equation
Authors:
Andrii Dmytryshyn,
Massimiliano Fasi,
Nicholas J. Higham,
Xiaobo Liu
Abstract:
We consider the solution of the general Sylvester equation $AX+XB=C$ in mixed precision. First, we investigate the use of GMRES-based iterative refinement (GMRES-IR) to solve the equation using implicitly its Kronecker product form: we propose an efficient scheme to use the Schur factors of the coefficient matrices as preconditioners, but we demonstrate that this approach is not suitable in the ca…
▽ More
We consider the solution of the general Sylvester equation $AX+XB=C$ in mixed precision. First, we investigate the use of GMRES-based iterative refinement (GMRES-IR) to solve the equation using implicitly its Kronecker product form: we propose an efficient scheme to use the Schur factors of the coefficient matrices as preconditioners, but we demonstrate that this approach is not suitable in the case of the Sylvester equation. By revisiting a stationary iteration for linear systems, we therefore derive a new iterative refinement scheme for the quasi-triangular Sylvester equation, and our rounding error analysis provides sufficient conditions for convergence and a bound on the attainable relative residual. We leverage this iterative scheme to solve the general Sylvester equation in mixed precision. The new algorithms compute the Schur decomposition of the matrix coefficients in low precision, use the low-precision Schur factors to obtain an approximate solution to the quasi-triangular equation, and iteratively refine it to obtain a working-precision solution to the quasi-triangular equation. However, being only orthonormal to low precision, the unitary Schur factors of $A$ and $B$ cannot be used to recover the solution to the original equation. We propose two effective approaches to address this issue: one is based on re-orthonormalization in the working precision, and the other on explicit inversion of the almost-unitary factors. We test these mixed-precision algorithms on various Sylvester and Lyapunov equations from the literature. Our numerical experiments show that, for both classes of equations, the new algorithms are at least as accurate as existing ones. Our cost analysis, on the other hand, suggests that they would typically be faster than mono-precision alternatives if implemented on hardware that natively supports low precision.
△ Less
Submitted 5 March, 2025;
originally announced March 2025.
-
Even grade generic skew-symmetric matrix polynomials with bounded rank
Authors:
Fernando De Terán,
Andrii Dmytryshyn,
Froilán M. Dopico
Abstract:
We show that the set of $m \times m$ complex skew-symmetric matrix polynomials of even grade $d$, i.e., of degree at most $d$, and (normal) rank at most $2r$ is the closure of the single set of matrix polynomials with certain, explicitly described, complete eigenstructure. This complete eigenstructure corresponds to the most generic $m \times m$ complex skew-symmetric matrix polynomials of even gr…
▽ More
We show that the set of $m \times m$ complex skew-symmetric matrix polynomials of even grade $d$, i.e., of degree at most $d$, and (normal) rank at most $2r$ is the closure of the single set of matrix polynomials with certain, explicitly described, complete eigenstructure. This complete eigenstructure corresponds to the most generic $m \times m$ complex skew-symmetric matrix polynomials of even grade $d$ and rank at most $2r$. The analogous problem for the case of skew-symmetric matrix polynomials of odd grade is solved in [Linear Algebra Appl., 536:1-18, 2018].
△ Less
Submitted 27 December, 2023;
originally announced December 2023.
-
Versal deformations: A tool of linear algebra
Authors:
Andrii Dmytryshyn
Abstract:
Versal deformation of a matrix A is a normal form to which all matrices A + E, close to A, can be reduced by similarity transformation smoothly depending on the entries of A + E. In this paper we discuss versal deformations and their use in codimension computations, in investigation of closure relations of orbits and bundles, in studying changes of canonical forms under perturbations, as well as i…
▽ More
Versal deformation of a matrix A is a normal form to which all matrices A + E, close to A, can be reduced by similarity transformation smoothly depending on the entries of A + E. In this paper we discuss versal deformations and their use in codimension computations, in investigation of closure relations of orbits and bundles, in studying changes of canonical forms under perturbations, as well as in reduction of unstructured perturbations to structured perturbations.
△ Less
Submitted 22 December, 2023;
originally announced December 2023.
-
Minimal rank factorizations of polynomial matrices
Authors:
Andrii Dmytryshyn,
Froilán Dopico,
Paul Van Dooren
Abstract:
We investigate rank revealing factorizations of $m \times n$ polynomial matrices $P(λ)$ into products of three, $P(λ) = L(λ) E(λ) R(λ)$, or two, $P(λ) = L(λ) R(λ)$, polynomial matrices. Among all possible factorizations of these types, we focus on those for which $L(λ)$ and/or $R(λ)$ is a minimal basis, since they have favorable properties from the point of view of data compression and allow us to…
▽ More
We investigate rank revealing factorizations of $m \times n$ polynomial matrices $P(λ)$ into products of three, $P(λ) = L(λ) E(λ) R(λ)$, or two, $P(λ) = L(λ) R(λ)$, polynomial matrices. Among all possible factorizations of these types, we focus on those for which $L(λ)$ and/or $R(λ)$ is a minimal basis, since they have favorable properties from the point of view of data compression and allow us to relate easily the degree of $P(λ)$ with some degree properties of the factors. We call these factorizations minimal rank factorizations. Motivated by the well-known fact that, generically, rank deficient polynomial matrices over the complex field do not have eigenvalues, we pay particular attention to the properties of the minimal rank factorizations of polynomial matrices without eigenvalues. We carefully analyze the degree properties of generic minimal rank factorizations in the set of complex $m \times n$ polynomial matrices with normal rank at most $r< \min \{m,n\}$ and degree at most $d$, and we prove that there are only $rd+1$ different classes of generic factorizations according to the degree properties of the factors and that all of them are of the form $L(λ) R(λ)$, where the degrees of the $r$ columns of $L(λ)$ differ at most by one, the degrees of the $r$ rows of $R(λ)$ differ at most by one, and, for each $i=1, \ldots, r$, the sum of the degrees of the $i$th column of $L(λ)$ and of the $i$th row of $R(λ)$ is equal to $d$. Finally, we show how these sets of polynomial matrices with generic factorizations are related to the sets of polynomial matrices with generic eigenstructures.
△ Less
Submitted 2 October, 2024; v1 submitted 1 December, 2023;
originally announced December 2023.
-
Simulations of quantum dynamics with fermionic phase-space representations using numerical matrix factorizations as stochastic gauges
Authors:
F Rousse,
M Fasi,
A Dmytryshyn,
M Gulliksson,
M Ogren
Abstract:
The Gaussian phase-space representation can be used to implement quantum dynamics for fermionic particles numerically. To improve numerical results, we explore the use of dynamical diffusion gauges in such implementations. This is achieved by benchmarking quantum dynamics of few-body systems against independent exact solutions. A diffusion gauge is implemented here as a so-called noise-matrix, whi…
▽ More
The Gaussian phase-space representation can be used to implement quantum dynamics for fermionic particles numerically. To improve numerical results, we explore the use of dynamical diffusion gauges in such implementations. This is achieved by benchmarking quantum dynamics of few-body systems against independent exact solutions. A diffusion gauge is implemented here as a so-called noise-matrix, which satisfies a matrix equation defined by the corresponding Fokker--Planck equation of the phase-space representation. For the physical systems with fermionic particles considered here, the numerical evaluation of the new diffusion gauges allows us to double the practical simulation time, compared with hitherto known analytic noise-matrices. This development may have far reaching consequences for future quantum dynamical simulations of many-body systems.
△ Less
Submitted 11 April, 2023;
originally announced April 2023.
-
Generic eigenstructures of Hermitian pencils
Authors:
Fernando De Terán,
Andrii Dmytryshyn,
Froilán M. Dopico
Abstract:
We obtain the generic complete eigenstructures of complex Hermitian $n\times n$ matrix pencils with rank at most $r$ (with $r\leq n$). To do this, we prove that the set of such pencils is the union of a finite number of bundle closures, where each bundle is the set of complex Hermitian $n\times n$ pencils with the same complete eigenstructure (up to the specific values of the finite eigenvalues).…
▽ More
We obtain the generic complete eigenstructures of complex Hermitian $n\times n$ matrix pencils with rank at most $r$ (with $r\leq n$). To do this, we prove that the set of such pencils is the union of a finite number of bundle closures, where each bundle is the set of complex Hermitian $n\times n$ pencils with the same complete eigenstructure (up to the specific values of the finite eigenvalues). We also obtain the explicit number of such bundles and their codimension. The cases $r=n$, corresponding to general Hermitian pencils, and $r<n$ exhibit surprising differences, since for $r<n$ the generic complete eigenstructures can contain only real eigenvalues, while for $r=n$ they can contain real and non-real eigenvalues. Moreover, we will see that the sign characteristic of the real eigenvalues plays a relevant role for determining the generic eigenstructures of Hermitian pencils.
△ Less
Submitted 21 September, 2022;
originally announced September 2022.
-
Recovering a perturbation of a matrix polynomial from a perturbation of its linearization
Authors:
Andrii Dmytryshyn
Abstract:
A number of theoretical and computational problems for matrix polynomials are solved by passing to linearizations. Therefore a perturbation theory results for linearizations need to be related back to matrix polynomials. In this paper we present an algorithm that finds which perturbation of matrix coefficients of a matrix polynomial corresponds to a given perturbation of the entire linearization p…
▽ More
A number of theoretical and computational problems for matrix polynomials are solved by passing to linearizations. Therefore a perturbation theory results for linearizations need to be related back to matrix polynomials. In this paper we present an algorithm that finds which perturbation of matrix coefficients of a matrix polynomial corresponds to a given perturbation of the entire linearization pencil. Moreover we find transformation matrices that, via strict equivalence, transform a perturbation of the linearization to the linearization of a perturbed polynomial. For simplicity, we present the results for the first companion linearization but they can be generalized to a broader class of linearizations.
△ Less
Submitted 4 August, 2020;
originally announced August 2020.
-
Schur decomposition of several matrices
Authors:
Andrii Dmytryshyn
Abstract:
Schur decompositions and the corresponding Schur forms of a single matrix, a pair of matrices, or a collection of matrices associated with the periodic eigenvalue problem are frequently used and studied. These forms are upper-triangular complex matrices or quasi-upper-triangular real matrices that are equivalent to the original matrices via unitary or, respectively, orthogonal transformations. In…
▽ More
Schur decompositions and the corresponding Schur forms of a single matrix, a pair of matrices, or a collection of matrices associated with the periodic eigenvalue problem are frequently used and studied. These forms are upper-triangular complex matrices or quasi-upper-triangular real matrices that are equivalent to the original matrices via unitary or, respectively, orthogonal transformations. In general, for theoretical and numerical purposes we often need to reduce, by admissible transformations, a collection of matrices to the Schur form. Unfortunately, such a reduction is not always possible. In this paper we describe all collections of complex (real) matrices that can be reduced to the Schur form by the corresponding unitary (orthogonal) transformations and explain how such a reduction can be done. We prove that this class consists of the collections of matrices associated with pseudoforest graphs. In other words, we describe when the Schur form of a collection of matrices exists and how to find it.
△ Less
Submitted 1 February, 2023; v1 submitted 11 February, 2020;
originally announced February 2020.
-
Generic symmetric matrix polynomials with bounded rank and fixed odd grade
Authors:
Fernando De Terán,
Andrii Dmytryshyn,
Froilán M. Dopico
Abstract:
We determine the generic complete eigenstructures for $n \times n$ complex symmetric matrix polynomials of odd grade $d$ and rank at most $r$. More precisely, we show that the set of $n \times n$ complex symmetric matrix polynomials of odd grade $d$, i.e., of degree at most $d$, and rank at most $r$ is the union of the closures of the $\lfloor rd/2\rfloor+1$ sets of symmetric matrix polynomials ha…
▽ More
We determine the generic complete eigenstructures for $n \times n$ complex symmetric matrix polynomials of odd grade $d$ and rank at most $r$. More precisely, we show that the set of $n \times n$ complex symmetric matrix polynomials of odd grade $d$, i.e., of degree at most $d$, and rank at most $r$ is the union of the closures of the $\lfloor rd/2\rfloor+1$ sets of symmetric matrix polynomials having certain, explicitly described, complete eigenstructures. Then, we prove that these sets are open in the set of $n \times n$ complex symmetric matrix polynomials of odd grade $d$ and rank at most $r$. In order to prove the previous results, we need to derive necessary and sufficient conditions for the existence of symmetric matrix polynomials with prescribed grade, rank, and complete eigenstructure, in the case where all their elementary divisors are different from each other and of degree $1$. An important remark on the results of this paper is that the generic eigenstructures identified in this work are completely different from the ones identified in previous works for unstructured and skew-symmetric matrix polynomials with bounded rank and fixed grade larger than one, because the symmetric ones include eigenvalues while the others not. This difference requires to use new techniques.
△ Less
Submitted 4 November, 2019;
originally announced November 2019.
-
Generic symmetric matrix pencils with bounded rank
Authors:
Fernando De Terán,
Andrii Dmytryshyn,
Froilán M. Dopico
Abstract:
We show that the set of $n \times n$ complex symmetric matrix pencils of rank at most $r$ is the union of the closures of $\lfloor r/2\rfloor +1$ sets of matrix pencils with some, explicitly described, complete eigenstructures. As a consequence, these are the generic complete eigenstructures of $n \times n$ complex symmetric matrix pencils of rank at most $r$. We also show that these closures corr…
▽ More
We show that the set of $n \times n$ complex symmetric matrix pencils of rank at most $r$ is the union of the closures of $\lfloor r/2\rfloor +1$ sets of matrix pencils with some, explicitly described, complete eigenstructures. As a consequence, these are the generic complete eigenstructures of $n \times n$ complex symmetric matrix pencils of rank at most $r$. We also show that these closures correspond to the irreducible components of the set of $n\times n$ symmetric matrix pencils with rank at most $r$ when considered as an algebraic set.
△ Less
Submitted 9 August, 2018;
originally announced August 2018.
-
Generalization of Roth's solvability criteria to systems of matrix equations
Authors:
Andrii Dmytryshyn,
Vyacheslav Futorny,
Tetiana Klymchuk,
Vladimir V. Sergeichuk
Abstract:
W.E. Roth (1952) proved that the matrix equation $AX-XB=C$ has a solution if and only if the matrices $\left[\begin{matrix}A&C\\0&B\end{matrix}\right]$ and $\left[\begin{matrix}A&0\\0&B\end{matrix}\right]$ are similar. A. Dmytryshyn and B. Kågström (2015) extended Roth's criterion to systems of matrix equations $A_iX_{i'}M_i-N_iX_{i''}^{σ_i} B_i=C_i$ $(i=1,\dots,s)$ with unknown matrices…
▽ More
W.E. Roth (1952) proved that the matrix equation $AX-XB=C$ has a solution if and only if the matrices $\left[\begin{matrix}A&C\\0&B\end{matrix}\right]$ and $\left[\begin{matrix}A&0\\0&B\end{matrix}\right]$ are similar. A. Dmytryshyn and B. Kågström (2015) extended Roth's criterion to systems of matrix equations $A_iX_{i'}M_i-N_iX_{i''}^{σ_i} B_i=C_i$ $(i=1,\dots,s)$ with unknown matrices $X_1,\dots,X_t$, in which every $X^σ$ is $X$, $X^T$, or $X^*$. We extend their criterion to systems of complex matrix equations that include the complex conjugation of unknown matrices. We also prove an analogous criterion for systems of quaternion matrix equations.
△ Less
Submitted 15 April, 2017;
originally announced April 2017.
-
Generic skew-symmetric matrix polynomials with fixed rank and fixed odd grade
Authors:
Andrii Dmytryshyn,
Froilan M. Dopico
Abstract:
We show that the set of $m \times m$ complex skew-symmetric matrix polynomials of odd grade $d$, i.e., of degree at most $d$, and (normal) rank at most $2r$ is the closure of the single set of matrix polynomials with the certain, explicitly described, complete eigenstructure. This complete eigenstructure corresponds to the most generic $m \times m$ complex skew-symmetric matrix polynomials of odd…
▽ More
We show that the set of $m \times m$ complex skew-symmetric matrix polynomials of odd grade $d$, i.e., of degree at most $d$, and (normal) rank at most $2r$ is the closure of the single set of matrix polynomials with the certain, explicitly described, complete eigenstructure. This complete eigenstructure corresponds to the most generic $m \times m$ complex skew-symmetric matrix polynomials of odd grade $d$ and rank at most $2r$. In particular, this result includes the case of skew-symmetric matrix pencils ($d=1$).
△ Less
Submitted 16 March, 2017;
originally announced March 2017.
-
Generic matrix polynomials with fixed rank and fixed degree
Authors:
Andrii Dmytryshyn,
Froilán M. Dopico
Abstract:
The set ${\cal P}^{m\times n}_{r,d}$ of $m \times n$ complex matrix polynomials of grade $d$ and (normal) rank at most $r$ in a complex $(d+1)mn$ dimensional space is studied. For $r = 1, \dots , \min \{m, n\}-1$, we show that ${\cal P}^{m\times n}_{r,d}$ is the union of the closures of the $rd+1$ sets of matrix polynomials with rank $r$, degree exactly $d$, and explicitly described complete eigen…
▽ More
The set ${\cal P}^{m\times n}_{r,d}$ of $m \times n$ complex matrix polynomials of grade $d$ and (normal) rank at most $r$ in a complex $(d+1)mn$ dimensional space is studied. For $r = 1, \dots , \min \{m, n\}-1$, we show that ${\cal P}^{m\times n}_{r,d}$ is the union of the closures of the $rd+1$ sets of matrix polynomials with rank $r$, degree exactly $d$, and explicitly described complete eigenstructures. In addition, for the full-rank rectangular polynomials, i.e. $r= \min \{m, n\}$ and $m \neq n$, we show that ${\cal P}^{m\times n}_{r,d}$ coincides with the closure of a single set of the polynomials with rank $r$, degree exactly $d$, and the described complete eigenstructure. These complete eigenstructures correspond to generic $m \times n$ matrix polynomials of grade $d$ and rank at most~$r$.
△ Less
Submitted 13 December, 2016;
originally announced December 2016.
-
Miniversal deformations of matrices under *congruence and reducing transformations
Authors:
A. Dmytryshyn,
V. Futorny,
V. V. Sergeichuk
Abstract:
V.I. Arnold [Russian Math. Surveys 26(2) (1971) 29-43] constructed a miniversal deformation of a square complex matrix under similarity; that is, a simple normal form to which not only a given square matrix A but all matrices B close to it can be reduced by similarity transformations that smoothly depend on the entries of B. We give miniversal deformations of matrices of sesquilinear forms; that i…
▽ More
V.I. Arnold [Russian Math. Surveys 26(2) (1971) 29-43] constructed a miniversal deformation of a square complex matrix under similarity; that is, a simple normal form to which not only a given square matrix A but all matrices B close to it can be reduced by similarity transformations that smoothly depend on the entries of B. We give miniversal deformations of matrices of sesquilinear forms; that is, of square complex matrices under *congruence, and construct an analytic reducing transformation to a miniversal deformation. Analogous results for matrices under congruence were obtained by the authors in [Linear Algebra Appl. 436 (2012) 2670-2700].
△ Less
Submitted 6 October, 2013; v1 submitted 11 May, 2011;
originally announced May 2011.
-
Miniversal deformations of pairs of symmetric matrices under congruence
Authors:
Andrii Dmytryshyn
Abstract:
For each pair of complex symmetric matrices $(A,B)$ we provide a normal form with a minimal number of independent parameters, to which all pairs of complex symmetric matrices $(\widetilde{A},\widetilde{B})$, close to $(A,B)$ can be reduced by congruence transformation that smoothly depends on the entries of $\widetilde{A}$ and $\widetilde{B}$. Such a normal form is called a miniversal deformation…
▽ More
For each pair of complex symmetric matrices $(A,B)$ we provide a normal form with a minimal number of independent parameters, to which all pairs of complex symmetric matrices $(\widetilde{A},\widetilde{B})$, close to $(A,B)$ can be reduced by congruence transformation that smoothly depends on the entries of $\widetilde{A}$ and $\widetilde{B}$. Such a normal form is called a miniversal deformation of $(A,B)$ under congruence. A number of independent parameters in the miniversal deformation of a symmetric matrix pencil is equal to the codimension of the congruence orbit of this symmetric matrix pencil and is computed too. We also provide an upper bound on the distance from $(A,B)$ to its miniversal deformation.
△ Less
Submitted 29 May, 2018; v1 submitted 13 April, 2011;
originally announced April 2011.
-
Miniversal deformations of pairs of skew-symmetric matrices under congruence
Authors:
Andrii Dmytryshyn
Abstract:
Miniversal deformations for pairs of skew-symmetric matrices under congruence are constructed. To be precise, for each such a pair $(A,B)$ we provide a normal form with a minimal number of independent parameters to which all pairs of skew-symmetric matrices $(\widetilde{A},\widetilde{B})$, close to $(A,B)$ can be reduced by congruence transformation which smoothly depends on the entries of the mat…
▽ More
Miniversal deformations for pairs of skew-symmetric matrices under congruence are constructed. To be precise, for each such a pair $(A,B)$ we provide a normal form with a minimal number of independent parameters to which all pairs of skew-symmetric matrices $(\widetilde{A},\widetilde{B})$, close to $(A,B)$ can be reduced by congruence transformation which smoothly depends on the entries of the matrices in the pair $(\widetilde{A},\widetilde{B})$. An upper bound on the distance from such a miniversal deformation to $(A,B)$ is derived too. We also present an example of using miniversal deformations for analyzing changes in the canonical structure information (i.e. eigenvalues and minimal indices) of skew-symmetric matrix pairs under perturbations.
△ Less
Submitted 10 June, 2016; v1 submitted 13 April, 2011;
originally announced April 2011.
-
Change of the congruence canonical form of 2-by-2 and 3-by-3 matrices under perturbations and bundles of matrices under congruence
Authors:
Andrii Dmytryshyn,
Vyacheslav Futorny,
Bo Kågström,
Lena Klimenko,
Vladimir V. Sergeichuk
Abstract:
We construct the Hasse diagrams $G_2$ and $G_3$ for the closure ordering on the sets of congruence classes of $2\times 2$ and $3\times 3$ complex matrices. In other words, we construct two directed graphs whose vertices are $2\times 2$ or, respectively, $3\times 3$ canonical matrices under congruence and there is a directed path from $A$ to $B$ if and only if $A$ can be transformed by an arbitrari…
▽ More
We construct the Hasse diagrams $G_2$ and $G_3$ for the closure ordering on the sets of congruence classes of $2\times 2$ and $3\times 3$ complex matrices. In other words, we construct two directed graphs whose vertices are $2\times 2$ or, respectively, $3\times 3$ canonical matrices under congruence and there is a directed path from $A$ to $B$ if and only if $A$ can be transformed by an arbitrarily small perturbation to a matrix that is congruent to $B$.
A bundle of matrices under congruence is defined as a set of square matrices $A$ for which the pencils $A+λA^T$ belong to the same bundle under strict equivalence. In support of this definition, we show that all matrices in a congruence bundle of $2\times 2$ or $3\times 3$ matrices have the same properties with respect to perturbations. We construct the Hasse diagrams $G_2^{\rm B}$ and $G_3^{\rm B}$ for the closure ordering on the sets of congruence bundles of $2\times 2$ and, respectively, $3\times 3$ matrices. We find the isometry groups of $2\times 2$ and $3\times 3$ congruence canonical matrices.
△ Less
Submitted 8 December, 2014; v1 submitted 20 April, 2010;
originally announced April 2010.
-
Miniversal deformations of matrices of bilinear forms
Authors:
Andrii R. Dmytryshyn,
Vyacheslav Futorny,
Vladimir V. Sergeichuk
Abstract:
V.I. Arnold [Russian Math. Surveys 26 (2) (1971) 29-43] constructed a miniversal deformation of matrices under similarity; that is, a simple normal form to which not only a given square matrix A but all matrices B close to it can be reduced by similarity transformations that smoothly depend on the entries of B. We construct a miniversal deformation of matrices under congruence.
V.I. Arnold [Russian Math. Surveys 26 (2) (1971) 29-43] constructed a miniversal deformation of matrices under similarity; that is, a simple normal form to which not only a given square matrix A but all matrices B close to it can be reduced by similarity transformations that smoothly depend on the entries of B. We construct a miniversal deformation of matrices under congruence.
△ Less
Submitted 1 December, 2011; v1 submitted 20 April, 2010;
originally announced April 2010.
