-
Randomized coupled decompositions
Authors:
Erna Begovic,
Anita Carevic,
Ivana Sain Glibic
Abstract:
Coupled decompositions are a widely used tool for data fusion. As the volume of data increases, so does the dimensionality of matrices and tensors, highlighting the need for more efficient coupled decomposition algorithms. This paper studies the problem of coupled matrix factorization (CMF), where two matrices represented in low-rank form share a common factor. Additionally, it explores coupled ma…
▽ More
Coupled decompositions are a widely used tool for data fusion. As the volume of data increases, so does the dimensionality of matrices and tensors, highlighting the need for more efficient coupled decomposition algorithms. This paper studies the problem of coupled matrix factorization (CMF), where two matrices represented in low-rank form share a common factor. Additionally, it explores coupled matrix and tensor factorization (CMTF), where a matrix and a tensor are represented in low-rank form, also sharing a common factor matrix. We show that these problems can be solved using a direct approach with singular value decomposition (SVD), rather than relying on an iterative method. Knowing that matrices coming from real-world applications are often very large, the computational cost can be substantial. To address this issue and improve the efficiency, we propose new techniques for randomizing these algorithms. This includes a novel strategy for selecting a projection subspace that takes into account the contribution from both matrices involved in the decomposition equally. We present extensive results of numerical tests that confirm the efficiency of our algorithms. Furthermore, as a novel approach and with a high success rate, we apply our randomized algorithms to the face recognition problem.
△ Less
Submitted 8 April, 2025; v1 submitted 4 November, 2024;
originally announced November 2024.
-
Singular quadratic eigenvalue problems: Linearization and weak condition numbers
Authors:
Daniel Kressner,
Ivana Šain Glibić
Abstract:
The numerical solution of singular eigenvalue problems is complicated by the fact that small perturbations of the coefficients may have an arbitrarily bad effect on eigenvalue accuracy. However, it has been known for a long time that such perturbations are exceptional and standard eigenvalue solvers, such as the QZ algorithm, tend to yield good accuracy despite the inevitable presence of roundoff…
▽ More
The numerical solution of singular eigenvalue problems is complicated by the fact that small perturbations of the coefficients may have an arbitrarily bad effect on eigenvalue accuracy. However, it has been known for a long time that such perturbations are exceptional and standard eigenvalue solvers, such as the QZ algorithm, tend to yield good accuracy despite the inevitable presence of roundoff error. Recently, Lotz and Noferini quantified this phenomenon by introducing the concept of $δ$-weak eigenvalue condition numbers. In this work, we consider singular quadratic eigenvalue problems and two popular linearizations. Our results show that a correctly chosen linearization increases $δ$-weak eigenvalue condition numbers only marginally, justifying the use of these linearizations in numerical solvers also in the singular case. We propose a very simple but often effective algorithm for computing well-conditioned eigenvalues of a singular quadratic eigenvalue problems by adding small random perturbations to the coefficients. We prove that the eigenvalue condition number is, with high probability, a reliable criterion for detecting and excluding spurious eigenvalues created from the singular part.
△ Less
Submitted 8 January, 2023; v1 submitted 15 April, 2022;
originally announced April 2022.
-
An algorithm for the complete solution of the quartic eigenvalue problem
Authors:
Zlatko Drmač,
Ivana Šain Glibić
Abstract:
Quartic eigenvalue problem $(λ^4 A + λ^3 B + λ^2C + λD + E)x = \mathbf{0}$ naturally arises e.g. when solving the Orr-Sommerfeld equation in the analysis of the stability of the {Poiseuille} flow, in theoretical analysis and experimental design of locally resonant phononic plates, modeling a robot with electric motors in the joints, calibration of catadioptric vision system, or e.g. computation of…
▽ More
Quartic eigenvalue problem $(λ^4 A + λ^3 B + λ^2C + λD + E)x = \mathbf{0}$ naturally arises e.g. when solving the Orr-Sommerfeld equation in the analysis of the stability of the {Poiseuille} flow, in theoretical analysis and experimental design of locally resonant phononic plates, modeling a robot with electric motors in the joints, calibration of catadioptric vision system, or e.g. computation of the guided and leaky modes of a planar waveguide. This paper proposes a new numerical method for the full solution (all eigenvalues and all left and right eigenvectors) that is based on quadratification, i.e. reduction of the quartic problem to a spectraly equivalent quadratic eigenvalue problem, and on a careful preprocessing to identify and deflate zero and infinite eigenvalues before the linearized quadratification is forwarded to the QZ algorithm. Numerical examples and backward error analysis confirm that the proposed algorithm is superior to the available methods.
△ Less
Submitted 8 March, 2021; v1 submitted 16 May, 2019;
originally announced May 2019.
-
New numerical algorithm for deflation of infinite and zero eigenvalues and full solution of quadratic eigenvalue problems
Authors:
Zlatko Drmač,
Ivana Šain Glibić
Abstract:
This paper presents a new method for computing all eigenvalues and eigenvectors of quadratic matrix pencil. It is an upgrade of the quadeig algorithm by Hammarling, Munro and Tisseur, which attempts to reveal and remove by deflation certain number of zero and infinite eigenvalues before QZ iterations. Proposed modifications of the quadeig framework are designed to enhance backward stability and to…
▽ More
This paper presents a new method for computing all eigenvalues and eigenvectors of quadratic matrix pencil. It is an upgrade of the quadeig algorithm by Hammarling, Munro and Tisseur, which attempts to reveal and remove by deflation certain number of zero and infinite eigenvalues before QZ iterations. Proposed modifications of the quadeig framework are designed to enhance backward stability and to make the process of deflating infinite and zero eigenvalues more numerically robust. In particular, careful preprocessing allows scaling invariant/component-wise backward error and thus better condition number. Further, using an upper triangular version of the Kronecker canonical form enables deflating additional infinite eigenvalues, in addition to those inferred from the rank of leading coefficient matrix. Theoretical analysis and empirical evidence from thorough testing of the software implementation confirm superior numerical performances of the proposed method.
△ Less
Submitted 10 April, 2019;
originally announced April 2019.
