-
Krylov and core transformation algorithms for an inverse eigenvalue problem to compute recurrences of multiple orthogonal polynomials
Authors:
Amin Faghih,
Michele Rinelli,
Marc Van Barel,
Raf Vandebril,
Robbe Vermeiren
Abstract:
In this paper, we develop algorithms for computing the recurrence coefficients corresponding to multiple orthogonal polynomials on the step-line. We reformulate the problem as an inverse eigenvalue problem, which can be solved using numerical linear algebra techniques. We consider two approaches: the first is based on the link with block Krylov subspaces and results in a biorthogonal Lanczos proce…
▽ More
In this paper, we develop algorithms for computing the recurrence coefficients corresponding to multiple orthogonal polynomials on the step-line. We reformulate the problem as an inverse eigenvalue problem, which can be solved using numerical linear algebra techniques. We consider two approaches: the first is based on the link with block Krylov subspaces and results in a biorthogonal Lanczos process with multiple starting vectors; the second consists of applying a sequence of Gaussian eliminations on a diagonal matrix to construct the banded Hessenberg matrix containing the recurrence coefficients. We analyze the accuracy and stability of the algorithms with numerical experiments on the ill-conditioned inverse eigenvalue problemshave related to Kravchuk and Hahn polynomials, as well as on other better conditioned examples.
△ Less
Submitted 24 June, 2025;
originally announced June 2025.
-
On computing the zeros of a class of Sobolev orthogonal polynomials
Authors:
Nicola Mastronardi,
Marc Van Barel,
Raf Vandebril,
Paul Van Dooren
Abstract:
A fast and weakly stable method for computing the zeros of a particular class of hypergeometric polynomials is presented. The studied hypergeometric polynomials satisfy a higher order differential equation and generalize Laguerre polynomials. The theoretical study of the asymptotic distribution of the spectrum of these polynomials is an active research topic. In this article we do not contribute t…
▽ More
A fast and weakly stable method for computing the zeros of a particular class of hypergeometric polynomials is presented. The studied hypergeometric polynomials satisfy a higher order differential equation and generalize Laguerre polynomials. The theoretical study of the asymptotic distribution of the spectrum of these polynomials is an active research topic. In this article we do not contribute to the theory, but provide a practical method to contribute to further and better understanding of the asymptotic behavior. The polynomials under consideration fit into the class of Sobolev orthogonal polynomials, satisfying a four--term recurrence relation. This allows computing the roots via a generalized eigenvalue problem. After condition enhancing similarity transformations, the problem is transformed into the computation of the eigenvalues of a comrade matrix, which is a symmetric tridiagonal modified by a rank--one matrix. The eigenvalues are then retrieved by relying on an existing structured rank based fast algorithm. Numerical examples are reported studying the accuracy, stability and conforming the efficiency for various parameter settings of the proposed approach.
△ Less
Submitted 26 March, 2025;
originally announced March 2025.
-
Constructing Sobolev orthonormal rational functions via an updating procedure
Authors:
Amin Faghih,
Marc Van Barel,
Niel Van Buggenhout,
Raf Vandebril
Abstract:
In this paper, we generate the recursion coefficients for rational functions with prescribed poles that are orthonormal with respect to a continuous Sobolev inner product. Using a rational Gauss quadrature rule, the inner product can be discretized, thus allowing a linear algebraic approach. The presented approach involves reformulating the problem as an inverse eigenvalue problem involving a Hess…
▽ More
In this paper, we generate the recursion coefficients for rational functions with prescribed poles that are orthonormal with respect to a continuous Sobolev inner product. Using a rational Gauss quadrature rule, the inner product can be discretized, thus allowing a linear algebraic approach. The presented approach involves reformulating the problem as an inverse eigenvalue problem involving a Hessenberg pencil, where the pencil will contain the recursion coefficients that generate the sequence of Sobolev orthogonal rational functions. This reformulation is based on the connection between Sobolev orthonormal rational functions and the orthonormal bases for rational Krylov subspaces generated by a Jordan-like matrix. An updating procedure, introducing the nodes of the inner product one after the other, is proposed and the performance is examined through some numerical examples.
△ Less
Submitted 17 March, 2025;
originally announced March 2025.
-
A Parametric Family of Polynomial Wavelets for Signal and Image Processing
Authors:
Mariantonia Cotronei,
Woula Themistoclakis,
Marc Van Barel
Abstract:
This paper investigates the potential applications of a parametric family of polynomial wavelets that has been recently introduced starting from de la Vallée Poussin (VP) interpolation at Chebyshev nodes. Unlike classical wavelets, which are constructed on the real line, these VP wavelets are defined on a bounded interval, offering the advantage of handling boundaries naturally while maintaining c…
▽ More
This paper investigates the potential applications of a parametric family of polynomial wavelets that has been recently introduced starting from de la Vallée Poussin (VP) interpolation at Chebyshev nodes. Unlike classical wavelets, which are constructed on the real line, these VP wavelets are defined on a bounded interval, offering the advantage of handling boundaries naturally while maintaining computational efficiency. In fact, the structure of these wavelets enables the use of fast algorithms for decomposition and reconstruction. Furthermore, the flexibility offered by a free parameter allows a better control of localized singularities, such as edges in images. On the basis of previous theoretical foundations, we show the effectiveness of the VP wavelets for basic signal denoising and image compression, emphasizing their potential for more advanced signal and image processing tasks.
△ Less
Submitted 16 March, 2025;
originally announced March 2025.
-
A free parameter depending family of polynomial wavelets on a compact interval
Authors:
Woula Themistoclakis,
Marc Van Barel
Abstract:
On a compact interval, we introduce and study a whole family of wavelets depending on a free parameter that can be suitably modulated to improve performance. Such wavelets arise from de la Vallée Poussin (VP) interpolation at Chebyshev nodes, generalizing previous work by Capobianco and Themistoclakis who considered a special parameter setting. In our construction, both scaling and wavelet functio…
▽ More
On a compact interval, we introduce and study a whole family of wavelets depending on a free parameter that can be suitably modulated to improve performance. Such wavelets arise from de la Vallée Poussin (VP) interpolation at Chebyshev nodes, generalizing previous work by Capobianco and Themistoclakis who considered a special parameter setting. In our construction, both scaling and wavelet functions are interpolating polynomials at some Chebyshev zeros of 1st kind. Contrarily to the classical approach, they are not generated by dilations and translations of a single mother function and are naturally defined on the interval $[-1,1]$ to which any other compact interval can be reduced. In the paper, we provide a non-standard multiresolution analysis with fast (DCT-based) decomposition and reconstruction algorithms. Moreover, we state several theoretical results, particularly on convergence, laying the foundation for future applications.
△ Less
Submitted 16 March, 2025;
originally announced March 2025.
-
An Arnoldi-based approach to polynomial and rational least squares problems
Authors:
Amin Faghih,
Marc Van Barel,
Niel Van Buggenhout,
Raf Vandebril
Abstract:
In this research, we solve polynomial, Sobolev polynomial, rational, and Sobolev rational least squares problems. Although the increase in the approximation degree allows us to fit the data better in attacking least squares problems, the ill-conditioning of the coefficient matrix fuels the dramatic decrease in the accuracy of the approximation at higher degrees. To overcome this drawback, we first…
▽ More
In this research, we solve polynomial, Sobolev polynomial, rational, and Sobolev rational least squares problems. Although the increase in the approximation degree allows us to fit the data better in attacking least squares problems, the ill-conditioning of the coefficient matrix fuels the dramatic decrease in the accuracy of the approximation at higher degrees. To overcome this drawback, we first show that the column space of the coefficient matrix is equivalent to a Krylov subspace. Then the connection between orthogonal polynomials or rational functions and orthogonal bases for Krylov subspaces in order to exploit Krylov subspace methods like Arnoldi orthogonalization is established. Furthermore, some examples are provided to illustrate the theory and the performance of the proposed approach.
△ Less
Submitted 8 July, 2024;
originally announced July 2024.
-
Generalized cyclic symmetric decompositions for the matrix multiplication tensor
Authors:
Charlotte Vermeylen,
Marc Van Barel
Abstract:
A new generalized cyclic symmetric structure in the factor matrices of polyadic decompositions of matrix multiplication tensors for non-square matrix multiplication is proposed to reduce the number of variables in the optimization problem and in this way improve the convergence. The structure is implemented in an existing numerical optimization algorithm. Extensive numerical experiments are given…
▽ More
A new generalized cyclic symmetric structure in the factor matrices of polyadic decompositions of matrix multiplication tensors for non-square matrix multiplication is proposed to reduce the number of variables in the optimization problem and in this way improve the convergence. The structure is implemented in an existing numerical optimization algorithm. Extensive numerical experiments are given that the proposed structure indeed finds more (practical) decompositions.
△ Less
Submitted 18 March, 2025; v1 submitted 25 April, 2024;
originally announced April 2024.
-
A Riemannian rank-adaptive method for higher-order tensor completion in the tensor-train format
Authors:
Charlotte Vermeylen,
Marc Van Barel
Abstract:
In this paper a new Riemannian rank adaptive method (RRAM) is proposed for the low-rank tensor completion problem (LRTCP) formulated as a least-squares optimization problem on the algebraic variety of tensors of bounded tensor-train (TT) rank. The method iteratively optimizes over fixed-rank smooth manifolds using a Riemannian conjugate gradient algorithm from Steinlechner (2016) and gradually inc…
▽ More
In this paper a new Riemannian rank adaptive method (RRAM) is proposed for the low-rank tensor completion problem (LRTCP) formulated as a least-squares optimization problem on the algebraic variety of tensors of bounded tensor-train (TT) rank. The method iteratively optimizes over fixed-rank smooth manifolds using a Riemannian conjugate gradient algorithm from Steinlechner (2016) and gradually increases the rank by computing a descent direction in the tangent cone to the variety. Additionally, a numerical method to estimate the amount of rank increase is proposed based on a theoretical result for the stationary points of the low-rank tensor approximation problem and a definition of an estimated TT-rank. Furthermore, when the iterate comes close to a lower-rank set, the RRAM decreases the rank based on the TT-rounding algorithm from Oseledets (2011) and a definition of a numerical rank. We prove that the TT-rounding algorithm can be considered as an approximate projection onto the lower-rank set which satisfies a certain angle condition to ensure that the image is sufficiently close to that of an exact projection. Several numerical experiments are given to illustrate the use of the RRAM and its subroutines in {\Matlab}. Furthermore, in all experiments the proposed RRAM outperforms the state-of-the-art RRAM for tensor completion in the TT format from Steinlechner (2016) in terms of computation time.
△ Less
Submitted 19 February, 2024;
originally announced February 2024.
-
Stability Improvements for Fast Matrix Multiplication
Authors:
Charlotte Vermeylen,
Marc Van Barel
Abstract:
We implement an Augmented Lagrangian method to minimize a constrained least-squares cost function designed to find polyadic decompositions of the matrix multiplication tensor. We use this method to obtain new discrete decompositions and parameter families of decompositions. Using these parametrizations, faster and more stable matrix multiplication algorithms can be discovered.
We implement an Augmented Lagrangian method to minimize a constrained least-squares cost function designed to find polyadic decompositions of the matrix multiplication tensor. We use this method to obtain new discrete decompositions and parameter families of decompositions. Using these parametrizations, faster and more stable matrix multiplication algorithms can be discovered.
△ Less
Submitted 4 October, 2023;
originally announced October 2023.
-
Rank Estimation for Third-Order Tensor Completion in the Tensor-Train Format
Authors:
Charlotte Vermeylen,
Guillaume Olikier,
P. -A. Absil,
Marc Van Barel
Abstract:
We propose a numerical method to obtain an adequate value for the upper bound on the rank for the tensor completion problem on the variety of third-order tensors of bounded tensor-train rank. The method is inspired by the parametrization of the tangent cone derived by Kutschan (2018). A proof of the adequacy of the upper bound for a related low-rank tensor approximation problem is given and an est…
▽ More
We propose a numerical method to obtain an adequate value for the upper bound on the rank for the tensor completion problem on the variety of third-order tensors of bounded tensor-train rank. The method is inspired by the parametrization of the tangent cone derived by Kutschan (2018). A proof of the adequacy of the upper bound for a related low-rank tensor approximation problem is given and an estimated rank is defined to extend the result to the low-rank tensor completion problem. Some experiments on synthetic data illustrate the approach and show that the method is very robust, e.g., to noise on the data.
△ Less
Submitted 26 September, 2023;
originally announced September 2023.
-
A generalization of Floater--Hormann interpolants
Authors:
Woula Themistoclakis,
Marc Van Barel
Abstract:
In this paper the interpolating rational functions introduced by Floater and Hormann are generalized leading to a whole new family of rational functions depending on $γ$, an additional positive integer parameter. For $γ= 1$, the original Floater--Hormann interpolants are obtained. When $γ>1$ we prove that the new rational functions share a lot of the nice properties of the original Floater--Horman…
▽ More
In this paper the interpolating rational functions introduced by Floater and Hormann are generalized leading to a whole new family of rational functions depending on $γ$, an additional positive integer parameter. For $γ= 1$, the original Floater--Hormann interpolants are obtained. When $γ>1$ we prove that the new rational functions share a lot of the nice properties of the original Floater--Hormann functions. Indeed, for any configuration of nodes in a compact interval, they have no real poles, interpolate the given data, preserve the polynomials up to a certain fixed degree, and have a barycentric-type representation. Moreover, we estimate the associated Lebesgue constants in terms of the minimum ($h^*$) and maximum ($h$) distance between two consecutive nodes. It turns out that, in contrast to the original Floater-Hormann interpolants, for all $γ> 1$ we get uniformly bounded Lebesgue constants in the case of equidistant and quasi-equidistant nodes configurations (i.e., when $h\sim h^*$). For such configurations, as the number of nodes tends to infinity, we prove that the new interpolants ($γ>1$) uniformly converge to the interpolated function $f$, for any continuous function $f$ and all $γ>1$. The same is not ensured by the original FH interpolants ($γ=1$). Moreover, we provide uniform and pointwise estimates of the approximation error for functions having different degrees of smoothness.
Numerical experiments illustrate the theoretical results and show a better error profile for less smooth functions compared to the original Floater-Hormann interpolants.
△ Less
Submitted 19 October, 2023; v1 submitted 11 July, 2023;
originally announced July 2023.
-
An Approximate Projection onto the Tangent Cone to the Variety of Third-Order Tensors of Bounded Tensor-Train Rank
Authors:
Charlotte Vermeylen,
Guillaume Olikier,
Marc Van Barel
Abstract:
An approximate projection onto the tangent cone to the variety of third-order tensors of bounded tensor-train rank is proposed and proven to satisfy a better angle condition than the one proposed by Kutschan (2019). Such an approximate projection enables, e.g., to compute gradient-related directions in the tangent cone, as required by algorithms aiming at minimizing a continuously differentiable f…
▽ More
An approximate projection onto the tangent cone to the variety of third-order tensors of bounded tensor-train rank is proposed and proven to satisfy a better angle condition than the one proposed by Kutschan (2019). Such an approximate projection enables, e.g., to compute gradient-related directions in the tangent cone, as required by algorithms aiming at minimizing a continuously differentiable function on the variety, a problem appearing notably in tensor completion. A numerical experiment is presented which indicates that, in practice, the angle condition satisfied by the proposed approximate projection is better than both the one satisfied by the approximate projection introduced by Kutschan and the proven theoretical bound.
△ Less
Submitted 23 June, 2023;
originally announced June 2023.
-
Algorithms for Modifying Recurrence Relations of Orthogonal Polynomial and Rational Functions when Changing the Discrete Inner Product
Authors:
Marc Van Barel,
Niel Van Buggenhout,
Raf Vandebril
Abstract:
Often, polynomials or rational functions, orthogonal for a particular inner product are desired. In practical numerical algorithms these polynomials are not constructed, but instead the associated recurrence relations are computed. Moreover, also typically the inner product is changed to a discrete inner product, which is the finite sum of weighted functions evaluated in specific nodes. For partic…
▽ More
Often, polynomials or rational functions, orthogonal for a particular inner product are desired. In practical numerical algorithms these polynomials are not constructed, but instead the associated recurrence relations are computed. Moreover, also typically the inner product is changed to a discrete inner product, which is the finite sum of weighted functions evaluated in specific nodes. For particular applications it is beneficial to have an efficient procedure to update the recurrence relations when adding or removing nodes from the inner product. The construction of the recurrence relations is equivalent to computing a structured matrix (polynomial) or pencil (rational) having prescribed spectral properties. Hence the solution of this problem is often referred to as solving an Inverse Eigenvalue Problem. In Van Buggenhout et al. (2022) we proposed updating techniques to add nodes to the inner product while efficiently updating the recurrences. To complete this study we present in this article manners to efficiently downdate the recurrences when removing nodes from the inner product. The link between removing nodes and the QR algorithm to deflate eigenvalues is exploited to develop efficient algorithms. We will base ourselves on the perfect shift strategy and develop algorithms, both for the polynomial case and the rational function setting. Numerical experiments validate our approach.
△ Less
Submitted 1 February, 2023;
originally announced February 2023.
-
Adaptive cross approximation for Tikhonov regularization in general form
Authors:
Thomas Mach,
Lothar Reichel,
Marc Van Barel
Abstract:
Many problems in Science and Engineering give rise to linear integral equations of the first kind with a smooth kernel. Discretization of the integral operator yields a matrix, whose singular values cluster at the origin. We describe the approximation of such matrices by adaptive cross approximation, which avoids forming the entire matrix. The choice of the number of steps of adaptive cross approx…
▽ More
Many problems in Science and Engineering give rise to linear integral equations of the first kind with a smooth kernel. Discretization of the integral operator yields a matrix, whose singular values cluster at the origin. We describe the approximation of such matrices by adaptive cross approximation, which avoids forming the entire matrix. The choice of the number of steps of adaptive cross approximation is discussed. The discretized right-hand side represents data that commonly are contaminated by measurement error. Solution of the linear system of equations so obtained is not meaningful because the matrix determined by adaptive cross approximation is rank-deficient. We remedy this difficulty by using Tikhonov regularization and discuss how a fairly general regularization matrix can be used. Computed examples illustrate that the use of a regularization matrix different from the identity can improve the quality of the computed approximate solutions significantly.
△ Less
Submitted 12 April, 2022;
originally announced April 2022.
-
Generation of orthogonal rational functions by procedures for structured matrices
Authors:
Niel Van Buggenhout,
Marc Van Barel,
Raf Vandebril
Abstract:
The problem of computing recurrence coefficients of sequences of rational functions orthogonal with respect to a discrete inner product is formulated as an inverse eigenvalue problem for a pencil of Hessenberg matrices. Two procedures are proposed to solve this inverse eigenvalue problem, via the rational Arnoldi iteration and via an updating procedure using unitary similarity transformations. The…
▽ More
The problem of computing recurrence coefficients of sequences of rational functions orthogonal with respect to a discrete inner product is formulated as an inverse eigenvalue problem for a pencil of Hessenberg matrices. Two procedures are proposed to solve this inverse eigenvalue problem, via the rational Arnoldi iteration and via an updating procedure using unitary similarity transformations. The latter is shown to be numerically stable. This problem and both procedures are generalized by considering biorthogonal rational functions with respect to a bilinear form. This leads to an inverse eigenvalue problem for a pencil of tridiagonal matrices. A tridiagonal pencil implies short recurrence relations for the biorthogonal rational functions, which is more efficient than the orthogonal case. However the procedures solving this problem must rely on nonunitary operations and might not be numerically stable.
△ Less
Submitted 21 May, 2021; v1 submitted 8 March, 2021;
originally announced March 2021.
-
Backward Error Measures for Roots of Polynomials
Authors:
Simon Telen,
Sascha Timme,
Marc Van Barel
Abstract:
We analyze different measures for the backward error of a set of numerical approximations for the roots of a polynomial. We focus mainly on the element-wise mixed backward error introduced by Mastronardi and Van Dooren, and the tropical backward error introduced by Tisseur and Van Barel. We show that these measures are equivalent under suitable assumptions. We also show relations between these mea…
▽ More
We analyze different measures for the backward error of a set of numerical approximations for the roots of a polynomial. We focus mainly on the element-wise mixed backward error introduced by Mastronardi and Van Dooren, and the tropical backward error introduced by Tisseur and Van Barel. We show that these measures are equivalent under suitable assumptions. We also show relations between these measures and the classical element-wise and norm-wise backward error measures.
△ Less
Submitted 21 March, 2020;
originally announced March 2020.
-
Robust Numerical Tracking of One Path of a Polynomial Homotopy on Parallel Shared Memory Computers
Authors:
Simon Telen,
Marc Van Barel,
Jan Verschelde
Abstract:
We consider the problem of tracking one solution path defined by a polynomial homotopy on a parallel shared memory computer. Our robust path tracker applies Newton's method on power series to locate the closest singular parameter value. On top of that, it computes singular values of the Hessians of the polynomials in the homotopy to estimate the distance to the nearest different path. Together, th…
▽ More
We consider the problem of tracking one solution path defined by a polynomial homotopy on a parallel shared memory computer. Our robust path tracker applies Newton's method on power series to locate the closest singular parameter value. On top of that, it computes singular values of the Hessians of the polynomials in the homotopy to estimate the distance to the nearest different path. Together, these estimates are used to compute an appropriate adaptive stepsize. For n-dimensional problems, the cost overhead of our robust path tracker is O(n), compared to the commonly used predictor-corrector methods. This cost overhead can be reduced by a multithreaded program on a parallel shared memory computer.
△ Less
Submitted 29 July, 2020; v1 submitted 21 February, 2020;
originally announced February 2020.
-
Min-Max Elementwise Backward Error for Roots of Polynomials and a Corresponding Backward Stable Root Finder
Authors:
Francoise Tisseur,
Marc Van Barel
Abstract:
A new measure called min-max elementwise backward error is introduced for approximate roots of scalar polynomials $p(z)$. Compared with the elementwise relative backward error, this new measure allows for larger relative perturbations on the coefficients of $p(z)$ that do not participate much in the overall backward error. By how much these coefficients can be perturbed is determined via an associ…
▽ More
A new measure called min-max elementwise backward error is introduced for approximate roots of scalar polynomials $p(z)$. Compared with the elementwise relative backward error, this new measure allows for larger relative perturbations on the coefficients of $p(z)$ that do not participate much in the overall backward error. By how much these coefficients can be perturbed is determined via an associated max-times polynomial and its tropical roots. An algorithm is designed for computing the roots of $p(z)$. It uses a companion linearization $C(z) = A-zB$ of $p(z)$ to which we added an extra zero leading coefficient, and an appropriate two-sided diagonal scaling that balances $A$ and makes $B$ graded in particular when there is variation in the magnitude of the coefficients of $p(z)$. An implementation of the QZ algorithm with a strict deflation criterion for eigenvalues at infinity is then used to obtain approximations to the roots of $p(z)$. Under the assumption that this implementation of the QZ algorithm exhibits a graded backward error when $B$ is graded, we prove that our new algorithm is min-max elementwise backward stable. Several numerical experiments show the superior performance of the new algorithm compared with the MATLAB \texttt{roots} function. Extending the algorithm to polynomial eigenvalue problems leads to a new polynomial eigensolver that exhibits excellent numerical behaviour compared with other existing polynomial eigensolvers, as illustrated by many numerical tests.
△ Less
Submitted 15 January, 2020;
originally announced January 2020.
-
A Robust Numerical Path Tracking Algorithm for Polynomial Homotopy Continuation
Authors:
Simon Telen,
Marc Van Barel,
Jan Verschelde
Abstract:
We propose a new algorithm for numerical path tracking in polynomial homotopy continuation. The algorithm is `robust' in the sense that it is designed to prevent path jumping and in many cases, it can be used in (only) double precision arithmetic. It is based on an adaptive stepsize predictor that uses Padé techniques to detect local difficulties for function approximation and danger for path jump…
▽ More
We propose a new algorithm for numerical path tracking in polynomial homotopy continuation. The algorithm is `robust' in the sense that it is designed to prevent path jumping and in many cases, it can be used in (only) double precision arithmetic. It is based on an adaptive stepsize predictor that uses Padé techniques to detect local difficulties for function approximation and danger for path jumping. We show the potential of the new path tracking algorithm through several numerical examples and compare with existing implementations.
△ Less
Submitted 10 September, 2020; v1 submitted 11 September, 2019;
originally announced September 2019.
-
Equivalent Polyadic Decompositions of Matrix Multiplication Tensors
Authors:
Guillaume O. Berger,
P. -A. Absil,
Lieven De Lathauwer,
Raphaël M. Jungers,
Marc Van Barel
Abstract:
Invariance transformations of polyadic decompositions of matrix multiplication tensors define an equivalence relation on the set of such decompositions. In this paper, we present an algorithm to efficiently decide whether two polyadic decompositions of a given matrix multiplication tensor are equivalent. With this algorithm, we analyze the equivalence classes of decompositions of several matrix mu…
▽ More
Invariance transformations of polyadic decompositions of matrix multiplication tensors define an equivalence relation on the set of such decompositions. In this paper, we present an algorithm to efficiently decide whether two polyadic decompositions of a given matrix multiplication tensor are equivalent. With this algorithm, we analyze the equivalence classes of decompositions of several matrix multiplication tensors. This analysis is relevant for the study of fast matrix multiplication as it relates to the question of how many essentially different fast matrix multiplication algorithms there exist. This question has been first studied by de~Groote, who showed that for the multiplication of $2\times2$ matrices with $7$ active multiplications, all algorithms are essentially equivalent to Strassen's algorithm. In contrast, the results of our analysis show that for the multiplication of larger matrices, (e.g., $2\times3$ by $3\times2$ or $3\times3$ by $3\times3$ matrices), two decompositions are very likely to be essentially different. We further provide a necessary criterion for a polyadic decomposition to be equivalent to a polyadic decomposition with integer entries. Decompositions with specific integer entries, e.g., powers of two, provide fast matrix multiplication algorithms with better efficiency and stability properties. This condition can be tested algorithmically and we present the conclusions obtained for the decompositions of small/medium matrix multiplication tensors.
△ Less
Submitted 13 April, 2022; v1 submitted 11 February, 2019;
originally announced February 2019.
-
Biorthogonal Extended Krylov Subspace Methods
Authors:
Niel Van Buggenhout,
Marc Van Barel,
Raf Vandebril
Abstract:
A general framework for oblique projections of nonhermitian matrices onto rational Krylov subspaces is developed. To obtain this framework we revisit the classical rational Krylov subspace algorithm and prove that the projected matrix can be written efficiently as a structured pencil, where the structure can take several forms, such as Hessenberg or inverse Hessenberg. One specific instance of the…
▽ More
A general framework for oblique projections of nonhermitian matrices onto rational Krylov subspaces is developed. To obtain this framework we revisit the classical rational Krylov subspace algorithm and prove that the projected matrix can be written efficiently as a structured pencil, where the structure can take several forms, such as Hessenberg or inverse Hessenberg. One specific instance of the structures appearing in this framework for oblique projections is a tridiagonal pencil. This is a direct generalization of the classical biorthogonal Krylov subspace method where the projection becomes a single nonhermitian tridiagonal matrix and of the Hessenberg pencil representation for rational Krylov subspaces. Based on the compact storage of this tridiagonal pencil in the biorthogonal setting, we can develop short recurrences. Numerical experiments confirm the validity of the approach.
△ Less
Submitted 15 November, 2019; v1 submitted 20 September, 2018;
originally announced September 2018.
-
Optimal Lebesgue constants for least squares polynomial approximation on the (hyper)sphere
Authors:
Woula Themistoclakis,
Marc Van Barel
Abstract:
We investigate the uniform approximation provided by least squares polynomials on the unit Euclidean sphere $\mathbb{S}^q$ in $\mathbb{R}^{q+1}$, with $q\ge 2$. Like any other polynomial projection, the study concerns the growth, as the degree $n$ tends to infinity, of the associated Lebesgue constant, i.e., of the uniform norm of the least squares operator. If the least squares polynomial of degr…
▽ More
We investigate the uniform approximation provided by least squares polynomials on the unit Euclidean sphere $\mathbb{S}^q$ in $\mathbb{R}^{q+1}$, with $q\ge 2$. Like any other polynomial projection, the study concerns the growth, as the degree $n$ tends to infinity, of the associated Lebesgue constant, i.e., of the uniform norm of the least squares operator. If the least squares polynomial of degree $n$ is based on a set of points, which are nodes of a positive weighted quadrature rule of degree of exactness $2n$, then we state two different sufficient conditions for having an optimal Lebesgue constant that increases with $n$ at the minimal projections order. Hence, under our assumptions least squares and hyperinterpolation polynomials provide a comparable approximation with respect to the uniform norm.
△ Less
Submitted 10 August, 2018;
originally announced August 2018.
-
Uniform approximation on the sphere by least squares polynomials
Authors:
Woula Themistoclakis,
Marc Van Barel
Abstract:
The paper concerns the uniform polynomial approximation of a function $f$, continuous on the unit Euclidean sphere of ${\mathbb R}^3$ and known only at a finite number of points that are somehow uniformly distributed on the sphere. First we focus on least squares polynomial approximation and prove that the related Lebesgue constants w.r.t. the uniform norm grow at the optimal rate. Then, we consid…
▽ More
The paper concerns the uniform polynomial approximation of a function $f$, continuous on the unit Euclidean sphere of ${\mathbb R}^3$ and known only at a finite number of points that are somehow uniformly distributed on the sphere. First we focus on least squares polynomial approximation and prove that the related Lebesgue constants w.r.t. the uniform norm grow at the optimal rate. Then, we consider delayed arithmetic means of least squares polynomials whose degrees vary from $n-m$ up to $n+m$, being $m=\lfloor θn\rfloor$ for any fixed parameter $0<θ<1$. As $n$ tends to infinity, we prove that these polynomials uniformly converge to $f$ at the near-best polynomial approximation rate. Moreover, for fixed $n$, by using the same data points we can further improve the approximation by suitably modulating the action ray $m$ determined by the parameter $θ$. Some numerical experiments are given to illustrate the theoretical results.
△ Less
Submitted 9 August, 2018; v1 submitted 1 June, 2018;
originally announced June 2018.
-
Truncated Normal Forms for Solving Polynomial Systems: Generalized and Efficient Algorithms
Authors:
Bernard Mourrain,
Simon Telen,
Marc Van Barel
Abstract:
We consider the problem of finding the isolated common roots of a set of polynomial functions defining a zero-dimensional ideal I in a ring R of polynomials over C. Normal form algorithms provide an algebraic approach to solve this problem. The framework presented in Telen et al. (2018) uses truncated normal forms (TNFs) to compute the algebra structure of R/I and the solutions of I. This framewor…
▽ More
We consider the problem of finding the isolated common roots of a set of polynomial functions defining a zero-dimensional ideal I in a ring R of polynomials over C. Normal form algorithms provide an algebraic approach to solve this problem. The framework presented in Telen et al. (2018) uses truncated normal forms (TNFs) to compute the algebra structure of R/I and the solutions of I. This framework allows for the use of much more general bases than the standard monomials for R/I. This is exploited in this paper to introduce the use of two special (nonmonomial) types of basis functions with nice properties. This allows, for instance, to adapt the basis functions to the expected location of the roots of I. We also propose algorithms for efficient computation of TNFs and a generalization of the construction of TNFs in the case of non-generic zero-dimensional systems. The potential of the TNF method and usefulness of the new results are exposed by many experiments.
△ Less
Submitted 7 December, 2018; v1 submitted 21 March, 2018;
originally announced March 2018.
-
Solving Polynomial Systems via a Stabilized Representation of Quotient Algebras
Authors:
Simon Telen,
Bernard Mourrain,
Marc Van Barel
Abstract:
We consider the problem of finding the isolated common roots of a set of polynomial functions defining a zero-dimensional ideal I in a ring R of polynomials over C. We propose a general algebraic framework to find the solutions and to compute the structure of the quotient ring R/I from the null space of a Macaulay-type matrix. The affine dense, affine sparse, homogeneous and multi-homogeneous case…
▽ More
We consider the problem of finding the isolated common roots of a set of polynomial functions defining a zero-dimensional ideal I in a ring R of polynomials over C. We propose a general algebraic framework to find the solutions and to compute the structure of the quotient ring R/I from the null space of a Macaulay-type matrix. The affine dense, affine sparse, homogeneous and multi-homogeneous cases are treated. In the presented framework, the concept of a border basis is generalized by relaxing the conditions on the set of basis elements. This allows for algorithms to adapt the choice of basis in order to enhance the numerical stability. We present such an algorithm and show numerical results.
△ Less
Submitted 13 November, 2017;
originally announced November 2017.
-
A Stabilized Normal Form Algorithm for Generic Systems of Polynomial Equations
Authors:
Simon Telen,
Marc Van Barel
Abstract:
We propose a numerical linear algebra based method to find the multiplication operators of the quotient ring $\mathbb{C}[x]/I$ associated to a zero-dimensional ideal $I$ generated by $n$ $\mathbb{C}$-polynomials in $n$ variables. We assume that the polynomials are generic in the sense that the number of solutions in $\mathbb{C}^n$ equals the Bézout number. The main contribution of this paper is an…
▽ More
We propose a numerical linear algebra based method to find the multiplication operators of the quotient ring $\mathbb{C}[x]/I$ associated to a zero-dimensional ideal $I$ generated by $n$ $\mathbb{C}$-polynomials in $n$ variables. We assume that the polynomials are generic in the sense that the number of solutions in $\mathbb{C}^n$ equals the Bézout number. The main contribution of this paper is an automated choice of basis for $\mathbb{C}[x]/I$, which is crucial for the feasibility of normal form methods in finite precision arithmetic. This choice is based on numerical linear algebra techniques and governed by the numerical properties of the given generators of $I$.
△ Less
Submitted 22 March, 2018; v1 submitted 25 August, 2017;
originally announced August 2017.
