-
A Lanczos-type procedure for tensors
Authors:
S. Cipolla,
S. Pozza,
M. Redivo-Zaglia,
N. Van Buggenhout
Abstract:
The solution of linear non-autonomous ordinary differential equation systems (also known as the time-ordered exponential) is a computationally challenging problem arising in a variety of applications. In this work, we present and study a new framework for the computation of bilinear forms involving the time-ordered exponential. Such a framework is based on an extension of the non-Hermitian Lanczos…
▽ More
The solution of linear non-autonomous ordinary differential equation systems (also known as the time-ordered exponential) is a computationally challenging problem arising in a variety of applications. In this work, we present and study a new framework for the computation of bilinear forms involving the time-ordered exponential. Such a framework is based on an extension of the non-Hermitian Lanczos algorithm to 4-mode tensors. Detailed results concerning its theoretical properties are presented. Moreover, computational results performed on real world problems confirm the effectiveness of our approach.
△ Less
Submitted 8 June, 2022;
originally announced June 2022.
-
Shanks and Anderson-type acceleration techniques for systems of nonlinear equations
Authors:
Claude Brezinski,
Stefano Cipolla,
Michela Redivo-Zaglia,
Yousef Saad
Abstract:
This paper examines a number of extrapolation and acceleration methods, and introduces a few modifications of the standard Shanks transformation that deal with general sequences. One of the goals of the paper is to lay out a general framework that encompasses most of the known acceleration strategies. The paper also considers the Anderson Acceleration method under a new light and exploits a connec…
▽ More
This paper examines a number of extrapolation and acceleration methods, and introduces a few modifications of the standard Shanks transformation that deal with general sequences. One of the goals of the paper is to lay out a general framework that encompasses most of the known acceleration strategies. The paper also considers the Anderson Acceleration method under a new light and exploits a connection with quasi-Newton methods, in order to establish local linear convergence results of a stabilized version of Anderson Acceleration method. The methods are tested on a number of problems, including a few that arise from nonlinear Partial Differential Equations.
△ Less
Submitted 8 July, 2021; v1 submitted 11 July, 2020;
originally announced July 2020.
-
Shifted and extrapolated power methods for tensor $\ell^p$-eigenpairs
Authors:
Stefano Cipolla,
Michela Redivo-Zaglia,
Francesco Tudisco
Abstract:
This work is concerned with the computation of $\ell^p$-eigenvalues and eigenvectors of square tensors with $d$ modes. In the first part we propose two possible shifted variants of the popular (higher-order) power method %for the computation of $\ell^p$-eigenpairs proving the convergence of both the schemes to the Perron $\ell^p$-eigenvector of the tensor, and the maximal corresponding $\ell^p$-ei…
▽ More
This work is concerned with the computation of $\ell^p$-eigenvalues and eigenvectors of square tensors with $d$ modes. In the first part we propose two possible shifted variants of the popular (higher-order) power method %for the computation of $\ell^p$-eigenpairs proving the convergence of both the schemes to the Perron $\ell^p$-eigenvector of the tensor, and the maximal corresponding $\ell^p$-eigenvalue, when the tensor is entrywise nonnegative and $p$ is strictly larger than the number of modes. Then, motivated by the slow rate of convergence that the proposed methods achieve for certain real-world tensors, when $p\approx d$, the number of modes, in the second part we introduce an extrapolation framework based on the simplified topological $\varepsilon$-algorithm to efficiently accelerate the shifted power sequences. Numerical results on synthetic and real world problems show the improvements gained by the introduction of the shifting parameter and the efficiency of the acceleration technique.
△ Less
Submitted 4 December, 2019; v1 submitted 26 September, 2019;
originally announced September 2019.
-
Extrapolation Methods for fixed-point Multilinear PageRank computations
Authors:
Stefano Cipolla,
Michela Redivo-Zaglia,
Francesco Tudisco
Abstract:
Nonnegative tensors arise very naturally in many applications that involve large and complex data flows. Due to the relatively small requirement in terms of memory storage and number of operations per step, the (shifted) higher-order power method is one of the most commonly used technique for the computation of positive Z-eigenvectors of this type of tensors. However, unlike the matrix case, the m…
▽ More
Nonnegative tensors arise very naturally in many applications that involve large and complex data flows. Due to the relatively small requirement in terms of memory storage and number of operations per step, the (shifted) higher-order power method is one of the most commonly used technique for the computation of positive Z-eigenvectors of this type of tensors. However, unlike the matrix case, the method may fail to converge even for irreducible tensors. Moreover, when it converges, its convergence rate can be very slow. These two drawbacks often make the computation of the eigenvectors demanding or unfeasible for large problems. In this work we consider a particular class of nonnegative tensors associated to the multilinear PageRank modification of higher-order Markov chains. Based on the simplified topological $ε$-algorithm in its restarted form, we introduce an extrapolation-based acceleration of power method type algorithms, namely the shifted fixed-point method and the inner-outer method. The accelerated methods show remarkably better performance, with faster convergence rates and reduced overall computational time. Extensive numerical experiments on synthetic and real-world datasets demonstrate the advantages of the introduced extrapolation techniques.
△ Less
Submitted 26 August, 2019; v1 submitted 4 June, 2019;
originally announced June 2019.
-
Generalizations of Sylvester's determinantal identity
Authors:
Anna Karapiperi,
Michela Redivo-Zaglia,
Maria Rosaria Russo
Abstract:
In this paper we deal with the noteworthy Sylvester's determinantal identity and some of its generalizations. We report the formulae due to Yakovlev, to Gasca, Lopez--Carmona, Ramirez, to Beckermann, Gasca, Mühlbach, and to Mulders in a unified formulation which allows to understand them better and to compare them. Then, we propose a different generalization of Sylvester's classical formula. This…
▽ More
In this paper we deal with the noteworthy Sylvester's determinantal identity and some of its generalizations. We report the formulae due to Yakovlev, to Gasca, Lopez--Carmona, Ramirez, to Beckermann, Gasca, Mühlbach, and to Mulders in a unified formulation which allows to understand them better and to compare them. Then, we propose a different generalization of Sylvester's classical formula. This new generalization expresses the determinant of a matrix in relation with the determinant of the bordered matrices obtained adding more than one row and one column to the original matrix. Sylvester's identity is recovered as a particular case.
△ Less
Submitted 2 March, 2015;
originally announced March 2015.
-
New representations of Padé and Padé-type approximants
Authors:
Claude Brezinski,
Michela Redivo-Zaglia
Abstract:
Padé approximants are rational functions whose series expansion match a given series as far as possible. These approximants are usually written under a rational form. In this paper, we will show how to write them also under two different barycentric forms, and under a partial fraction form, depending on free parameters. According to the choice of these parameters, Padé-type approximants can be obt…
▽ More
Padé approximants are rational functions whose series expansion match a given series as far as possible. These approximants are usually written under a rational form. In this paper, we will show how to write them also under two different barycentric forms, and under a partial fraction form, depending on free parameters. According to the choice of these parameters, Padé-type approximants can be obtained under a barycentric or a partial fraction form.
△ Less
Submitted 28 April, 2014;
originally announced April 2014.
-
The simplified topological $\varepsilon$--algorithms for accelerating sequences in a vector space
Authors:
Claude Brezinski,
Michela Redivo-Zaglia
Abstract:
When a sequence of numbers is slowly converging, it can be transformed into a new sequence which, under some assumptions, could converge faster to the same limit. One of the most well--known sequence transformation is Shanks transformation which can be recursively implemented by the $\varepsilon$--algorithm of Wynn. This transformation and this algorithm have been extended (in two different ways)…
▽ More
When a sequence of numbers is slowly converging, it can be transformed into a new sequence which, under some assumptions, could converge faster to the same limit. One of the most well--known sequence transformation is Shanks transformation which can be recursively implemented by the $\varepsilon$--algorithm of Wynn. This transformation and this algorithm have been extended (in two different ways) to sequence of elements of a topological vector space $E$. In this paper, we present new algorithms of implementing these topological Shanks transformations. They no longer require the manipulation of elements of the algebraic dual space $E^*$ of $E$, nor using the duality product into the rules of the algorithms, they need the storage of less elements of $E$, and the stability is improved. They also allow us to prove convergence and acceleration results for some types of sequences. Various applications involving sequences of vectors or matrices show the interest of the new algorithms.
△ Less
Submitted 12 February, 2014; v1 submitted 11 February, 2014;
originally announced February 2014.
-
Barycentric Padé approximation
Authors:
Claude Brezinski,
Michela Redivo-Zaglia
Abstract:
In this paper, we show how any Padé approximant $[p/q]_f$ of a formal power series $f$ can be written under two different barycentric rational forms. These form depend on $p+q+1$ parameters which can be almost arbitrarily chosen.
In this paper, we show how any Padé approximant $[p/q]_f$ of a formal power series $f$ can be written under two different barycentric rational forms. These form depend on $p+q+1$ parameters which can be almost arbitrarily chosen.
△ Less
Submitted 25 November, 2013; v1 submitted 16 July, 2013;
originally announced July 2013.
-
Convergence acceleration of Kaczmarz's method
Authors:
Claude Brezinski,
Michela Redivo-Zaglia
Abstract:
The method of alternation projections (MAP) is an iterative procedure for finding the projection of a point on the intersection of closed subspaces of an Hilbert space. The convergence of this method is usually slow, and several methods for its acceleration have already been proposed. In this work, we consider a special MAP, namely Kaczmarz' method for solving systems of linear equations. The conv…
▽ More
The method of alternation projections (MAP) is an iterative procedure for finding the projection of a point on the intersection of closed subspaces of an Hilbert space. The convergence of this method is usually slow, and several methods for its acceleration have already been proposed. In this work, we consider a special MAP, namely Kaczmarz' method for solving systems of linear equations. The convergence of this method is discussed. After giving its matrix formulation and its projection properties, we consider several procedures for accelerating its convergence. They are based on sequence transformations whose kernels contain sequences of the same form as the sequence of vectors generated by Kaczmarz' method. Acceleration can be achieved either directly, that is without modifying the sequence obtained by the method, or by restarting it from the vector obtained by acceleration. Numerical examples show the effectiveness of both procedures.
△ Less
Submitted 1 February, 2013;
originally announced February 2013.
-
Padé-type rational and barycentric interpolation
Authors:
Claude Brezinski,
Michela Redivo-Zaglia
Abstract:
In this paper, we consider the particular case of the general rational Hermite interpolation problem where only the value of the function is interpolated at some points, and where the function and its first derivatives agree at the origin. Thus, the interpolants constructed in this way possess a Padé--type property at 0. Numerical examples show the interest of the procedure. The interpolation proc…
▽ More
In this paper, we consider the particular case of the general rational Hermite interpolation problem where only the value of the function is interpolated at some points, and where the function and its first derivatives agree at the origin. Thus, the interpolants constructed in this way possess a Padé--type property at 0. Numerical examples show the interest of the procedure. The interpolation procedure can be easily modified to introduce a partial knowledge on the poles and the zeros of the function to approximated. A strategy for removing the spurious poles is explained. A formula for the error is proved in the real case. Applications are given.
△ Less
Submitted 24 September, 2012; v1 submitted 25 July, 2011;
originally announced July 2011.
-
Preconditioning linear systems via matrix function evaluation
Authors:
Paolo Novati,
Michela Redivo-Zaglia,
Maria Rosaria Russo
Abstract:
For the solution of discrete ill-posed problems, in this paper a novel preconditioned iterative method based on the Arnoldi algorithm for matrix functions is presented. The method is also extended to work in connection with Tikhonov regularization. Numerical experiments arising from the solution of integral equations and image restoration are presented.
For the solution of discrete ill-posed problems, in this paper a novel preconditioned iterative method based on the Arnoldi algorithm for matrix functions is presented. The method is also extended to work in connection with Tikhonov regularization. Numerical experiments arising from the solution of integral equations and image restoration are presented.
△ Less
Submitted 17 November, 2011; v1 submitted 31 May, 2011;
originally announced May 2011.
-
Multistep epsilon-algorithm, Shanks' transformation, and Lotka-Volterra system by Hirota's method
Authors:
Claude Brezinski,
Yi He,
Xing-Biao Hu,
Michela Redivo-Zaglia,
Jian-Qing Sun
Abstract:
In this paper, we give a multistep extension of the epsilon-algorithm of Wynn, and we show that it implements a multistep extension of the Shanks' sequence transformation which is defined by ratios of determinants. Reciprocally, the quantities defined in this transformation can be recursively computed by the multistep epsilon-algorithm. The multistep epsilon-algorithm and the multistep Shanks' tra…
▽ More
In this paper, we give a multistep extension of the epsilon-algorithm of Wynn, and we show that it implements a multistep extension of the Shanks' sequence transformation which is defined by ratios of determinants. Reciprocally, the quantities defined in this transformation can be recursively computed by the multistep epsilon-algorithm. The multistep epsilon-algorithm and the multistep Shanks' transformation are related to an extended discrete Lotka-Volterra system. These results are obtained by using the Hirota's bilinear method, a procedure quite useful in the solution of nonlinear partial differential and difference equations.
△ Less
Submitted 28 December, 2010;
originally announced December 2010.
-
A rational Arnoldi approach for ill-conditioned linear systems
Authors:
Claude Brezinski,
Paolo Novati,
Michela Redivo-Zaglia
Abstract:
For the solution of full-rank ill-posed linear systems a new approach based on the Arnoldi algorithm is presented. Working with regularized systems, the method theoretically reconstructs the true solution by means of the computation of a suitable function of matrix. In this sense the method can be referred to as an iterative refinement process. Numerical experiments arising from integral equations…
▽ More
For the solution of full-rank ill-posed linear systems a new approach based on the Arnoldi algorithm is presented. Working with regularized systems, the method theoretically reconstructs the true solution by means of the computation of a suitable function of matrix. In this sense the method can be referred to as an iterative refinement process. Numerical experiments arising from integral equations and interpolation theory are presented. Finally, the method is extended to work in connection with the standard Tikhonov regularization with a right hand side contaminated by noise.
△ Less
Submitted 28 September, 2010;
originally announced September 2010.
-
smt: a Matlab structured matrices toolbox
Authors:
Michela Redivo-Zaglia,
Giuseppe Rodriguez
Abstract:
We introduce the smt toolbox for Matlab. It implements optimized storage and fast arithmetics for circulant and Toeplitz matrices, and is intended to be transparent to the user and easily extensible. It also provides a set of test matrices, computation of circulant preconditioners, and two fast algorithms for Toeplitz linear systems.
We introduce the smt toolbox for Matlab. It implements optimized storage and fast arithmetics for circulant and Toeplitz matrices, and is intended to be transparent to the user and easily extensible. It also provides a set of test matrices, computation of circulant preconditioners, and two fast algorithms for Toeplitz linear systems.
△ Less
Submitted 30 March, 2009;
originally announced March 2009.
