Showing 1–5 of 5 results for author: de Almeida, A L F

Randomized block Krylov method for approximation of truncated tensor SVD

Authors: Malihe Nobakht Kooshkghazi, Salman Ahmadi-Asl, Andre L. F. de Almeida

Abstract: This paper is devoted to studying the application of the block Krylov subspace method for approximation of the truncated tensor SVD (T-SVD). The theoretical results of the proposed randomized approach are presented. Several experimental experiments using synthetics and real-world data are conducted to verify the efficiency and feasibility of the proposed randomized approach, and the numerical resu… ▽ More This paper is devoted to studying the application of the block Krylov subspace method for approximation of the truncated tensor SVD (T-SVD). The theoretical results of the proposed randomized approach are presented. Several experimental experiments using synthetics and real-world data are conducted to verify the efficiency and feasibility of the proposed randomized approach, and the numerical results show that the proposed method provides promising results. Applications of the proposed approach to data completion and data compression are presented. △ Less

Submitted 7 April, 2025; originally announced April 2025.

Randomized algorithms for Kroncecker tensor decomposition and applications

Authors: Salman Ahmadi-Asl, Naeim Rezaeian, Andre L. F. de Almeida, Yipeng Liu

Abstract: This paper proposes fast randomized algorithms for computing the Kronecker Tensor Decomposition (KTD). The proposed algorithms can decompose a given tensor into the KTD format much faster than the existing state-of-the-art algorithms. Our principal idea is to use the randomization framework to reduce computational complexity significantly. We provide extensive simulations to verify the effectivene… ▽ More This paper proposes fast randomized algorithms for computing the Kronecker Tensor Decomposition (KTD). The proposed algorithms can decompose a given tensor into the KTD format much faster than the existing state-of-the-art algorithms. Our principal idea is to use the randomization framework to reduce computational complexity significantly. We provide extensive simulations to verify the effectiveness and performance of the proposed randomized algorithms with several orders of magnitude acceleration compared to the deterministic one. Our simulations use synthetics and real-world datasets with applications to tensor completion, video/image compression, image denoising, and image super-resolution △ Less

Submitted 21 May, 2025; v1 submitted 3 December, 2024; originally announced December 2024.

Rank-1 Tensor Approximation Methods and Application to Deflation

Authors: Alex Pereira da Silva, Pierre Comon, Andre Lima Ferrer de Almeida

Abstract: Because of the attractiveness of the canonical polyadic (CP) tensor decomposition in various applications, several algorithms have been designed to compute it, but efficient ones are still lacking. Iterative deflation algorithms based on successive rank-1 approximations can be used to perform this task, since the latter are rather easy to compute. We first present an algebraic rank-1 approximation… ▽ More Because of the attractiveness of the canonical polyadic (CP) tensor decomposition in various applications, several algorithms have been designed to compute it, but efficient ones are still lacking. Iterative deflation algorithms based on successive rank-1 approximations can be used to perform this task, since the latter are rather easy to compute. We first present an algebraic rank-1 approximation method that performs better than the standard higher-order singular value decomposition (HOSVD) for three-way tensors. Second, we propose a new iterative rank-1 approximation algorithm that improves any other rank-1 approximation method. Third, we describe a probabilistic framework allowing to study the convergence of deflation CP decomposition (DCPD) algorithms based on successive rank-1 approximations. A set of computer experiments then validates theoretical results and demonstrates the efficiency of DCPD algorithms compared to other ones. △ Less

Submitted 21 August, 2015; originally announced August 2015.

Consensus-based In-Network Computation of the PARAFAC Decomposition

Authors: Alain Y. Kibangou, André L. F. de Almeida

Abstract: In this work, we present a new approach for the distributed computation of the PARAFAC decomposition of a third-order tensor across a network of collaborating nodes. We are interested in the case where the overall data gathered across the network can be modeled as a data tensor admitting an essentially unique PARAFAC decomposition, while each node only observes a sub-tensor with not necessarily en… ▽ More In this work, we present a new approach for the distributed computation of the PARAFAC decomposition of a third-order tensor across a network of collaborating nodes. We are interested in the case where the overall data gathered across the network can be modeled as a data tensor admitting an essentially unique PARAFAC decomposition, while each node only observes a sub-tensor with not necessarily enough diversity so that identifiability conditions are not locally fulfilled at each node. In this situation, conventional (centralized) tensor based methods cannot be applied individually at each node. By allowing collaboration between neighboring nodes of the network, we propose distributed versions of the alternating least squares (ALS) and Levenberg-Marquardt (LM) algorithms for the in-network estimation of the factor matrices of a third-order tensor. We assume that one of the factor matrices contains parameters that are local to each node, while the two remaining factor matrices contain global parameters that are common to the whole network. The proposed algorithms combine the estimation of the local factors with an in-network computation of the global factors of the PARAFAC decomposition using average consensus over graphs. They emulate their centralized counterparts in the case of ideal data exchange and ideal consensus computations. The performance of the proposed algorithms are evaluated in both ideal and imperfect cases. △ Less

Submitted 5 June, 2014; originally announced June 2014.

Overview of Constrained PARAFAC Models

Authors: Gérard Favier, André L. F. de Almeida

Abstract: In this paper, we present an overview of constrained PARAFAC models where the constraints model linear dependencies among columns of the factor matrices of the tensor decomposition, or alternatively, the pattern of interactions between different modes of the tensor which are captured by the equivalent core tensor. Some tensor prerequisites with a particular emphasis on mode combination using Krone… ▽ More In this paper, we present an overview of constrained PARAFAC models where the constraints model linear dependencies among columns of the factor matrices of the tensor decomposition, or alternatively, the pattern of interactions between different modes of the tensor which are captured by the equivalent core tensor. Some tensor prerequisites with a particular emphasis on mode combination using Kronecker products of canonical vectors that makes easier matricization operations, are first introduced. This Kronecker product based approach is also formulated in terms of the index notation, which provides an original and concise formalism for both matricizing tensors and writing tensor models. Then, after a brief reminder of PARAFAC and Tucker models, two families of constrained tensor models, the co-called PARALIND/CONFAC and PARATUCK models, are described in a unified framework, for $N^{th}$ order tensors. New tensor models, called nested Tucker models and block PARALIND/CONFAC models, are also introduced. A link between PARATUCK models and constrained PARAFAC models is then established. Finally, new uniqueness properties of PARATUCK models are deduced from sufficient conditions for essential uniqueness of their associated constrained PARAFAC models. △ Less

Submitted 29 July, 2014; v1 submitted 28 May, 2014; originally announced May 2014.