-
Matrix Product State for Higher-Order Tensor Compression and Classification
Authors:
Johann A. Bengua,
Ho N. Phien,
Hoang D. Tuan,
Minh N. Do
Abstract:
This paper introduces matrix product state (MPS) decomposition as a new and systematic method to compress multidimensional data represented by higher-order tensors. It solves two major bottlenecks in tensor compression: computation and compression quality. Regardless of tensor order, MPS compresses tensors to matrices of moderate dimension which can be used for classification. Mainly based on a su…
▽ More
This paper introduces matrix product state (MPS) decomposition as a new and systematic method to compress multidimensional data represented by higher-order tensors. It solves two major bottlenecks in tensor compression: computation and compression quality. Regardless of tensor order, MPS compresses tensors to matrices of moderate dimension which can be used for classification. Mainly based on a successive sequence of singular value decompositions (SVD), MPS is quite simple to implement and arrives at the global optimal matrix, bypassing local alternating optimization, which is not only computationally expensive but cannot yield the global solution. Benchmark results show that MPS can achieve better classification performance with favorable computation cost compared to other tensor compression methods.
△ Less
Submitted 15 September, 2016;
originally announced September 2016.
-
Concatenated image completion via tensor augmentation and completion
Authors:
Johann A. Bengua,
Hoang D. Tuan,
Ho N. Phien,
Minh N. Do
Abstract:
This paper proposes a novel framework called concatenated image completion via tensor augmentation and completion (ICTAC), which recovers missing entries of color images with high accuracy. Typical images are second- or third-order tensors (2D/3D) depending if they are grayscale or color, hence tensor completion algorithms are ideal for their recovery. The proposed framework performs image complet…
▽ More
This paper proposes a novel framework called concatenated image completion via tensor augmentation and completion (ICTAC), which recovers missing entries of color images with high accuracy. Typical images are second- or third-order tensors (2D/3D) depending if they are grayscale or color, hence tensor completion algorithms are ideal for their recovery. The proposed framework performs image completion by concatenating copies of a single image that has missing entries into a third-order tensor, applying a dimensionality augmentation technique to the tensor, utilizing a tensor completion algorithm for recovering its missing entries, and finally extracting the recovered image from the tensor. The solution relies on two key components that have been recently proposed to take advantage of the tensor train (TT) rank: A tensor augmentation tool called ket augmentation (KA) that represents a low-order tensor by a higher-order tensor, and the algorithm tensor completion by parallel matrix factorization via tensor train (TMac-TT), which has been demonstrated to outperform state-of-the-art tensor completion algorithms. Simulation results for color image recovery show the clear advantage of our framework against current state-of-the-art tensor completion algorithms.
△ Less
Submitted 13 July, 2016;
originally announced July 2016.
-
Efficient tensor completion for color image and video recovery: Low-rank tensor train
Authors:
Johann A. Bengua,
Ho N. Phien,
Hoang D. Tuan,
Minh N. Do
Abstract:
This paper proposes a novel approach to tensor completion, which recovers missing entries of data represented by tensors. The approach is based on the tensor train (TT) rank, which is able to capture hidden information from tensors thanks to its definition from a well-balanced matricization scheme. Accordingly, new optimization formulations for tensor completion are proposed as well as two new alg…
▽ More
This paper proposes a novel approach to tensor completion, which recovers missing entries of data represented by tensors. The approach is based on the tensor train (TT) rank, which is able to capture hidden information from tensors thanks to its definition from a well-balanced matricization scheme. Accordingly, new optimization formulations for tensor completion are proposed as well as two new algorithms for their solution. The first one called simple low-rank tensor completion via tensor train (SiLRTC-TT) is intimately related to minimizing a nuclear norm based on TT rank. The second one is from a multilinear matrix factorization model to approximate the TT rank of a tensor, and is called tensor completion by parallel matrix factorization via tensor train (TMac-TT). A tensor augmentation scheme of transforming a low-order tensor to higher-orders is also proposed to enhance the effectiveness of SiLRTC-TT and TMac-TT. Simulation results for color image and video recovery show the clear advantage of our method over all other methods.
△ Less
Submitted 5 June, 2016;
originally announced June 2016.
-
Two-hop Power-Relaying for Linear Wireless Sensor Networks
Authors:
Johann A. Bengua,
Hoang D. Tuan,
Ho N. Phien,
Ha H. Kha
Abstract:
This paper presents two-hop relay gain-scheduling control in a Wireless Sensor Network to estimate a static target prior characterized by Gaussian probability distribution. The target is observed by a network of linear sensors, whose observations are transmitted to a fusion center for carrying out final estimation via a amplify-and-forward relay node. We are concerned with the joint transmission p…
▽ More
This paper presents two-hop relay gain-scheduling control in a Wireless Sensor Network to estimate a static target prior characterized by Gaussian probability distribution. The target is observed by a network of linear sensors, whose observations are transmitted to a fusion center for carrying out final estimation via a amplify-and-forward relay node. We are concerned with the joint transmission power allocation for sensors and relay to optimize the minimum mean square error (MMSE) estimator, which is deployed at the fusion center. Particularly, such highly nonlinear optimization problems are solved by an iterative procedure of very low computational complexity. Simulations are provided to support the efficiency of our proposed power allocation.
△ Less
Submitted 11 February, 2016;
originally announced February 2016.
-
Matrix Product State for Feature Extraction of Higher-Order Tensors
Authors:
Johann A. Bengua,
Ho N. Phien,
Hoang D. Tuan,
Minh N. Do
Abstract:
This paper introduces matrix product state (MPS) decomposition as a computational tool for extracting features of multidimensional data represented by higher-order tensors. Regardless of tensor order, MPS extracts its relevant features to the so-called core tensor of maximum order three which can be used for classification. Mainly based on a successive sequence of singular value decompositions (SV…
▽ More
This paper introduces matrix product state (MPS) decomposition as a computational tool for extracting features of multidimensional data represented by higher-order tensors. Regardless of tensor order, MPS extracts its relevant features to the so-called core tensor of maximum order three which can be used for classification. Mainly based on a successive sequence of singular value decompositions (SVD), MPS is quite simple to implement without any recursive procedure needed for optimizing local tensors. Thus, it leads to substantial computational savings compared to other tensor feature extraction methods such as higher-order orthogonal iteration (HOOI) underlying the Tucker decomposition (TD). Benchmark results show that MPS can reduce significantly the feature space of data while achieving better classification performance compared to HOOI.
△ Less
Submitted 20 January, 2016; v1 submitted 2 March, 2015;
originally announced March 2015.
