Showing 1–7 of 7 results for author: Rontogiannis, A A

Block-Term Tensor Decomposition Model Selection and Computation: The Bayesian Way

Authors: Paris V. Giampouras, Athanasios A. Rontogiannis, Eleftherios Kofidis

Abstract: The so-called block-term decomposition (BTD) tensor model, especially in its rank-$(L_r,L_r,1)$ version, has been recently receiving increasing attention due to its enhanced ability of representing systems and signals that are composed of \emph{blocks} of rank higher than one, a scenario encountered in numerous and diverse applications. Uniqueness conditions and fitting methods have thus been thor… ▽ More The so-called block-term decomposition (BTD) tensor model, especially in its rank-$(L_r,L_r,1)$ version, has been recently receiving increasing attention due to its enhanced ability of representing systems and signals that are composed of \emph{blocks} of rank higher than one, a scenario encountered in numerous and diverse applications. Uniqueness conditions and fitting methods have thus been thoroughly studied. Nevertheless, the challenging problem of estimating the BTD model structure, namely the number of block terms, $R$, and their individual ranks, $L_r$, has only recently started to attract significant attention, mainly through regularization-based approaches which entail the need to tune the regularization parameter(s). In this work, we build on ideas of sparse Bayesian learning (SBL) and put forward a fully automated Bayesian approach. Through a suitably crafted multi-level \emph{hierarchical} probabilistic model, which gives rise to heavy-tailed prior distributions for the BTD factors, structured sparsity is \emph{jointly} imposed. Ranks are then estimated from the numbers of blocks ($R$) and columns ($L_r$) of non-negligible energy. Approximate posterior inference is implemented, within the variational inference framework. The resulting iterative algorithm completely avoids hyperparameter tuning, which is a significant defect of regularization-based methods. Alternative probabilistic models are also explored and the connections with their regularization-based counterparts are brought to light with the aid of the associated maximum a-posteriori (MAP) estimators. We report simulation results with both synthetic and real-word data, which demonstrate the merits of the proposed method in terms of both rank estimation and model fitting as compared to state-of-the-art relevant methods. △ Less

Submitted 5 July, 2021; v1 submitted 8 January, 2021; originally announced January 2021.

Low-rank and Sparse NMF for Joint Endmembers' Number Estimation and Blind Unmixing of Hyperspectral Images

Authors: Paris V. Giampouras, Athanasios A. Rontogiannis, Konstantinos D. Koutroumbas

Abstract: Estimation of the number of endmembers existing in a scene constitutes a critical task in the hyperspectral unmixing process. The accuracy of this estimate plays a crucial role in subsequent unsupervised unmixing steps i.e., the derivation of the spectral signatures of the endmembers (endmembers' extraction) and the estimation of the abundance fractions of the pixels. A common practice amply follo… ▽ More Estimation of the number of endmembers existing in a scene constitutes a critical task in the hyperspectral unmixing process. The accuracy of this estimate plays a crucial role in subsequent unsupervised unmixing steps i.e., the derivation of the spectral signatures of the endmembers (endmembers' extraction) and the estimation of the abundance fractions of the pixels. A common practice amply followed in literature is to treat endmembers' number estimation and unmixing, independently as two separate tasks, providing the outcome of the former as input to the latter. In this paper, we go beyond this computationally demanding strategy. More precisely, we set forth a multiple constrained optimization framework, which encapsulates endmembers' number estimation and unsupervised unmixing in a single task. This is attained by suitably formulating the problem via a low-rank and sparse nonnegative matrix factorization rationale, where low-rankness is promoted with the use of a sophisticated $\ell_2/\ell_1$ norm penalty term. An alternating proximal algorithm is then proposed for minimizing the emerging cost function. The results obtained by simulated and real data experiments verify the effectiveness of the proposed approach. △ Less

Submitted 16 March, 2017; originally announced March 2017.

Online Low-Rank Subspace Learning from Incomplete Data: A Bayesian View

Authors: Paris V. Giampouras, Athanasios A. Rontogiannis, Konstantinos E. Themelis, Konstantinos D. Koutroumbas

Abstract: Extracting the underlying low-dimensional space where high-dimensional signals often reside has long been at the center of numerous algorithms in the signal processing and machine learning literature during the past few decades. At the same time, working with incomplete (partly observed) large scale datasets has recently been commonplace for diverse reasons. This so called {\it big data era} we ar… ▽ More Extracting the underlying low-dimensional space where high-dimensional signals often reside has long been at the center of numerous algorithms in the signal processing and machine learning literature during the past few decades. At the same time, working with incomplete (partly observed) large scale datasets has recently been commonplace for diverse reasons. This so called {\it big data era} we are currently living calls for devising online subspace learning algorithms that can suitably handle incomplete data. Their envisaged objective is to {\it recursively} estimate the unknown subspace by processing streaming data sequentially, thus reducing computational complexity, while obviating the need for storing the whole dataset in memory. In this paper, an online variational Bayes subspace learning algorithm from partial observations is presented. To account for the unawareness of the true rank of the subspace, commonly met in practice, low-rankness is explicitly imposed on the sought subspace data matrix by exploiting sparse Bayesian learning principles. Moreover, sparsity, {\it simultaneously} to low-rankness, is favored on the subspace matrix by the sophisticated hierarchical Bayesian scheme that is adopted. In doing so, the proposed algorithm becomes adept in dealing with applications whereby the underlying subspace may be also sparse, as, e.g., in sparse dictionary learning problems. As shown, the new subspace tracking scheme outperforms its state-of-the-art counterparts in terms of estimation accuracy, in a variety of experiments conducted on simulated and real data. △ Less

Submitted 12 February, 2016; v1 submitted 11 February, 2016; originally announced February 2016.

Semisupervised hyperspectral image unmixing using a variational Bayes algorithm

Authors: Konstantinos E. Themelis, Athanasios A. Rontogiannis, Konstantinos D. Koutroumbas

Abstract: This technical report presents a variational Bayes algorithm for semisupervised hyperspectral image unmixing. The presented Bayesian model employs a heavy tailed, nonnegatively truncated Laplace prior over the abundance coefficients. This prior imposes both the sparsity assumption and the nonnegativity constraint on the abundance coefficients. Experimental results conducted on the Aviris Cuprite d… ▽ More This technical report presents a variational Bayes algorithm for semisupervised hyperspectral image unmixing. The presented Bayesian model employs a heavy tailed, nonnegatively truncated Laplace prior over the abundance coefficients. This prior imposes both the sparsity assumption and the nonnegativity constraint on the abundance coefficients. Experimental results conducted on the Aviris Cuprite data set are presented that demonstrate the effectiveness of the proposed method. △ Less

Submitted 18 June, 2014; originally announced June 2014.

Comments: technical report

A variational Bayes framework for sparse adaptive estimation

Authors: Konstantinos E. Themelis, Athanasios A. Rontogiannis, Konstantinos D. Koutroumbas

Abstract: Recently, a number of mostly $\ell_1$-norm regularized least squares type deterministic algorithms have been proposed to address the problem of \emph{sparse} adaptive signal estimation and system identification. From a Bayesian perspective, this task is equivalent to maximum a posteriori probability estimation under a sparsity promoting heavy-tailed prior for the parameters of interest. Following… ▽ More Recently, a number of mostly $\ell_1$-norm regularized least squares type deterministic algorithms have been proposed to address the problem of \emph{sparse} adaptive signal estimation and system identification. From a Bayesian perspective, this task is equivalent to maximum a posteriori probability estimation under a sparsity promoting heavy-tailed prior for the parameters of interest. Following a different approach, this paper develops a unifying framework of sparse \emph{variational Bayes} algorithms that employ heavy-tailed priors in conjugate hierarchical form to facilitate posterior inference. The resulting fully automated variational schemes are first presented in a batch iterative form. Then it is shown that by properly exploiting the structure of the batch estimation task, new sparse adaptive variational Bayes algorithms can be derived, which have the ability to impose and track sparsity during real-time processing in a time-varying environment. The most important feature of the proposed algorithms is that they completely eliminate the need for computationally costly parameter fine-tuning, a necessary ingredient of sparse adaptive deterministic algorithms. Extensive simulation results are provided to demonstrate the effectiveness of the new sparse variational Bayes algorithms against state-of-the-art deterministic techniques for adaptive channel estimation. The results show that the proposed algorithms are numerically robust and exhibit in general superior estimation performance compared to their deterministic counterparts. △ Less

Submitted 13 January, 2014; originally announced January 2014.

Approximating the mean of a truncated normal distribution

Authors: Konstantinos D. Koutroumbas, Konstantinos E. Themelis, Athanasios A. Rontogiannis

Abstract: A non trivial problem that arises in several applications is the estimation of the mean of a truncated normal distribution. In this paper, an iterative deterministic scheme for approximating this mean is proposed. It has been inspired from an iterative Markov chain Monte Carlo (MCMC) scheme that addresses this problem and it can be viewed as a generalization of a recently proposed relevant model.… ▽ More A non trivial problem that arises in several applications is the estimation of the mean of a truncated normal distribution. In this paper, an iterative deterministic scheme for approximating this mean is proposed. It has been inspired from an iterative Markov chain Monte Carlo (MCMC) scheme that addresses this problem and it can be viewed as a generalization of a recently proposed relevant model. Conditions are provided under which it is proved that the scheme converges to a unique fixed point. Finally, the theoretical results are also supported by computer simulations, which also show the rapid convergence of the method to a solution vector that is very close to the mean of the truncated normal distribution under study. △ Less

Submitted 2 April, 2014; v1 submitted 2 July, 2013; originally announced July 2013.

On the unmixing of MEx/OMEGA hyperspectral data

Authors: Konstantinos E. Themelis, Frédéric Schmidt, Olga Sykioti, Athanasios A. Rontogiannis, Konstantinos D. Koutroumbas, Ioannis A. Daglis

Abstract: This article presents a comparative study of three different types of estimators used for supervised linear unmixing of two MEx/OMEGA hyperspectral cubes. The algorithms take into account the constraints of the abundance fractions, in order to get physically interpretable results. Abundance maps show that the Bayesian maximum a posteriori probability (MAP) estimator proposed in Themelis and Rontog… ▽ More This article presents a comparative study of three different types of estimators used for supervised linear unmixing of two MEx/OMEGA hyperspectral cubes. The algorithms take into account the constraints of the abundance fractions, in order to get physically interpretable results. Abundance maps show that the Bayesian maximum a posteriori probability (MAP) estimator proposed in Themelis and Rontogiannis (2008) outperforms the other two schemes, offering a compromise between complexity and estimation performance. Thus, the MAP estimator is a candidate algorithm to perform ice and minerals detection on large hyperspectral datasets. △ Less

Submitted 7 December, 2011; originally announced December 2011.

Journal ref: Planetary and Space Science, 2011