Showing 1–9 of 9 results for author: Averbuch, A

Directional wavelet packets originating from polynomial splines

Authors: Amir Averbuch, Pekka Neittaanmaki, Valery Zheludev

Abstract: The paper presents a versatile library of quasi-analytic complex-valued wavelet packets (WPs) which originate from polynomial splines of arbitrary orders. The real parts of the quasi-analytic WPs are the regular spline-based orthonormal WPs designed in [1]. The imaginary parts are the so-called complementary orthonormal WPs that are derived from the Hilbert transforms of the regular WPs and, unlik… ▽ More The paper presents a versatile library of quasi-analytic complex-valued wavelet packets (WPs) which originate from polynomial splines of arbitrary orders. The real parts of the quasi-analytic WPs are the regular spline-based orthonormal WPs designed in [1]. The imaginary parts are the so-called complementary orthonormal WPs that are derived from the Hilbert transforms of the regular WPs and, unlike the symmetric regular WPs, are antisymmetric. Tensor products of 1D quasi-analytic WPs provide a diversity of 2D WPs oriented in multiple directions. For example, a set of the fourth-level WPs comprises 62 different directions. The properties of the presented WPs are refined frequency resolution, directionality of waveforms with unlimited number of orientations, (anti-)symmetry of waveforms and windowed oscillating structure of waveforms with a variety of frequencies. Directional WPs have a strong potential to be used in various image processing applications such as restoration of degraded images and extraction of characteristic features from the images. △ Less

Submitted 11 August, 2020; originally announced August 2020.

Comments: 26 pages, 18 figures. arXiv admin note: substantial text overlap with arXiv:1907.01479, arXiv:2001.04899

Analytic and directional wavelet packets in the space of periodic signals

Authors: Amir Averbuch, Pekka Neittaanmaki, Valery Zheludev

Abstract: The paper presents a versatile library of analytic and quasi-analytic complex-valued wavelet packets (WPs) which originate from discrete splines of arbitrary orders. The real parts of the quasi-analytic WPs are the regular spline-based orthonormal WPs designed in [2]. The imaginary parts are the so-called complementary orthonormal WPs, which, unlike the symmetric regular WPs, they are antisymmetri… ▽ More The paper presents a versatile library of analytic and quasi-analytic complex-valued wavelet packets (WPs) which originate from discrete splines of arbitrary orders. The real parts of the quasi-analytic WPs are the regular spline-based orthonormal WPs designed in [2]. The imaginary parts are the so-called complementary orthonormal WPs, which, unlike the symmetric regular WPs, they are antisymmetric. Tensor products of 1D quasi-analytic WPs provide a diversity of 2D WPs oriented in multiple directions. For example, a set of the fourth-level WPs comprises 62 different directions. The designed computational scheme in the paper enables us to get fast and easy implementation of the WP transforms. The presented WPs proved to be efficient in signal/image processing applications such as restoration of images degraded by either additive noise or missing of up to 90% of their pixels. △ Less

Submitted 3 July, 2019; v1 submitted 2 July, 2019; originally announced July 2019.

Matrix Decompositions using sub-Gaussian Random Matrices

Authors: Yariv Aizenbud, Amir Averbuch

Abstract: In recent years, several algorithms, which approximate matrix decomposition, have been developed. These algorithms are based on metric conservation features for linear spaces of random projection types. We show that an i.i.d sub-Gaussian matrix with large probability to have zero entries is metric conserving. We also present a new algorithm, which achieves with high probability, a rank $r$ decompo… ▽ More In recent years, several algorithms, which approximate matrix decomposition, have been developed. These algorithms are based on metric conservation features for linear spaces of random projection types. We show that an i.i.d sub-Gaussian matrix with large probability to have zero entries is metric conserving. We also present a new algorithm, which achieves with high probability, a rank $r$ decomposition approximation for an $m \times n$ matrix that has an asymptotic complexity like state-of-the-art algorithms. We derive an error bound that does not depend on the first $r$ singular values. Although the proven error bound is not as tight as the state-of-the-art bound, experiments show that the proposed algorithm is faster in practice, while getting the same error rates as the state-of-the-art algorithms get. △ Less

Submitted 10 February, 2016; originally announced February 2016.

Randomized LU Decomposition Using Sparse Projections

Authors: Yariv Aizenbud, Gil Shabat, Amir Averbuch

Abstract: A fast algorithm for the approximation of a low rank LU decomposition is presented. In order to achieve a low complexity, the algorithm uses sparse random projections combined with FFT-based random projections. The asymptotic approximation error of the algorithm is analyzed and a theoretical error bound is presented. Finally, numerical examples illustrate that for a similar approximation error, th… ▽ More A fast algorithm for the approximation of a low rank LU decomposition is presented. In order to achieve a low complexity, the algorithm uses sparse random projections combined with FFT-based random projections. The asymptotic approximation error of the algorithm is analyzed and a theoretical error bound is presented. Finally, numerical examples illustrate that for a similar approximation error, the sparse LU algorithm is faster than recent state-of-the-art methods. The algorithm is completely parallelizable that enables to run on a GPU. The performance is tested on a GPU card, showing a significant improvement in the running time in comparison to sequential execution. △ Less

Submitted 17 January, 2016; originally announced January 2016.

Diffusion Representations

Authors: Moshe Salhov, Amit Bermanis, Guy Wolf, Amir Averbuch

Abstract: Diffusion Maps framework is a kernel based method for manifold learning and data analysis that defines diffusion similarities by imposing a Markovian process on the given dataset. Analysis by this process uncovers the intrinsic geometric structures in the data. Recently, it was suggested to replace the standard kernel by a measure-based kernel that incorporates information about the density of the… ▽ More Diffusion Maps framework is a kernel based method for manifold learning and data analysis that defines diffusion similarities by imposing a Markovian process on the given dataset. Analysis by this process uncovers the intrinsic geometric structures in the data. Recently, it was suggested to replace the standard kernel by a measure-based kernel that incorporates information about the density of the data. Thus, the manifold assumption is replaced by a more general measure-based assumption. The measure-based diffusion kernel incorporates two separate independent representations. The first determines a measure that correlates with a density that represents normal behaviors and patterns in the data. The second consists of the analyzed multidimensional data points. In this paper, we present a representation framework for data analysis of datasets that is based on a closed-form decomposition of the measure-based kernel. The proposed representation preserves pairwise diffusion distances that does not depend on the data size while being invariant to scale. For a stationary data, no out-of-sample extension is needed for embedding newly arrived data points in the representation space. Several aspects of the presented methodology are demonstrated on analytically generated data. △ Less

Submitted 19 November, 2015; originally announced November 2015.

Direct Inversion of the 3D Pseudo-polar Fourier Transform

Authors: Amir Averbuch, Gil Shabat, Yoel Shkolnisky

Abstract: The pseudo-polar Fourier transform is a specialized non-equally spaced Fourier transform, which evaluates the Fourier transform on a near-polar grid, known as the pseudo-polar grid. The advantage of the pseudo-polar grid over other non-uniform sampling geometries is that the transformation, which samples the Fourier transform on the pseudo-polar grid, can be inverted using a fast and stable algori… ▽ More The pseudo-polar Fourier transform is a specialized non-equally spaced Fourier transform, which evaluates the Fourier transform on a near-polar grid, known as the pseudo-polar grid. The advantage of the pseudo-polar grid over other non-uniform sampling geometries is that the transformation, which samples the Fourier transform on the pseudo-polar grid, can be inverted using a fast and stable algorithm. For other sampling geometries, even if the non-equally spaced Fourier transform can be inverted, the only known algorithms are iterative. The convergence speed of these algorithms as well as their accuracy are difficult to control, as they depend both on the sampling geometry as well as on the unknown reconstructed object. In this paper, we present a direct inversion algorithm for the three-dimensional pseudo-polar Fourier transform. The algorithm is based only on one-dimensional resampling operations, and is shown to be significantly faster than existing iterative inversion algorithms. △ Less

Submitted 6 February, 2016; v1 submitted 22 July, 2015; originally announced July 2015.

Randomized LU Decomposition

Authors: Gil Shabat, Yaniv Shmueli, Yariv Aizenbud, Amir Averbuch

Abstract: We present a fast randomized algorithm that computes a low rank LU decomposition. Our algorithm uses random projections type techniques to efficiently compute a low rank approximation of large matrices. The randomized LU algorithm can be parallelized and further accelerated by using sparse random matrices in its projection step. Several different error bounds are proven for the algorithm approxima… ▽ More We present a fast randomized algorithm that computes a low rank LU decomposition. Our algorithm uses random projections type techniques to efficiently compute a low rank approximation of large matrices. The randomized LU algorithm can be parallelized and further accelerated by using sparse random matrices in its projection step. Several different error bounds are proven for the algorithm approximations. To prove these bounds, recent results from random matrix theory related to subgaussian matrices are used. As an application, we also show how the algorithm can be utilized to solve problems such as the rank-deficient least squares problem. Numerical examples, which illustrate the performance of the algorithm and compare it to other decomposition methods, are presented. △ Less

Submitted 30 January, 2016; v1 submitted 27 October, 2013; originally announced October 2013.

Matrix Compression using the Nystroöm Method

Authors: Arik Nemtsov, Amir Averbuch, Alon Schclar

Abstract: The Nyström method is routinely used for out-of-sample extension of kernel matrices. We describe how this method can be applied to find the singular value decomposition (SVD) of general matrices and the eigenvalue decomposition (EVD) of square matrices. We take as an input a matrix $M\in \mathbb{R}^{m\times n}$, a user defined integer $s\leq min(m,n)$ and $A_M \in \mathbb{R}^{s\times s}$, a matrix… ▽ More The Nyström method is routinely used for out-of-sample extension of kernel matrices. We describe how this method can be applied to find the singular value decomposition (SVD) of general matrices and the eigenvalue decomposition (EVD) of square matrices. We take as an input a matrix $M\in \mathbb{R}^{m\times n}$, a user defined integer $s\leq min(m,n)$ and $A_M \in \mathbb{R}^{s\times s}$, a matrix sampled from the columns and rows of $M$. These are used to construct an approximate rank-$s$ SVD of $M$ in $O\left(s^2\left(m+n\right)\right)$ operations. If $M$ is square, the rank-$s$ EVD can be similarly constructed in $O\left(s^2 n\right)$ operations. Thus, the matrix $A_M$ is a compressed version of $M$. We discuss the choice of $A_M$ and propose an algorithm that selects a good initial sample for a pivoted version of $M$. The proposed algorithm performs well for general matrices and kernel matrices whose spectra exhibit fast decay. △ Less

Submitted 1 May, 2013; originally announced May 2013.

Comments: 31 pages, 3 figures, submitted to Linear Algebra and its Applications

Missing Entries Matrix Approximation and Completion

Authors: Gil Shabat, Yaniv Shmueli, Amir Averbuch

Abstract: We describe several algorithms for matrix completion and matrix approximation when only some of its entries are known. The approximation constraint can be any whose approximated solution is known for the full matrix. For low rank approximations, similar algorithms appears recently in the literature under different names. In this work, we introduce new theorems for matrix approximation and show tha… ▽ More We describe several algorithms for matrix completion and matrix approximation when only some of its entries are known. The approximation constraint can be any whose approximated solution is known for the full matrix. For low rank approximations, similar algorithms appears recently in the literature under different names. In this work, we introduce new theorems for matrix approximation and show that these algorithms can be extended to handle different constraints such as nuclear norm, spectral norm, orthogonality constraints and more that are different than low rank approximations. As the algorithms can be viewed from an optimization point of view, we discuss their convergence to global solution for the convex case. We also discuss the optimal step size and show that it is fixed in each iteration. In addition, the derived matrix completion flow is robust and does not require any parameters. This matrix completion flow is applicable to different spectral minimizations and can be applied to physics, mathematics and electrical engineering problems such as data reconstruction of images and data coming from PDEs such as Helmholtz equation used for electromagnetic waves. △ Less

Submitted 29 June, 2014; v1 submitted 27 February, 2013; originally announced February 2013.