-
Phasebook: A Survey of Selected Open Problems in Phase Retrieval
Authors:
Marc Allain,
Selin Aslan,
Wim Coene,
Sjoerd Dirksen,
Jonathan Dong,
Julien Flamant,
Mark Iwen,
Felix Krahmer,
Tristan van Leeuwen,
Oleh Melnyk,
Andreas Menzel,
Allard P. Mosk,
Viktor Nikitin,
Gerlind Plonka,
Palina Salanevich,
Matthias Wellershoff
Abstract:
Phase retrieval is an inverse problem that, on one hand, is crucial in many applications across imaging and physics, and, on the other hand, leads to deep research questions in theoretical signal processing and applied harmonic analysis. This survey paper is an outcome of the recent workshop Phase Retrieval in Mathematics and Applications (PRiMA) (held on August 5--9 2024 at the Lorentz Center in…
▽ More
Phase retrieval is an inverse problem that, on one hand, is crucial in many applications across imaging and physics, and, on the other hand, leads to deep research questions in theoretical signal processing and applied harmonic analysis. This survey paper is an outcome of the recent workshop Phase Retrieval in Mathematics and Applications (PRiMA) (held on August 5--9 2024 at the Lorentz Center in Leiden, The Netherlands) that brought together experts working on theoretical and practical aspects of the phase retrieval problem with the purpose to formulate and explore essential open problems in the field.
△ Less
Submitted 21 May, 2025;
originally announced May 2025.
-
MOCCA: A Fast Algorithm for Parallel MRI Reconstruction Using Model Based Coil Calibration
Authors:
Gerlind Plonka,
Yannick Riebe
Abstract:
We propose a new fast algorithm for simultaneous recovery of the coil sensitivities and of the magnetization image from incomplete Fourier measurements in parallel MRI. Our approach is based on a parameter model for the coil sensitivities using bivariate trigonometric polynomials of small degree. The derived MOCCA algorithm has low computational complexity of $O(N_c N^2 \log N)$ for $N \times N$ i…
▽ More
We propose a new fast algorithm for simultaneous recovery of the coil sensitivities and of the magnetization image from incomplete Fourier measurements in parallel MRI. Our approach is based on a parameter model for the coil sensitivities using bivariate trigonometric polynomials of small degree. The derived MOCCA algorithm has low computational complexity of $O(N_c N^2 \log N)$ for $N \times N$ images and $N_c$ coils and achieves very good performance for incomplete MRI data. We present a complete mathematical analysis of the proposed reconstruction method. Further, we show that MOCCA achieves similarly good reconstruction results as ESPIRiT with a considerably smaller numerical effort which is due to the employed parameter model. Our numerical examples show that MOCCA can outperform several other reconstruction methods.
△ Less
Submitted 28 October, 2024; v1 submitted 19 March, 2024;
originally announced March 2024.
-
Differential approximation of the Gaussian by short cosine sums with exponential error decay
Authors:
Nadiia Derevianko,
Gerlind Plonka
Abstract:
In this paper, we propose a method to approximate the Gaussian function on ${\mathbb R}$ by a short cosine sum. We generalise and extend the differential approximation method proposed in [4, 40] to approximate $\mathrm{e}^{-t^{2}/2σ}$ in the weighted space $L^{2}({\mathbb R}, \mathrm{e}^{-t^{2}/2ρ})$ where $σ, \, ρ>0$. We prove that the optimal frequency parameters $λ_1, \ldots , λ_{N}$ for this m…
▽ More
In this paper, we propose a method to approximate the Gaussian function on ${\mathbb R}$ by a short cosine sum. We generalise and extend the differential approximation method proposed in [4, 40] to approximate $\mathrm{e}^{-t^{2}/2σ}$ in the weighted space $L^{2}({\mathbb R}, \mathrm{e}^{-t^{2}/2ρ})$ where $σ, \, ρ>0$. We prove that the optimal frequency parameters $λ_1, \ldots , λ_{N}$ for this method in the approximation problem $ \min\limits_{λ_{1},\ldots, λ_{N}, γ_{1}, \ldots, γ_{N}}\|\mathrm{e}^{-\cdot^{2}/2σ} - \sum_{j=1}^{N} γ_{j} \, {\mathrm e}^{λ_{j} \cdot}\|_{L^{2}({\mathbb R}, \mathrm{e}^{-t^{2}/2ρ})}$, are zeros of a scaled Hermite polynomial. This observation leads us to a numerically stable approximation method with low computational cost of ${\mathcal O}(N^{3})$ operations. We derive a direct algorithm to solve this approximation problem based on a matrix pencil method for a special structured matrix. The entries of this matrix are determined by hypergeometric functions. For the weighted $L^{2}$-norm, we prove that the approximation error decays exponentially with respect to the length $N$ of the sum. An exponentially decaying error in the (unweighted) $L^{2}$-norm is achieved using a truncated cosine sum. Our new convergence result for approximation of Gaussian functions by exponential sums of length $N$ shows that exponential error decay rates $e^{-cN}$ are not only achievable for complete monotone functions.
△ Less
Submitted 22 May, 2025; v1 submitted 25 July, 2023;
originally announced July 2023.
-
Spline Representation and Redundancies of One-Dimensional ReLU Neural Network Models
Authors:
Gerlind Plonka,
Yannick Riebe,
Yurii Kolomoitsev
Abstract:
We analyze the structure of a one-dimensional deep ReLU neural network (ReLU DNN) in comparison to the model of continuous piecewise linear (CPL) spline functions with arbitrary knots. In particular, we give a recursive algorithm to transfer the parameter set determining the ReLU DNN into the parameter set of a CPL spline function. Using this representation, we show that after removing the well-kn…
▽ More
We analyze the structure of a one-dimensional deep ReLU neural network (ReLU DNN) in comparison to the model of continuous piecewise linear (CPL) spline functions with arbitrary knots. In particular, we give a recursive algorithm to transfer the parameter set determining the ReLU DNN into the parameter set of a CPL spline function. Using this representation, we show that after removing the well-known parameter redundancies of the ReLU DNN, which are caused by the positive scaling property, all remaining parameters are independent. Moreover, we show that the ReLU DNN with one, two or three hidden layers can represent CPL spline functions with $K$ arbitrarily prescribed knots (breakpoints), where $K$ is the number of real parameters determining the normalized ReLU DNN (up to the output layer parameters). Our findings are useful to fix a priori conditions on the ReLU DNN to achieve an output with prescribed breakpoints and function values.
△ Less
Submitted 29 July, 2022;
originally announced July 2022.
-
ESPRIT versus ESPIRA for reconstruction of short cosine sums and its application
Authors:
Nadiia Derevianko,
Gerlind Plonka,
Raha Razavi
Abstract:
In this paper we introduce two new algorithms for stable approximation with and recovery of short cosine sums. The used signal model contains cosine terms with arbitrary real positive frequency parameters and therefore strongly generalizes usual Fourier sums. The proposed methods both employ a set of equidistant signal values as input data. The ESPRIT method for cosine sums is a Prony-like method…
▽ More
In this paper we introduce two new algorithms for stable approximation with and recovery of short cosine sums. The used signal model contains cosine terms with arbitrary real positive frequency parameters and therefore strongly generalizes usual Fourier sums. The proposed methods both employ a set of equidistant signal values as input data. The ESPRIT method for cosine sums is a Prony-like method and applies matrix pencils of Toeplitz+Hankel matrices while the ESPIRA method is based on rational approximation of DCT data and can be understood as a matrix pencil method for special Loewner matrices. Compared to known numerical methods for recovery of exponential sums, the design of the considered new algorithms directly exploits the special real structure of the signal model and therefore usually provides real parameter estimates for noisy input data, while the known general recovery algorithms for complex exponential sums tend to yield complex parameters in this case.
△ Less
Submitted 7 April, 2022;
originally announced April 2022.
-
From ESPRIT to ESPIRA: Estimation of Signal Parameters by Iterative Rational Approximation
Authors:
Nadiia Derevianko,
Gerlind Plonka,
Markus Petz
Abstract:
We introduce a new method for Estimation of Signal Parameters based on Iterative Rational Approximation (ESPIRA) for sparse exponential sums. Our algorithm uses the AAA algorithm for rational approximation of the discrete Fourier transform of the given equidistant signal values. We show that ESPIRA can be interpreted as a matrix pencil method applied to Loewner matrices. These Loewner matrices are…
▽ More
We introduce a new method for Estimation of Signal Parameters based on Iterative Rational Approximation (ESPIRA) for sparse exponential sums. Our algorithm uses the AAA algorithm for rational approximation of the discrete Fourier transform of the given equidistant signal values. We show that ESPIRA can be interpreted as a matrix pencil method applied to Loewner matrices. These Loewner matrices are closely connected with the Hankel matrices which are usually employed for signal recovery. Due to the construction of the Loewner matrices via an adaptive selection of index sets, the matrix pencil method is stabilized. ESPIRA achieves similar recovery results for exact data as ESPRIT and the matrix pencil method but with less computational effort. Moreover, ESPIRA strongly outperforms ESPRIT and the matrix pencil method for noisy data and for signal approximation by short exponential sums.
△ Less
Submitted 6 January, 2022; v1 submitted 29 June, 2021;
originally announced June 2021.
-
Exact Reconstruction of Extended Exponential Sums using Rational Approximation of their Fourier Coefficients
Authors:
Nadiia Derevianko,
Gerlind Plonka
Abstract:
In this paper we derive a new recovery procedure for the reconstruction of extended exponential sums of the form $y(t) = \sum_{j=1}^{M} \left( \sum_{m=0}^{n_j} \, γ_{j,m} \, t^{m} \right) {\mathrm e}^{2πλ_j t}$, where the frequency parameters $λ_{j} \in {\mathbb C}$ are pairwise distinct. For the reconstruction we employ a finite set of classical Fourier coefficients of $y$ with regard to a finite…
▽ More
In this paper we derive a new recovery procedure for the reconstruction of extended exponential sums of the form $y(t) = \sum_{j=1}^{M} \left( \sum_{m=0}^{n_j} \, γ_{j,m} \, t^{m} \right) {\mathrm e}^{2πλ_j t}$, where the frequency parameters $λ_{j} \in {\mathbb C}$ are pairwise distinct. For the reconstruction we employ a finite set of classical Fourier coefficients of $y$ with regard to a finite interval $[0,P] \subset {\mathbb R}$ with $P>0$. Our method requires at most $2N+2$ Fourier coefficients $c_{k}(y)$ to recover all parameters of $y$, where $N:=\sum_{j=1}^{M} (1+n_{j})$ denotes the order of $y$. The recovery is based on the observation that for $λ_{j} \not\in \frac{\mathrm i}{P} {\mathbb Z}$ the terms of $y$ possess Fourier coefficients with rational structure. We employ a recently proposed stable iterative rational approximation algorithm in [12]. If a sufficiently large set of $L$ Fourier coefficients of $y$ is available (i.e., $L > 2N+2$), then our recovery method automatically detects the number $M$ of terms of $y$, the multiplicities $n_{j}$ for $j=1, \ldots , M$, as well as all parameters $λ_{j}$, $j=1, \ldots , M$ and $ γ_{j,m}$ $j=1, \ldots , M$, $m=0, \ldots , n_{j}$, determining $y$. Therefore our method provides a new stable alternative to the known numerical approaches for the recovery of exponential sums that are based on Prony's method.
△ Less
Submitted 13 March, 2021;
originally announced March 2021.
-
Exact Reconstruction of Sparse Non-Harmonic Signals from Fourier Coefficients
Authors:
Markus Petz,
Gerlind Plonka,
Nadiia Derevianko
Abstract:
In this paper, we derive a new reconstruction method for real non-harmonic Fourier sums, i.e., real signals which can be represented as sparse exponential sums of the form $f(t) = \sum_{j=1}^{K} γ_{j} \, \cos(2πa_{j} t + b_{j})$, where the frequency parameters $a_{j} \in {\mathbb R}$ (or $a_{j} \in {\mathrm i} {\mathbb R}$) are pairwise different. Our method is based on the recently proposed stabl…
▽ More
In this paper, we derive a new reconstruction method for real non-harmonic Fourier sums, i.e., real signals which can be represented as sparse exponential sums of the form $f(t) = \sum_{j=1}^{K} γ_{j} \, \cos(2πa_{j} t + b_{j})$, where the frequency parameters $a_{j} \in {\mathbb R}$ (or $a_{j} \in {\mathrm i} {\mathbb R}$) are pairwise different. Our method is based on the recently proposed stable iterative rational approximation algorithm in \cite{NST18}. For signal reconstruction we use a set of classical Fourier coefficients of $f$ with regard to a fixed interval $(0, P)$ with $P>0$. Even though all terms of $f$ may be non-$P$-periodic, our reconstruction method requires at most $2K+2$ Fourier coefficients $c_{n}(f)$ to recover all parameters of $f$. We show that in the case of exact data, the proposed iterative algorithm terminates after at most $K+1$ steps. The algorithm can also detect the number $K$ of terms of $f$, if $K$ is a priori unknown and $L>2K+2$ Fourier coefficients are available. Therefore our method provides a new stable alternative to the known numerical approaches for the recovery of exponential sums that are based on Prony's method.
Keywords: sparse exponential sums, non-harmonic Fourier sums, reconstruction of sparse non-periodic signals, rational approximation, AAA algorithm, barycentric representation, Fourier coefficients
△ Less
Submitted 26 November, 2020;
originally announced November 2020.
-
Optimal Rank-1 Hankel Approximation of Matrices: Frobenius Norm, Spectral Norm, and Cadzow's Algorithm
Authors:
Hanna Knirsch,
Markus Petz,
Gerlind Plonka
Abstract:
We characterize optimal rank-1 matrix approximations with Hankel or Toeplitz structure with regard to two different norms, the Frobenius norm and the spectral norm, in a new way. More precisely, we show that these rank-1 matrix approximation problems can be solved by maximizing special rational functions. Our approach enables us to show that the optimal solutions with respect to these two norms ha…
▽ More
We characterize optimal rank-1 matrix approximations with Hankel or Toeplitz structure with regard to two different norms, the Frobenius norm and the spectral norm, in a new way. More precisely, we show that these rank-1 matrix approximation problems can be solved by maximizing special rational functions. Our approach enables us to show that the optimal solutions with respect to these two norms have completely different structure and only coincide in the trivial case when the singular value decomposition already provides an optimal rank-1 approximation with the desired Hankel or Toeplitz structure.
We also prove that the Cadzow algorithm for structured low-rank approximations always converges to a fixed point in the rank-1 case. However, it usually does not converge to the optimal solution, neither with regard to the Frobenius norm nor the spectral norm.
△ Less
Submitted 7 March, 2021; v1 submitted 23 April, 2020;
originally announced April 2020.
-
Deterministic Sparse Sublinear FFT with Improved Numerical Stability
Authors:
Gerlind Plonka,
Therese von Wulffen
Abstract:
In this paper we extend the deterministic sublinear FFT algorithm in Plonka et al. (2018) for fast reconstruction of $M$-sparse vectors ${\mathbf x}$ of length $N= 2^J$, where we assume that all components of the discrete Fourier transform $\hat{\mathbf x}= {\mathbf F}_{N} {\mathbf x}$ are available. The sparsity of ${\mathbf x}$ needs not to be known a priori, but is determined by the algorithm.…
▽ More
In this paper we extend the deterministic sublinear FFT algorithm in Plonka et al. (2018) for fast reconstruction of $M$-sparse vectors ${\mathbf x}$ of length $N= 2^J$, where we assume that all components of the discrete Fourier transform $\hat{\mathbf x}= {\mathbf F}_{N} {\mathbf x}$ are available. The sparsity of ${\mathbf x}$ needs not to be known a priori, but is determined by the algorithm. If the sparsity $M$ is larger than $2^{J/2}$, then the algorithm turns into a usual FFT algorithm with runtime ${\mathcal O}(N \log N)$. For $M^{2} < N$, the runtime of the algorithm is ${\mathcal O}(M^2 \, \log N)$. The proposed modifications of the approach in Plonka et al. (2018) lead to a significant improvement of the condition numbers of the Vandermonde matrices which are employed in the iterative reconstruction. Our numerical experiments show that our modification has a huge impact on the stability of the algorithm. While the algorithm in Plonka et al. (2018) starts to be unreliable for $M>20$ because of numerical instabilities, the modified algorithm is still numerically stable for $M=200$.
△ Less
Submitted 7 March, 2021; v1 submitted 23 April, 2020;
originally announced April 2020.
-
Modifications of Prony's Method for the Recovery and Sparse Approximation of Generalized Exponential Sums
Authors:
Ingeborg Keller,
Gerlind Plonka
Abstract:
In this survey we describe some modifications of Prony's method. In particular, we consider the recovery of general expansions into eigenfunctions of linear differential operators of first order and show, how these expansions can be recovered from function samples using generalized shift operators. We derive an ESPRIT-like algorithm for the generalized recovery method and show, that this approach…
▽ More
In this survey we describe some modifications of Prony's method. In particular, we consider the recovery of general expansions into eigenfunctions of linear differential operators of first order and show, how these expansions can be recovered from function samples using generalized shift operators. We derive an ESPRIT-like algorithm for the generalized recovery method and show, that this approach can be directly used to reconstruct classical exponential sums from non-equispaced data. Furthermore, we derive a modification of Prony's method for sparse approximation with exponential sums which leads to a non-linear least-squares problem.
△ Less
Submitted 10 January, 2020;
originally announced January 2020.
-
Parseval Proximal Neural Networks
Authors:
Marzieh Hasannasab,
Johannes Hertrich,
Sebastian Neumayer,
Gerlind Plonka,
Simon Setzer,
Gabriele Steidl
Abstract:
The aim of this paper is twofold. First, we show that a certain concatenation of a proximity operator with an affine operator is again a proximity operator on a suitable Hilbert space. Second, we use our findings to establish so-called proximal neural networks (PNNs) and stable tight frame proximal neural networks. Let $\mathcal H$ and $\mathcal K$ be real Hilbert spaces, $b\in\mathcal K$ and…
▽ More
The aim of this paper is twofold. First, we show that a certain concatenation of a proximity operator with an affine operator is again a proximity operator on a suitable Hilbert space. Second, we use our findings to establish so-called proximal neural networks (PNNs) and stable tight frame proximal neural networks. Let $\mathcal H$ and $\mathcal K$ be real Hilbert spaces, $b\in\mathcal K$ and $T\in\mathcal{B}(\mathcal H,\mathcal K)$ have closed range and Moore-Penrose inverse $T^\dagger$. Based on the well-known characterization of proximity operators by Moreau, we prove that for any proximity operator $\text{Prox}\colon\mathcal K\to\mathcal K$ the operator $T^\dagger\,\text{Prox} (T\cdot +b)$ is a proximity operator on $\mathcal H$ equipped with a suitable norm. In particular, it follows for the frequently applied soft shrinkage operator $\text{Prox} = S_λ\colon\ell_2 \rightarrow\ell_2$ and any frame analysis operator $T\colon\mathcal H\to\ell_2$ that the frame shrinkage operator $T^\dagger\, S_λ\,T$ is a proximity operator on a suitable Hilbert space. The concatenation of proximity operators on $\mathbb R^d$ equipped with different norms establishes a PNN. If the network arises from tight frame analysis or synthesis operators, then it forms an averaged operator. Hence, it has Lipschitz constant 1 and belongs to the class of so-called Lipschitz networks, which were recently applied to defend against adversarial attacks. Moreover, due to its averaging property, PNNs can be used within so-called Plug-and-Play algorithms with convergence guarantee. In case of Parseval frames, we call the networks Parseval proximal neural networks (PPNNs). Then, the involved linear operators are in a Stiefel manifold and corresponding minimization methods can be applied for training. Finally, some proof-of-the concept examples demonstrate the performance of PPNNs.
△ Less
Submitted 17 April, 2020; v1 submitted 19 December, 2019;
originally announced December 2019.
-
Frame Soft Shrinkage as Proximity Operator
Authors:
Marzieh Hassanasab,
Sebastian Neumayer,
Gerlind Plonka,
Simon Setzer,
Gabriele Steidl,
Jakob Alexander Geppert
Abstract:
Let $\mathcal H$ and $\mathcal K$ be real Hilbert spaces and $T \in \mathcal{B} (\mathcal H,\mathcal K)$ an injective operator with closed range and Moore-Penrose inverse $T^\dagger$. Based on the well-known characterization of proximity operators by Moreau, we prove that for any proximity operator $\text{Prox} \colon \mathcal K \to \mathcal K$ the operator $T^\dagger \, \text{Prox} \, T$ is a pro…
▽ More
Let $\mathcal H$ and $\mathcal K$ be real Hilbert spaces and $T \in \mathcal{B} (\mathcal H,\mathcal K)$ an injective operator with closed range and Moore-Penrose inverse $T^\dagger$. Based on the well-known characterization of proximity operators by Moreau, we prove that for any proximity operator $\text{Prox} \colon \mathcal K \to \mathcal K$ the operator $T^\dagger \, \text{Prox} \, T$ is a proximity operator on the linear space $\mathcal H$ equipped with a suitable norm. In particular, it follows for the frequently applied soft shrinkage operator $\text{Prox} = S_λ\colon \ell_2 \rightarrow \ell_2$ and any frame analysis operator $T\colon \mathcal H \to \ell_2$, that the frame shrinkage operator $T^\dagger\, S_λ\, T$ is a proximity operator in a suitable Hilbert space.
△ Less
Submitted 16 October, 2019; v1 submitted 7 October, 2019;
originally announced October 2019.
-
Frame Soft Shrinkage Operators are Proximity Operators
Authors:
Jakob Alexander Geppert,
Gerlind Plonka
Abstract:
In this paper, we show that the commonly used frame soft shrinkage operator, that maps a given vector ${\mathbf x} \in {\mathbb R}^{N}$ onto the vector ${\mathbf T}^{\dagger} S_γ {\mathbf T} {\mathbf x}$, is already a proximity operator, which can therefore be directly used in corresponding splitting algorithms. In our setting, the frame transform matrix ${\mathbf T} \in {\mathbb R}^{L \times N}$…
▽ More
In this paper, we show that the commonly used frame soft shrinkage operator, that maps a given vector ${\mathbf x} \in {\mathbb R}^{N}$ onto the vector ${\mathbf T}^{\dagger} S_γ {\mathbf T} {\mathbf x}$, is already a proximity operator, which can therefore be directly used in corresponding splitting algorithms. In our setting, the frame transform matrix ${\mathbf T} \in {\mathbb R}^{L \times N}$ with $L \ge N$ has full rank $N$, ${\mathbf T}^{\dagger}$ denotes the Moore-Penrose inverse of ${\mathbf T}$, and $S_γ$ is the usual soft shrinkage operator with threshold parameter $γ>0$. Our result generalizes the known assertion that ${\mathbf T}^{*} S_γ {\mathbf T}$ is the proximity operator of $\| {\mathbf T} \cdot \|_{1}$ if ${\mathbf T}$ is an orthogonal (square) matrix. It is well-known that for rectangular frame matrices ${\mathbf T}$ with $L > N$, the proximity operator of $\| {\mathbf T} \cdot \|_{1}$ does not have a closed representation and needs to be computed iteratively. We show that the frame soft shrinkage operator {${\mathbf T}^{\dagger} S_γ {\mathbf T}$} is a proximity operator as well, thereby motivating its application as a replacement of the exact proximity operator of $\| {\mathbf T} \cdot \|_{1}$. We further give an explanation, why the usage of the frame soft shrinkage operator still provides good results in various applications.
In particular, we provide some properties of the subdifferential of the convex functional $Φ$ which leads to the proximity operator ${\mathbf T}^{\dagger} S_γ {\mathbf T}$ and show that ${\mathbf T}^{\dagger} S_γ {\mathbf T}$ approximates $\textrm{prox}_{\|{\mathbf T} \cdot\|_{1}}$.
△ Less
Submitted 19 April, 2021; v1 submitted 4 October, 2019;
originally announced October 2019.
-
The Generalized Operator Based Prony Method
Authors:
Kilian Stampfer,
Gerlind Plonka
Abstract:
The generalized Prony method introduced by Peter & Plonka (2013) is a reconstruction technique for a large variety of sparse signal models that can be represented as sparse expansions into eigenfunctions of a linear operator $A$. However, this procedure requires the evaluation of higher powers of the linear operator $A$ that are often expensive to provide.
In this paper we propose two important…
▽ More
The generalized Prony method introduced by Peter & Plonka (2013) is a reconstruction technique for a large variety of sparse signal models that can be represented as sparse expansions into eigenfunctions of a linear operator $A$. However, this procedure requires the evaluation of higher powers of the linear operator $A$ that are often expensive to provide.
In this paper we propose two important extensions of the generalized Prony method that simplify the acquisition of the needed samples essentially and at the same time can improve the numerical stability of the method. The first extension regards the change of operators from $A$ to $\varphi(A)$, where $\varphi$ is an analytic function, while $A$ and $\varphi(A)$ possess the same set of eigenfunctions. The goal is now to choose $\varphi$ such that the powers of $\varphi(A)$ are much simpler to evaluate than the powers of $A$. The second extension concerns the choice of the sampling functionals. We show, how new sets of different sampling functionals $F_{k}$ can be applied with the goal to reduce the needed number of powers of the operator $A$ (resp. $\varphi(A)$) in the sampling scheme and to simplify the acquisition process for the recovery method.
△ Less
Submitted 18 February, 2020; v1 submitted 25 January, 2019;
originally announced January 2019.
-
Real Sparse Fast DCT for Vectors with Short Support
Authors:
Sina Bittens,
Gerlind Plonka
Abstract:
In this paper we present a new fast and deterministic algorithm for the inverse discrete cosine transform of type II for reconstructing the input vector $\mathbf x\in\mathbb R^N$, $N=2^J$, with short support of length $m$ from its discrete cosine transform $\mathbf x^{\widehat{\mathrm{II}}}=C^{\mathrm{II}}_N\mathbf x$ if an upper bound $M\geq m$ is known. The resulting algorithm only uses real ari…
▽ More
In this paper we present a new fast and deterministic algorithm for the inverse discrete cosine transform of type II for reconstructing the input vector $\mathbf x\in\mathbb R^N$, $N=2^J$, with short support of length $m$ from its discrete cosine transform $\mathbf x^{\widehat{\mathrm{II}}}=C^{\mathrm{II}}_N\mathbf x$ if an upper bound $M\geq m$ is known. The resulting algorithm only uses real arithmetic, has a runtime of $\mathcal{O}\left(M\log M+m\log_2\frac{N}{M}\right)$ and requires $\mathcal{O}\left(M+m\log_2\frac{N}{M}\right)$ samples of $\mathbf x^{\widehat{\mathrm{II}}}$. For $m,M\rightarrow N$ the runtime and sampling requirements approach those of a regular IDCT-II for vectors with full support. The algorithm presented hereafter does not employ inverse FFT algorithms to recover $\mathbf x$.
△ Less
Submitted 21 July, 2018; v1 submitted 19 July, 2018;
originally announced July 2018.
-
Sparse Fast DCT for Vectors with One-block Support
Authors:
Sina Bittens,
Gerlind Plonka
Abstract:
In this paper we present a new fast and deterministic algorithm for the inverse discrete cosine transform of type II that reconstructs the input vector $\mathbf{x}\in\mathbb{R}^{N}$, $N=2^{J-1}$, with short support of length $m$ from its discrete cosine transform $\mathbf{x}^{\widehat{\mathrm{II}}}=\mathbf{C}_N^{\mathrm{II}}\mathbf{x}$.
The resulting algorithm has a runtime of…
▽ More
In this paper we present a new fast and deterministic algorithm for the inverse discrete cosine transform of type II that reconstructs the input vector $\mathbf{x}\in\mathbb{R}^{N}$, $N=2^{J-1}$, with short support of length $m$ from its discrete cosine transform $\mathbf{x}^{\widehat{\mathrm{II}}}=\mathbf{C}_N^{\mathrm{II}}\mathbf{x}$.
The resulting algorithm has a runtime of $\mathcal{O}\left(m\log m\log \frac{2N}{m}\right)$ and requires $\mathcal{O}\left(m\log \frac{2N}{m}\right)$ samples of $\mathbf{x}^{\widehat{\mathrm{II}}}$.
In order to derive this algorithm we also develop a new fast and deterministic inverse FFT algorithm that constructs the input vector $\mathbf{y}\in\mathbb{R}^{2N}$ with reflected block support of block length $m$ from $\widehat{\mathbf{y}}$ with the same runtime and sampling complexities as our DCT algorithm.
△ Less
Submitted 14 March, 2018;
originally announced March 2018.
-
Sparse phase retrieval of one-dimensional signals by Prony's method
Authors:
Robert Beinert,
Gerlind Plonka
Abstract:
In this paper, we show that sparse signals f representable as a linear combination of a finite number N of spikes at arbitrary real locations or as a finite linear combination of B-splines of order m with arbitrary real knots can be almost surely recovered from O(N^2) Fourier intensity measurements up to trivial ambiguities. The constructive proof consists of two steps, where in the first step the…
▽ More
In this paper, we show that sparse signals f representable as a linear combination of a finite number N of spikes at arbitrary real locations or as a finite linear combination of B-splines of order m with arbitrary real knots can be almost surely recovered from O(N^2) Fourier intensity measurements up to trivial ambiguities. The constructive proof consists of two steps, where in the first step the Prony method is applied to recover all parameters of the autocorrelation function and in the second step the parameters of f are derived. Moreover, we present an algorithm to evaluate f from its Fourier intensities and illustrate it at different numerical examples.
△ Less
Submitted 31 January, 2017;
originally announced January 2017.
-
Application of the AAK theory for sparse approximation of exponential sums
Authors:
Gerlind Plonka,
Vlada Pototskaia
Abstract:
In this paper, we derive a new method for optimal $\ell^{1}$- and $\ell^2$-approximation of discrete signals on ${\mathbb N}_{0}$ whose entries can be represented as an exponential sum of finite length. Our approach employs Prony's method in a first step to recover the exponential sum that is determined by the signal. In the second step we use the AAK-theory to derive an algorithm for computing a…
▽ More
In this paper, we derive a new method for optimal $\ell^{1}$- and $\ell^2$-approximation of discrete signals on ${\mathbb N}_{0}$ whose entries can be represented as an exponential sum of finite length. Our approach employs Prony's method in a first step to recover the exponential sum that is determined by the signal. In the second step we use the AAK-theory to derive an algorithm for computing a shorter exponential sum that approximates the original signal in the $\ell^{p}$-norm well. AAK-theory originally determines best approximations of bounded periodic functions in Hardy-subspaces. We rewrite these ideas for our purposes and give a proof of the used AAK theorem based only on basic tools from linear algebra and Fourier analysis. The new algorithm is tested numerically in different examples.
△ Less
Submitted 30 September, 2016;
originally announced September 2016.
-
Enforcing uniqueness in one-dimensional phase retrieval by additional signal information in time domain
Authors:
Robert Beinert,
Gerlind Plonka
Abstract:
Considering the ambiguousness of the discrete-time phase retrieval problem to recover a signal from its Fourier intensities, one can ask the question: what additional information about the unknown signal do we need to select the correct solution within the large solution set? Based on a characterization of the occurring ambiguities, we investigate different a priori conditions in order to reduce t…
▽ More
Considering the ambiguousness of the discrete-time phase retrieval problem to recover a signal from its Fourier intensities, one can ask the question: what additional information about the unknown signal do we need to select the correct solution within the large solution set? Based on a characterization of the occurring ambiguities, we investigate different a priori conditions in order to reduce the number of ambiguities or even to receive a unique solution. Particularly, if we have access to additional magnitudes of the unknown signal in the time domain, we can show that almost all signals with finite support can be uniquely recovered. Moreover, we prove that an analogous result can be obtained by exploiting additional phase information.
△ Less
Submitted 15 April, 2016;
originally announced April 2016.
-
A sparse Fast Fourier Algorithm for Real Nonnegative Vectors
Authors:
Gerlind Plonka,
Katrin Wannenwetsch
Abstract:
In this paper we propose a new fast Fourier transform to recover a real nonnegative signal ${\bf x}$ from its discrete Fourier transform. If the signal ${\mathbf x}$ appears to have a short support, i.e., vanishes outside a support interval of length $m < N$, then the algorithm has an arithmetical complexity of only ${\cal O}(m \log m \log (N/m)) $ and requires ${\cal O}(m \log (N/m))$ Fourier sam…
▽ More
In this paper we propose a new fast Fourier transform to recover a real nonnegative signal ${\bf x}$ from its discrete Fourier transform. If the signal ${\mathbf x}$ appears to have a short support, i.e., vanishes outside a support interval of length $m < N$, then the algorithm has an arithmetical complexity of only ${\cal O}(m \log m \log (N/m)) $ and requires ${\cal O}(m \log (N/m))$ Fourier samples for this computation. In contrast to other approaches there is no a priori knowledge needed about sparsity or support bounds for the vector ${\bf x}$. The algorithm automatically recognizes and exploits a possible short support of the vector and falls back to a usual radix-2 FFT algorithm if ${\bf x}$ has (almost) full support. The numerical stability of the proposed algorithm ist shown by numerical examples.
△ Less
Submitted 18 February, 2020; v1 submitted 17 February, 2016;
originally announced February 2016.
-
Pseudo-inverses of difference matrices and their application to sparse signal approximation
Authors:
Gerlind Plonka,
Sebastian Hoffmann,
Joachim Weickert
Abstract:
We derive new explicit expressions for the components of Moore-Penrose inverses of symmetric difference matrices. These generalized inverses are applied in a new regularization approach for scattered data interpolation based on partial differential equations. The columns of the Moore-Penrose inverse then serve as elements of a dictionary that allow a sparse signal approximation. In order to find a…
▽ More
We derive new explicit expressions for the components of Moore-Penrose inverses of symmetric difference matrices. These generalized inverses are applied in a new regularization approach for scattered data interpolation based on partial differential equations. The columns of the Moore-Penrose inverse then serve as elements of a dictionary that allow a sparse signal approximation. In order to find a set of suitable data points for signal representation we apply the orthogonal patching pursuit (OMP) method.
△ Less
Submitted 16 April, 2015;
originally announced April 2015.
-
A deterministic sparse FFT algorithm for vectors with small support
Authors:
Gerlind Plonka,
Katrin Wannenwetsch
Abstract:
In this paper we consider the special case where a discrete signal ${\bf x}$ of length N is known to vanish outside a support interval of length $m < N$. If the support length $m$ of ${\bf x}$ or a good bound of it is a-priori known we derive a sublinear deterministic algorithm to compute ${\bf x}$ from its discrete Fourier transform. In case of exact Fourier measurements we require only…
▽ More
In this paper we consider the special case where a discrete signal ${\bf x}$ of length N is known to vanish outside a support interval of length $m < N$. If the support length $m$ of ${\bf x}$ or a good bound of it is a-priori known we derive a sublinear deterministic algorithm to compute ${\bf x}$ from its discrete Fourier transform. In case of exact Fourier measurements we require only ${\cal O}(m \log m)$ arithmetical operations. For noisy measurements, we propose a stable ${\cal O}(m \log N)$ algorithm.
△ Less
Submitted 9 April, 2015;
originally announced April 2015.
