-
Phasebook: A Survey of Selected Open Problems in Phase Retrieval
Authors:
Marc Allain,
Selin Aslan,
Wim Coene,
Sjoerd Dirksen,
Jonathan Dong,
Julien Flamant,
Mark Iwen,
Felix Krahmer,
Tristan van Leeuwen,
Oleh Melnyk,
Andreas Menzel,
Allard P. Mosk,
Viktor Nikitin,
Gerlind Plonka,
Palina Salanevich,
Matthias Wellershoff
Abstract:
Phase retrieval is an inverse problem that, on one hand, is crucial in many applications across imaging and physics, and, on the other hand, leads to deep research questions in theoretical signal processing and applied harmonic analysis. This survey paper is an outcome of the recent workshop Phase Retrieval in Mathematics and Applications (PRiMA) (held on August 5--9 2024 at the Lorentz Center in…
▽ More
Phase retrieval is an inverse problem that, on one hand, is crucial in many applications across imaging and physics, and, on the other hand, leads to deep research questions in theoretical signal processing and applied harmonic analysis. This survey paper is an outcome of the recent workshop Phase Retrieval in Mathematics and Applications (PRiMA) (held on August 5--9 2024 at the Lorentz Center in Leiden, The Netherlands) that brought together experts working on theoretical and practical aspects of the phase retrieval problem with the purpose to formulate and explore essential open problems in the field.
△ Less
Submitted 21 May, 2025;
originally announced May 2025.
-
Time-Harmonic Optical Flow with Applications in Elastography
Authors:
Oleh Melnyk,
Michael Quellmalz,
Gabriele Steidl,
Noah Jaitner,
Jakob Jordan,
Ingolf Sack
Abstract:
In this paper, we propose mathematical models for reconstructing the optical flow in time-harmonic elastography. In this image acquisition technique, the object undergoes a special time-harmonic oscillation with known frequency so that only the spatially varying amplitude of the velocity field has to be determined. This allows for a simpler multi-frame optical flow analysis using Fourier analytic…
▽ More
In this paper, we propose mathematical models for reconstructing the optical flow in time-harmonic elastography. In this image acquisition technique, the object undergoes a special time-harmonic oscillation with known frequency so that only the spatially varying amplitude of the velocity field has to be determined. This allows for a simpler multi-frame optical flow analysis using Fourier analytic tools in time. We propose three variational optical flow models and show how their minimization can be tackled via Fourier transform in time. Numerical examples with synthetic as well as real-world data demonstrate the benefits of our approach.
Keywords: optical flow, elastography, Fourier transform, iteratively reweighted least squares, Horn--Schunck method
△ Less
Submitted 24 May, 2024;
originally announced May 2024.
-
Sparse additive function decompositions facing basis transforms
Authors:
Fatima Antarou Ba,
Oleh Melnyk,
Christian Wald,
Gabriele Steidl
Abstract:
High-dimensional real-world systems can often be well characterized by a small number of simultaneous low-complexity interactions. The analysis of variance (ANOVA) decomposition and the anchored decomposition are typical techniques to find sparse additive decompositions of functions. In this paper, we are interested in a setting, where these decompositions are not directly spare, but become so aft…
▽ More
High-dimensional real-world systems can often be well characterized by a small number of simultaneous low-complexity interactions. The analysis of variance (ANOVA) decomposition and the anchored decomposition are typical techniques to find sparse additive decompositions of functions. In this paper, we are interested in a setting, where these decompositions are not directly spare, but become so after an appropriate basis transform. Noting that the sparsity of those additive function decompositions is equivalent to the fact that most of its mixed partial derivatives vanish, we can exploit a connection to the underlying function graphs to determine an orthogonal transform that realizes the appropriate basis change. This is done in three steps: we apply singular value decomposition to minimize the number of vertices of the function graph, and joint block diagonalization techniques of families of matrices followed by sparse minimization based on relaxations of the zero ''norm'' for minimizing the number of edges. For the latter one, we propose and analyze minimization techniques over the manifold of special orthogonal matrices. Various numerical examples illustrate the reliability of our approach for functions having, after a basis transform, a sparse additive decomposition into summands with at most two variables.
△ Less
Submitted 28 March, 2024; v1 submitted 22 March, 2024;
originally announced March 2024.
-
Background Denoising for Ptychography via Wigner Distribution Deconvolution
Authors:
Oleh Melnyk,
Patricia Römer
Abstract:
Ptychography is a computational imaging technique that aims to reconstruct the object of interest from a set of diffraction patterns. Each of these is obtained by a localized illumination of the object, which is shifted after each illumination to cover its whole domain. As in the resulting measurements the phase information is lost, ptychography gives rise to solving a phase retrieval problem. In…
▽ More
Ptychography is a computational imaging technique that aims to reconstruct the object of interest from a set of diffraction patterns. Each of these is obtained by a localized illumination of the object, which is shifted after each illumination to cover its whole domain. As in the resulting measurements the phase information is lost, ptychography gives rise to solving a phase retrieval problem. In this work, we consider ptychographic measurements corrupted with background noise, a type of additive noise that is independent of the shift, i.e., it is the same for all diffraction patterns. Two algorithms are provided, for arbitrary objects and for so-called phase objects that do not absorb the light but only scatter it. For the second type, a uniqueness of reconstruction is established for almost every object. Our approach is based on the Wigner Distribution Deconvolution, which lifts the object to a higher-dimensional matrix space where the recovery can be reformulated as a linear problem. Background noise only affects a few equations of the linear system that are therefore discarded. The lost information is then restored using redundancy in the higher-dimensional space.
Keywords: phase retrieval, ptychography, background noise, Wigner Distribution Deconvolution, uniqueness of reconstruction.
△ Less
Submitted 23 February, 2024;
originally announced February 2024.
-
Convergence properties of gradient methods for blind ptychography
Authors:
Oleh Melnyk
Abstract:
We consider blind ptychography, an imaging technique which aims to reconstruct an object of interest from a set of its diffraction patterns, each obtained by a local illumination. As the distribution of the light within the illuminated region, called the window, is unknown, it also has to be estimated as well. For the recovery, we consider gradient and stochastic gradient descent methods for the m…
▽ More
We consider blind ptychography, an imaging technique which aims to reconstruct an object of interest from a set of its diffraction patterns, each obtained by a local illumination. As the distribution of the light within the illuminated region, called the window, is unknown, it also has to be estimated as well. For the recovery, we consider gradient and stochastic gradient descent methods for the minimization of amplitude-base squared loss. In particular, this includes extended Ptychographic Iterative Engine as a special case of stochastic gradient descent. We show that all methods converge to a critical point at a sublinear rate with a proper choice of step sizes. We also discuss possibilities for larger step sizes.
△ Less
Submitted 14 June, 2023;
originally announced June 2023.
-
Stochastic Amplitude Flow for phase retrieval, its convergence and doppelgängers
Authors:
Oleh Melnyk
Abstract:
In this paper, we focus on Stochastic Amplitude Flow (SAF) for phase retrieval, a stochastic gradient descent for the amplitude-based squared loss. While the convergence to a critical point of (nonstochastic) Amplitude Flow is well-understood, SAF is a much less studied algorithm. We close this gap by deriving the convergence guarantees for SAF based on the contributions for Amplitude Flow and ana…
▽ More
In this paper, we focus on Stochastic Amplitude Flow (SAF) for phase retrieval, a stochastic gradient descent for the amplitude-based squared loss. While the convergence to a critical point of (nonstochastic) Amplitude Flow is well-understood, SAF is a much less studied algorithm. We close this gap by deriving the convergence guarantees for SAF based on the contributions for Amplitude Flow and analysis for stochastic gradient descent. These results are then applied to two more algorithms, which can be seen as instances of SAF. The first is an extension of the Kaczmarz method for phase retrieval. The second is Ptychographic Iterative Engine, which is a popular algorithm for ptychography, a special case of phase retrieval with the short-time Fourier transform.
Keywords: phase retrieval, Amplitude Flow, stochastic gradient descent, ptychography, Ptychographic Iterative Engine, Kaczmarz method.
△ Less
Submitted 9 December, 2022;
originally announced December 2022.
-
Image Recovery for Blind Polychromatic Ptychography
Authors:
Frank Filbir,
Oleh Melnyk
Abstract:
Ptychography is a lensless imaging technique, which considers reconstruction from a set of far-field diffraction patterns obtained by illuminating small overlapping regions of the specimen. In many cases, a distribution of light inside the illuminated region is unknown and has to be estimated along with the object of interest. This problem is referred to as blind ptychography. While in ptychograph…
▽ More
Ptychography is a lensless imaging technique, which considers reconstruction from a set of far-field diffraction patterns obtained by illuminating small overlapping regions of the specimen. In many cases, a distribution of light inside the illuminated region is unknown and has to be estimated along with the object of interest. This problem is referred to as blind ptychography. While in ptychography the illumination is commonly assumed to have a point spectrum, in this paper we consider an alternative scenario with non-trivial light spectrum known as blind polychromatic ptychography.
Firstly, we show that non-blind polychromatic ptychography can be seen as a recovery from quadratic measurements. Then, a reconstruction from such measurements can be performed by a variant of Amplitude Flow algorithm, which has guaranteed sublinear convergence to a critical point. Secondly, we address recovery from blind polychromatic ptychographic measurements by devising an alternating minimization version of Amplitude Flow and showing that it converges to a critical point at a sublinear rate.
Keywords: ptychography, phase retrieval, blind, alternating minimization, gradient descent.
△ Less
Submitted 4 October, 2022;
originally announced October 2022.
-
Transplanting Trees: Chromatic Symmetric Function Results through the Group Algebra of $S_n$
Authors:
Angèle M. Foley,
Joshua Kazdan,
Larissa Kröll,
Sofía Martínez Alberga,
Oleksii Melnyk,
Alexander Tenenbaum
Abstract:
One of the major outstanding conjectures in the study of chromatic symmetric functions (CSF's) states that trees are uniquely determined by their CSF's. Though verified on graphs of order up to twenty-nine, this result has been proved only for certain subclasses of trees. Using the definition of the CSF that emerges via the Frobenius character map applied to $\mathbb{C}[S_n]$, we offer new algebra…
▽ More
One of the major outstanding conjectures in the study of chromatic symmetric functions (CSF's) states that trees are uniquely determined by their CSF's. Though verified on graphs of order up to twenty-nine, this result has been proved only for certain subclasses of trees. Using the definition of the CSF that emerges via the Frobenius character map applied to $\mathbb{C}[S_n]$, we offer new algebraic proofs of several results about the CSF's of trees. Additionally, we prove that a "parent function" of the CSF defined in the group ring of $S_n$ can uniquely determine trees, providing further support for Stanley's conjecture.
△ Less
Submitted 20 January, 2022; v1 submitted 18 December, 2021;
originally announced December 2021.
-
On recovery guarantees for angular synchronization
Authors:
Frank Filbir,
Felix Krahmer,
Oleh Melnyk
Abstract:
The angular synchronization problem of estimating a set of unknown angles from their known noisy pairwise differences arises in various applications. It can be reformulated as a optimization problem on graphs involving the graph Laplacian matrix. We consider a general, weighted version of this problem, where the impact of the noise differs between different pairs of entries and some of the differe…
▽ More
The angular synchronization problem of estimating a set of unknown angles from their known noisy pairwise differences arises in various applications. It can be reformulated as a optimization problem on graphs involving the graph Laplacian matrix. We consider a general, weighted version of this problem, where the impact of the noise differs between different pairs of entries and some of the differences are erased completely; this version arises for example in ptychography. We study two common approaches for solving this problem, namely eigenvector relaxation and semidefinite convex relaxation. Although some recovery guarantees are available for both methods, their performance is either unsatisfying or restricted to the unweighted graphs. We close this gap, deriving recovery guarantees for the weighted problem that are completely analogous to the unweighted version.
△ Less
Submitted 8 September, 2022; v1 submitted 5 May, 2020;
originally announced May 2020.
-
Well conditioned ptychograpic imaging via lost subspace completion
Authors:
Anton Forstner,
Felix Krahmer,
Oleh Melnyk,
Nada Sissouno
Abstract:
Ptychography, a special case of the phase retrieval problem, is a popular method in modern imaging. Its measurements are based on the shifts of a locally supported window function. In general, direct recovery of an object from such measurements is known to be an ill-posed problem. Although for some windows the conditioning can be controlled, for a number of important cases it is not possible, for…
▽ More
Ptychography, a special case of the phase retrieval problem, is a popular method in modern imaging. Its measurements are based on the shifts of a locally supported window function. In general, direct recovery of an object from such measurements is known to be an ill-posed problem. Although for some windows the conditioning can be controlled, for a number of important cases it is not possible, for instance for Gaussian windows. In this paper we develop a subspace completion algorithm, which enables stable reconstruction for a much wider choice of windows, including Gaussian windows. The combination with a regularization technique leads to improved conditioning and better noise robustness.
△ Less
Submitted 9 April, 2020;
originally announced April 2020.
-
Spiders and their Kin: An Investigation of Stanley's Chromatic Symmetric Function for Spiders and Related Graphs
Authors:
Angèle M. Foley,
Joshua Kazdan,
Larissa Kröll,
Sofía Martínez Alberga,
Oleksii Melnyk,
Alexander Tenenbaum
Abstract:
We study the chromatic symmetric functions of graph classes related to spiders, namely generalized spider graphs (line graphs of spiders), and what we call horseshoe crab graphs. We show that no two generalized spiders have the same chromatic symmetric function, thereby extending the work of Martin, Morin and Wagner. Additionally, we establish that a subclass of generalized spiders, which we call…
▽ More
We study the chromatic symmetric functions of graph classes related to spiders, namely generalized spider graphs (line graphs of spiders), and what we call horseshoe crab graphs. We show that no two generalized spiders have the same chromatic symmetric function, thereby extending the work of Martin, Morin and Wagner. Additionally, we establish that a subclass of generalized spiders, which we call generalized nets, has no e-positive members, providing a more general counterexample to the necessity of the claw-free condition. We use yet another class of generalized spiders to construct a counterexample to a problem involving the $e$-positivity of claw-free, P4-sparse graphs, showing that Tsujie's result on the e-positivity of claw-free, P4-free graphs cannot be extended to graphs in this set. Finally, we investigate the e-positivity of another type of graphs, the horseshoe crab graphs (a class of unit interval graphs), and prove the positivity of all but one of the coefficients. This has close connections to the work of Gebhard and Sagan and Cho and Huh.
△ Less
Submitted 28 June, 2022; v1 submitted 9 December, 2018;
originally announced December 2018.