-
Denoising Multi-Color QR Codes and Stiefel-Valued Data by Relaxed Regularizations
Authors:
Robert Beinert,
Jonas Bresch
Abstract:
The handling of manifold-valued data, for instance, plays a central role in color restoration tasks relying on circle- or sphere-valued color models, in the study of rotational or directional information related to the special orthogonal group, and in Gaussian image processing, where the pixel statistics are interpreted as values on the hyperbolic sheet. Especially, to denoise these kind of data,…
▽ More
The handling of manifold-valued data, for instance, plays a central role in color restoration tasks relying on circle- or sphere-valued color models, in the study of rotational or directional information related to the special orthogonal group, and in Gaussian image processing, where the pixel statistics are interpreted as values on the hyperbolic sheet. Especially, to denoise these kind of data, there have been proposed several generalizations of total variation (TV) and Tikhonov-type denoising models incorporating the underlying manifolds. Recently, a novel, numerically efficient denoising approach has been introduced, where the data are embedded in an Euclidean ambient space, the non-convex manifolds are encoded by a series of positive semi-definite, fixed-rank matrices, and the rank constraint is relaxed to obtain a convexification that can be solved using standard algorithms from convex analysis. The aim of the present paper is to extent this approach to new kinds of data like multi-binary and Stiefel-valued data. Multi-binary data can, for instance, be used to model multi-color QR codes whereas Stiefel-valued data occur in image and video-based recognition. For both new data types, we propose TV- and Tikhonov-based denoising modelstogether with easy-to-solve convexification. All derived methods are evaluated on proof-of-concept, synthetic experiments.
△ Less
Submitted 28 June, 2025;
originally announced June 2025.
-
Normalized Radon Cumulative Distribution Transforms for Invariance and Robustness in Optimal Transport Based Image Classification
Authors:
Matthias Beckmann,
Robert Beinert,
Jonas Bresch
Abstract:
The Radon cumulative distribution transform (R-CDT), is an easy-to-compute feature extractor that facilitates image classification tasks especially in the small data regime. It is closely related to the sliced Wasserstein distance and provably guaranties the linear separability of image classes that emerge from translations or scalings. In many real-world applications, like the recognition of wate…
▽ More
The Radon cumulative distribution transform (R-CDT), is an easy-to-compute feature extractor that facilitates image classification tasks especially in the small data regime. It is closely related to the sliced Wasserstein distance and provably guaranties the linear separability of image classes that emerge from translations or scalings. In many real-world applications, like the recognition of watermarks in filigranology, however, the data is subject to general affine transformations originating from the measurement process. To overcome this issue, we recently introduced the so-called max-normalized R-CDT that only requires elementary operations and guaranties the separability under arbitrary affine transformations. The aim of this paper is to continue our study of the max-normalized R-CDT especially with respect to its robustness against non-affine image deformations. Our sensitivity analysis shows that its separability properties are stable provided the Wasserstein-infinity distance between the samples can be controlled. Since the Wasserstein-infinity distance only allows small local image deformations, we moreover introduce a mean-normalized version of the R-CDT. In this case, robustness relates to the Wasserstein-2 distance and also covers image deformations caused by impulsive noise for instance. Our theoretical results are supported by numerical experiments showing the effectiveness of our novel feature extractors as well as their robustness against local non-affine deformations and impulsive noise.
△ Less
Submitted 10 June, 2025;
originally announced June 2025.
-
Computing adjoint mismatch of linear maps
Authors:
Jonas Bresch,
Dirk A. Lorenz,
Felix Schneppe,
Maximilian Winkler
Abstract:
This paper considers the problem of detecting adjoint mismatch for two linear maps. To clarify, this means that we aim to calculate the operator norm for the difference of two linear maps, where for one we only have a black-box implementation for the evaluation of the map, and for the other we only have a black-box for the evaluation of the adjoint map. We give two stochastic algorithms for which…
▽ More
This paper considers the problem of detecting adjoint mismatch for two linear maps. To clarify, this means that we aim to calculate the operator norm for the difference of two linear maps, where for one we only have a black-box implementation for the evaluation of the map, and for the other we only have a black-box for the evaluation of the adjoint map. We give two stochastic algorithms for which we prove the almost sure convergence to the operator norm. The algorithm is a random search method for a generalization of the Rayleigh quotient and uses optimal step sizes. Additionally, a convergence analysis is done for the corresponding singular vector and the respective eigenvalue equation.
△ Less
Submitted 27 March, 2025;
originally announced March 2025.
-
Max-Normalized Radon Cumulative Distribution Transform for Limited Data Classification
Authors:
Matthias Beckmann,
Robert Beinert,
Jonas Bresch
Abstract:
The Radon cumulative distribution transform (R-CDT) exploits one-dimensional Wasserstein transport and the Radon transform to represent prominent features in images. It is closely related to the sliced Wasserstein distance and facilitates classification tasks, especially in the small data regime, like the recognition of watermarks in filigranology. Here, a typical issue is that the given data may…
▽ More
The Radon cumulative distribution transform (R-CDT) exploits one-dimensional Wasserstein transport and the Radon transform to represent prominent features in images. It is closely related to the sliced Wasserstein distance and facilitates classification tasks, especially in the small data regime, like the recognition of watermarks in filigranology. Here, a typical issue is that the given data may be subject to affine transformations caused by the measuring process. The aim of this paper is to make the R-CDT and the related sliced Wasserstein distance invariant under affine transformations. For this, we propose a two-step normalization of the R-CDT and prove that our novel transform allows linear separation of affinely transformed image classes. The theoretical results are supported by numerical experiments showing a significant increase of the classification accuracy compared to the original R-CDT.
△ Less
Submitted 25 November, 2024;
originally announced November 2024.
-
Denoising Hyperbolic-Valued Data by Relaxed Regularizations
Authors:
Robert Beinert,
Jonas Bresch
Abstract:
We introduce a novel relaxation strategy for denoising hyperbolic-valued data. The main challenge is here the non-convexity of the hyperbolic sheet. Instead of considering the denoising problem directly on the hyperbolic space, we exploit the Euclidean embedding and encode the hyperbolic sheet using a novel matrix representation. For denoising, we employ the Euclidean Tikhonov and total variation…
▽ More
We introduce a novel relaxation strategy for denoising hyperbolic-valued data. The main challenge is here the non-convexity of the hyperbolic sheet. Instead of considering the denoising problem directly on the hyperbolic space, we exploit the Euclidean embedding and encode the hyperbolic sheet using a novel matrix representation. For denoising, we employ the Euclidean Tikhonov and total variation (TV) model, where we incorporate our matrix representation. The major contribution is then a convex relaxation of the variational ansätze allowing the utilization of well-established convex optimization procedures like the alternating directions method of multipliers (ADMM). The resulting denoisers are applied to a real-world Gaussian image processing task, where we simultaneously restore the pixelwise mean and standard deviation of a retina scan series.
△ Less
Submitted 21 October, 2024;
originally announced October 2024.
-
Matrix-free stochastic calculation of operator norms without using adjoints
Authors:
Jonas Bresch,
Dirk A. Lorenz,
Felix Schneppe,
Maximilian Winkler
Abstract:
This paper considers the problem of computing the operator norm of a linear map between finite dimensional Hilbert spaces when only evaluations of the linear map are available and under restrictive storage assumptions. We propose a stochastic method of random search type to maximize the Rayleigh quotient and employ an exact line search in the random search directions. Moreover, we show that the pr…
▽ More
This paper considers the problem of computing the operator norm of a linear map between finite dimensional Hilbert spaces when only evaluations of the linear map are available and under restrictive storage assumptions. We propose a stochastic method of random search type to maximize the Rayleigh quotient and employ an exact line search in the random search directions. Moreover, we show that the proposed algorithm converges to the global maximum (the operator norm) almost surely, show a sublinear convergence behavior for the corresponding eigenvector and eigenvalue equation, and illustrate the performance of the method with numerical experiments.
△ Less
Submitted 26 June, 2025; v1 submitted 10 October, 2024;
originally announced October 2024.
-
Interpolating between Optimal Transport and KL regularized Optimal Transport using Rényi Divergences
Authors:
Jonas Bresch,
Viktor Stein
Abstract:
Regularized optimal transport (OT) has received much attention in recent years starting from Cuturi's introduction of Kullback-Leibler (KL) divergence regularized OT. In this paper, we propose regularizing the OT problem using the family of $α$-Rényi divergences for $α\in (0, 1)$. Rényi divergences are neither $f$-divergences nor Bregman distances, but they recover the KL divergence in the limit…
▽ More
Regularized optimal transport (OT) has received much attention in recent years starting from Cuturi's introduction of Kullback-Leibler (KL) divergence regularized OT. In this paper, we propose regularizing the OT problem using the family of $α$-Rényi divergences for $α\in (0, 1)$. Rényi divergences are neither $f$-divergences nor Bregman distances, but they recover the KL divergence in the limit $α\nearrow 1$. The advantage of introducing the additional parameter $α$ is that for $α\searrow 0$ we obtain convergence to the unregularized OT problem. For the KL regularized OT problem, this was achieved by letting the regularization parameter $\varepsilon$ tend to zero, which causes numerical instabilities. We present two different ways to obtain premetrics on probability measures, namely by Rényi divergence constraints and by penalization. The latter premetric interpolates between the unregularized and the KL regularized OT problem with weak convergence of the unique minimizer, generalizing the interpolation property of KL regularized OT. We use a nested mirror descent algorithm to solve the primal formulation. Both on real and synthetic data sets Rényi regularized OT plans outperform their KL and Tsallis counterparts in terms of being closer to the unregularized transport plans and recovering the ground truth in inference tasks better.
△ Less
Submitted 24 June, 2025; v1 submitted 29 April, 2024;
originally announced April 2024.
-
Denoising Sphere-Valued Data by Relaxed Total Variation Regularization
Authors:
Robert Beinert,
Jonas Bresch
Abstract:
Circle- and sphere-valued data play a significant role in inverse problems like magnetic resonance phase imaging and radar interferometry, in the analysis of directional information, and in color restoration tasks. In this paper, we aim to restore $(d-1)$-sphere-valued signals exploiting the classical anisotropic total variation on the surrounding $d$-dimensional Euclidean space. For this, we prop…
▽ More
Circle- and sphere-valued data play a significant role in inverse problems like magnetic resonance phase imaging and radar interferometry, in the analysis of directional information, and in color restoration tasks. In this paper, we aim to restore $(d-1)$-sphere-valued signals exploiting the classical anisotropic total variation on the surrounding $d$-dimensional Euclidean space. For this, we propose a novel variational formulation, whose data fidelity is based on inner products instead of the usually employed squared norms. Convexifying the resulting non-convex problem and using ADMM, we derive an efficient and fast numerical denoiser. In the special case of binary (0-sphere-valued) signals, the relaxation is provable tight, i.e. the relaxed solution can be used to construct a solution of the original non-convex problem. Moreover, the tightness can be numerically observed for barcode and QR code denoising as well as in higher dimensional experiments like the color restoration using hue and chromaticity and the recovery of SO(3)-valued signals.
△ Less
Submitted 19 April, 2024;
originally announced April 2024.
-
Denoising of Sphere- and SO(3)-Valued Data by Relaxed Tikhonov Regularization
Authors:
Robert Beinert,
Jonas Bresch,
Gabriele Steidl
Abstract:
Manifold-valued signal- and image processing has received attention due to modern image acquisition techniques. Recently, a convex relaxation of the otherwise nonconvex Tikhonov-regularization for denoising circle-valued data has been proposed by Condat (2022). The circle constraints are here encoded in a series of low-dimensional, positive semi-definite matrices. Using Schur complement arguments,…
▽ More
Manifold-valued signal- and image processing has received attention due to modern image acquisition techniques. Recently, a convex relaxation of the otherwise nonconvex Tikhonov-regularization for denoising circle-valued data has been proposed by Condat (2022). The circle constraints are here encoded in a series of low-dimensional, positive semi-definite matrices. Using Schur complement arguments, we show that the resulting variational model can be simplified while leading to the same solution. The simplified model can be generalized to higher dimensional spheres and to SO(3)-valued data, where we rely on the quaternion representation of the latter. Standard algorithms from convex analysis can be applied to solve the resulting convex minimization problem. As proof-of-the-concept, we use the alternating direction method of multipliers to demonstrate the denoising behavior of the proposed method. In a series of experiments, we demonstrate the numerical convergence of the signal- or image values to the underlying manifold.
△ Less
Submitted 16 May, 2024; v1 submitted 20 July, 2023;
originally announced July 2023.
