-
Truncated Huber Penalty for Sparse Signal Recovery with Convergence Analysis
Authors:
Li Yang,
Serena Morigi,
Michael K. Ng,
You-wei Wen
Abstract:
Sparse signal recovery from under-determined systems presents significant challenges when using conventional L_0 and L_1 penalties, primarily due to computational complexity and estimation bias. This paper introduces a truncated Huber penalty, a non-convex metric that effectively bridges the gap between unbiased sparse recovery and differentiable optimization. The proposed penalty applies quadrati…
▽ More
Sparse signal recovery from under-determined systems presents significant challenges when using conventional L_0 and L_1 penalties, primarily due to computational complexity and estimation bias. This paper introduces a truncated Huber penalty, a non-convex metric that effectively bridges the gap between unbiased sparse recovery and differentiable optimization. The proposed penalty applies quadratic regularization to small entries while truncating large magnitudes, avoiding non-differentiable points at optima. Theoretical analysis demonstrates that, for an appropriately chosen threshold, any s-sparse solution recoverable via conventional penalties remains a local optimum under the truncated Huber function. This property allows the exact and robust recovery theories developed for other penalty regularization functions to be directly extended to the truncated Huber function. To solve the optimization problem, we develop a block coordinate descent (BCD) algorithm with finite-step convergence guarantees under spark conditions. Numerical experiments are conducted to validate the effectiveness and robustness of the proposed approach. Furthermore, we extend the truncated Huber-penalized model to the gradient domain, illustrating its applicability in signal denoising and image smoothing.
△ Less
Submitted 6 April, 2025;
originally announced April 2025.
-
Oracle-Net for nonlinear compressed sensing in Electrical Impedance Tomography reconstruction problems
Authors:
Damiana Lazzaro,
Serena Morigi,
Luca Ratti
Abstract:
Sparse recovery principles play an important role in solving many nonlinear ill-posed inverse problems. We investigate a variational framework with support Oracle for compressed sensing sparse reconstructions, where the available measurements are nonlinear and possibly corrupted by noise. A graph neural network, named Oracle-Net, is proposed to predict the support from the nonlinear measurements a…
▽ More
Sparse recovery principles play an important role in solving many nonlinear ill-posed inverse problems. We investigate a variational framework with support Oracle for compressed sensing sparse reconstructions, where the available measurements are nonlinear and possibly corrupted by noise. A graph neural network, named Oracle-Net, is proposed to predict the support from the nonlinear measurements and is integrated into a regularized recovery model to enforce sparsity. The derived nonsmooth optimization problem is then efficiently solved through a constrained proximal gradient method. Error bounds on the approximate solution of the proposed Oracle-based optimization are provided in the context of the ill-posed Electrical Impedance Tomography problem. Numerical solutions of the EIT nonlinear inverse reconstruction problem confirm the potential of the proposed method which improves the reconstruction quality from undersampled measurements, under sparsity assumptions.
△ Less
Submitted 9 April, 2024;
originally announced April 2024.
-
Fast and stable schemes for non-linear osmosis filtering
Authors:
L. Calatroni,
S. Morigi,
S. Parisotto,
G. A. Recupero
Abstract:
We consider a non-linear variant of the transport-diffusion osmosis model for solving a variety of imaging problems such as shadow/soft-light removal and compact data representation. The non-linear behaviour is encoded in terms of a general scalar function g with suitable properties, which allows to balance the diffusion intensity on the different regions of the image while preventing smoothing ar…
▽ More
We consider a non-linear variant of the transport-diffusion osmosis model for solving a variety of imaging problems such as shadow/soft-light removal and compact data representation. The non-linear behaviour is encoded in terms of a general scalar function g with suitable properties, which allows to balance the diffusion intensity on the different regions of the image while preventing smoothing artefacts. For the proposed model, conservation properties (intensity and non-negativity) are proved and a variational interpretation is showed for specific choices of g. Upon suitable spatial discretisation, both an explicit and a semi-implicit iterative scheme are considered, for which convergence restrictions and unconditional stability are proved, respectively. To validate the proposed modelling and the computational speed of the numerical schemes considered, we report several results and comparisons for the problem of shadow/light-spot removal and compact data representation, showing that artefact-free and computationally efficient results are obtained in comparison to standard linear and anisotropic models, and state-of-the art approaches.
△ Less
Submitted 29 March, 2022;
originally announced March 2022.
-
Non-convex Super-resolution of OCT images via sparse representation
Authors:
Gabriele Scrivanti,
Luca Calatroni,
Serena Morigi,
Lindsay Nicholson,
Alin Achim
Abstract:
We propose a non-convex variational model for the super-resolution of Optical Coherence Tomography (OCT) images of the murine eye, by enforcing sparsity with respect to suitable dictionaries learnt from high-resolution OCT data. The statistical characteristics of OCT images motivate the use of α-stable distributions for learning dictionaries, by considering the non-Gaussian case, α=1. The sparsity…
▽ More
We propose a non-convex variational model for the super-resolution of Optical Coherence Tomography (OCT) images of the murine eye, by enforcing sparsity with respect to suitable dictionaries learnt from high-resolution OCT data. The statistical characteristics of OCT images motivate the use of α-stable distributions for learning dictionaries, by considering the non-Gaussian case, α=1. The sparsity-promoting cost function relies on a non-convex penalty - Cauchy-based or Minimax Concave Penalty (MCP) - which makes the problem particularly challenging. We propose an efficient algorithm for minimizing the function based on the forward-backward splitting strategy which guarantees at each iteration the existence and uniqueness of the proximal point. Comparisons with standard convex L1-based reconstructions show the better performance of non-convex models, especially in view of further OCT image analysis
△ Less
Submitted 22 October, 2020;
originally announced October 2020.
-
Space-variant Generalized Gaussian Regularization for Image Restoration
Authors:
Alessandro Lanza,
Serena Morigi,
Monica Pragliola,
Fiorella Sgallari
Abstract:
We propose a new space-variant regularization term for variational image restoration based on the assumption that the gradient magnitudes of the target image distribute locally according to a half-Generalized Gaussian distribution. This leads to a highly flexible regularizer characterized by two per-pixel free parameters, which are automatically estimated from the observed image. The proposed regu…
▽ More
We propose a new space-variant regularization term for variational image restoration based on the assumption that the gradient magnitudes of the target image distribute locally according to a half-Generalized Gaussian distribution. This leads to a highly flexible regularizer characterized by two per-pixel free parameters, which are automatically estimated from the observed image. The proposed regularizer is coupled with either the $L_2$ or the $L_1$ fidelity terms, in order to effectively deal with additive white Gaussian noise or impulsive noises such as, e.g, additive white Laplace and salt and pepper noise. The restored image is efficiently computed by means of an iterative numerical algorithm based on the alternating direction method of multipliers. Numerical examples indicate that the proposed regularizer holds the potential for achieving high quality restorations for a wide range of target images characterized by different gradient distributions and for the different types of noise considered.
△ Less
Submitted 26 June, 2019; v1 submitted 21 June, 2019;
originally announced June 2019.
-
Shape Partitioning via L$_p$ Compressed Modes
Authors:
Martin Huska,
Damiana Lazzaro,
Serena Morigi
Abstract:
The eigenfunctions of the Laplace Beltrami operator (Manifold Harmonics) define a function basis that can be used in spectral analysis on manifolds. In [21] the authors recast the problem as an orthogonality constrained optimization problem and pioneer the use of an $L_1$ penalty term to obtain sparse (localized) solutions. In this context, the notion corresponding to sparsity is compact support w…
▽ More
The eigenfunctions of the Laplace Beltrami operator (Manifold Harmonics) define a function basis that can be used in spectral analysis on manifolds. In [21] the authors recast the problem as an orthogonality constrained optimization problem and pioneer the use of an $L_1$ penalty term to obtain sparse (localized) solutions. In this context, the notion corresponding to sparsity is compact support which entails spatially localized solutions. We propose to enforce such a compact support structure by a variational optimization formulation with an $L_p$ penalization term, with $0<p<1$. The challenging solution of the orthogonality constrained non-convex minimization problem is obtained by applying splitting strategies and an ADMM-based iterative algorithm. The effectiveness of the novel compact support basis is demonstrated in the solution of the 2-manifold decomposition problem which plays an important role in shape geometry processing where the boundary of a 3D object is well represented by a polygonal mesh. We propose an algorithm for mesh segmentation and patch-based partitioning (where a genus-0 surface patching is required). Experiments on shape partitioning are conducted to validate the performance of the proposed compact support basis.
△ Less
Submitted 20 April, 2018;
originally announced April 2018.
-
On multi-degree splines
Authors:
Carolina Vittoria Beccari,
Giulio Casciola,
Serena Morigi
Abstract:
Multi-degree splines are piecewise polynomial functions having sections of different degrees. For these splines, we discuss the construction of a B-spline basis by means of integral recurrence relations, extending the class of multi-degree splines that can be derived by existing approaches. We then propose a new alternative method for constructing and evaluating the B-spline basis, based on the us…
▽ More
Multi-degree splines are piecewise polynomial functions having sections of different degrees. For these splines, we discuss the construction of a B-spline basis by means of integral recurrence relations, extending the class of multi-degree splines that can be derived by existing approaches. We then propose a new alternative method for constructing and evaluating the B-spline basis, based on the use of so-called transition functions. Using the transition functions we develop general algorithms for knot-insertion, degree elevation and conversion to Bézier form, essential tools for applications in geometric modeling. We present numerical examples and briefly discuss how the same idea can be used in order to construct geometrically continuous multi-degree splines.
△ Less
Submitted 14 September, 2017;
originally announced September 2017.
-
Vessel Segmentation in Medical Imaging Using a Tight-Frame Based Algorithm
Authors:
Xiaohao Cai,
Raymond Chan,
Serena Morigi,
Fiorella Sgallari
Abstract:
Tight-frame, a generalization of orthogonal wavelets, has been used successfully in various problems in image processing, including inpainting, impulse noise removal, super-resolution image restoration, etc. Segmentation is the process of identifying object outlines within images. There are quite a few efficient algorithms for segmentation that depend on the variational approach and the partial di…
▽ More
Tight-frame, a generalization of orthogonal wavelets, has been used successfully in various problems in image processing, including inpainting, impulse noise removal, super-resolution image restoration, etc. Segmentation is the process of identifying object outlines within images. There are quite a few efficient algorithms for segmentation that depend on the variational approach and the partial differential equation (PDE) modeling.
In this paper, we propose to apply the tight-frame approach to automatically identify tube-like structures such as blood vessels in Magnetic Resonance Angiography (MRA) images. Our method iteratively refines a region that encloses the possible boundary or surface of the vessels. In each iteration, we apply the tight-frame algorithm to denoise and smooth the possible boundary and sharpen the region. We prove the convergence of our algorithm. Numerical experiments on real 2D/3D MRA images demonstrate that our method is very efficient with convergence usually within a few iterations, and it outperforms existing PDE and variational methods as it can extract more tubular objects and fine details in the images.
△ Less
Submitted 13 August, 2011;
originally announced September 2011.