-
A stochastic optimisation unadjusted Langevin method for empirical Bayesian estimation in semi-blind image deblurring problems
Authors:
Charlesquin Kemajou Mbakam,
Marcelo Pereyra,
Jean-François Giovannelli
Abstract:
This paper presents a novel stochastic optimisation methodology to perform empirical Bayesian inference in semi-blind image deconvolution problems. Given a blurred image and a parametric class of possible operators, the proposed optimisation approach automatically calibrates the parameters of the blur model by maximum marginal likelihood estimation, followed by (non-blind) image deconvolution by m…
▽ More
This paper presents a novel stochastic optimisation methodology to perform empirical Bayesian inference in semi-blind image deconvolution problems. Given a blurred image and a parametric class of possible operators, the proposed optimisation approach automatically calibrates the parameters of the blur model by maximum marginal likelihood estimation, followed by (non-blind) image deconvolution by maximum-a-posteriori estimation conditionally to the estimated model parameters. In addition to the blur model, the proposed approach also automatically calibrates the noise variance as well as any regularisation parameters. The marginal likelihood of the blur, noise variance, and regularisation parameters is generally computationally intractable, as it requires calculating several integrals over the entire solution space. Our approach addresses this difficulty by using a stochastic approximation proximal gradient optimisation scheme, which iteratively solves such integrals by using a Moreau-Yosida regularised unadjusted Langevin Markov chain Monte Carlo algorithm. This optimisation strategy can be easily and efficiently applied to any model that is log-concave, and by using the same gradient and proximal operators that are required to compute the maximum-a-posteriori solution by convex optimisation. We provide convergence guarantees for the proposed optimisation scheme under realistic and easily verifiable conditions and subsequently demonstrate the effectiveness of the approach with a series of deconvolution experiments and comparisons with alternative strategies from the state of the art.
△ Less
Submitted 7 March, 2024;
originally announced March 2024.
-
Bayesian model selection for unsupervised image deconvolution with structured Gaussian priors
Authors:
Benjamin Harroué,
Jean-François Giovannelli,
Marcelo Pereyra
Abstract:
This paper considers the objective comparison of stochastic models to solve inverse problems, more specifically image restoration. Most often, model comparison is addressed in a supervised manner, that can be time-consuming and partly arbitrary. Here we adopt an unsupervised Bayesian approach and objectively compare the models based on their posterior probabilities, directly from the data without…
▽ More
This paper considers the objective comparison of stochastic models to solve inverse problems, more specifically image restoration. Most often, model comparison is addressed in a supervised manner, that can be time-consuming and partly arbitrary. Here we adopt an unsupervised Bayesian approach and objectively compare the models based on their posterior probabilities, directly from the data without ground truth available. The probabilities depend on the marginal likelihood or "evidence" of the models and we resort to the Chib approach including a Gibbs sampler. We focus on the family of Gaussian models with circulant covariances and unknown hyperparameters, and compare different types of covariance matrices for the image and noise.
△ Less
Submitted 13 October, 2020;
originally announced October 2020.
-
Gradient Scan Gibbs Sampler: an efficient algorithm for high-dimensional Gaussian distributions
Authors:
Olivier Féron,
François Orieux,
Jean-François Giovannelli
Abstract:
This paper deals with Gibbs samplers that include high dimensional conditional Gaussian distributions. It proposes an efficient algorithm that avoids the high dimensional Gaussian sampling and relies on a random excursion along a small set of directions. The algorithm is proved to converge, i.e. the drawn samples are asymptotically distributed according to the target distribution. Our main motivat…
▽ More
This paper deals with Gibbs samplers that include high dimensional conditional Gaussian distributions. It proposes an efficient algorithm that avoids the high dimensional Gaussian sampling and relies on a random excursion along a small set of directions. The algorithm is proved to converge, i.e. the drawn samples are asymptotically distributed according to the target distribution. Our main motivation is in inverse problems related to general linear observation models and their solution in a hierarchical Bayesian framework implemented through sampling algorithms. It finds direct applications in semi-blind/unsupervised methods as well as in some non-Gaussian methods. The paper provides an illustration focused on the unsupervised estimation for super-resolution methods.
△ Less
Submitted 11 September, 2015;
originally announced September 2015.
-
Estimating hyperparameters and instrument parameters in regularized inversion. Illustration for SPIRE/Herschel map making
Authors:
F. Orieux,
J. -F. Giovannelli,
T. Rodet,
A. Abergel
Abstract:
We describe regularized methods for image reconstruction and focus on the question of hyperparameter and instrument parameter estimation, i.e. unsupervised and myopic problems. We developed a Bayesian framework that is based on the \post density for all unknown quantities, given the observations. This density is explored by a Markov Chain Monte-Carlo sampling technique based on a Gibbs loop and in…
▽ More
We describe regularized methods for image reconstruction and focus on the question of hyperparameter and instrument parameter estimation, i.e. unsupervised and myopic problems. We developed a Bayesian framework that is based on the \post density for all unknown quantities, given the observations. This density is explored by a Markov Chain Monte-Carlo sampling technique based on a Gibbs loop and including a Metropolis-Hastings step. The numerical evaluation relies on the SPIRE instrument of the Herschel observatory. Using simulated and real observations, we show that the hyperparameters and instrument parameters are correctly estimated, which opens up many perspectives for imaging in astrophysics.
△ Less
Submitted 15 November, 2012;
originally announced November 2012.
-
Efficient sampling of high-dimensional Gaussian fields: the non-stationary / non-sparse case
Authors:
F. Orieux,
O. Féron,
J. -F. Giovannelli
Abstract:
This paper is devoted to the problem of sampling Gaussian fields in high dimension. Solutions exist for two specific structures of inverse covariance : sparse and circulant. The proposed approach is valid in a more general case and especially as it emerges in inverse problems. It relies on a perturbation-optimization principle: adequate stochastic perturbation of a criterion and optimization of th…
▽ More
This paper is devoted to the problem of sampling Gaussian fields in high dimension. Solutions exist for two specific structures of inverse covariance : sparse and circulant. The proposed approach is valid in a more general case and especially as it emerges in inverse problems. It relies on a perturbation-optimization principle: adequate stochastic perturbation of a criterion and optimization of the perturbed criterion. It is shown that the criterion minimizer is a sample of the target density. The motivation in inverse problems is related to general (non-convolutive) linear observation models and their resolution in a Bayesian framework implemented through sampling algorithms when existing samplers are not feasible. It finds a direct application in myopic and/or unsupervised inversion as well as in some non-Gaussian inversion. An illustration focused on hyperparameter estimation for super-resolution problems assesses the effectiveness of the proposed approach.
△ Less
Submitted 30 May, 2011;
originally announced May 2011.
-
Bayesian estimation of regularization and PSF parameters for Wiener-Hunt deconvolution
Authors:
Francois Orieux,
Jean-Francois Giovannelli,
Thomas Rodet
Abstract:
This paper tackles the problem of image deconvolution with joint estimation of PSF parameters and hyperparameters. Within a Bayesian framework, the solution is inferred via a global a posteriori law for unknown parameters and object. The estimate is chosen as the posterior mean, numerically calculated by means of a Monte-Carlo Markov chain algorithm. The estimates are efficiently computed in the F…
▽ More
This paper tackles the problem of image deconvolution with joint estimation of PSF parameters and hyperparameters. Within a Bayesian framework, the solution is inferred via a global a posteriori law for unknown parameters and object. The estimate is chosen as the posterior mean, numerically calculated by means of a Monte-Carlo Markov chain algorithm. The estimates are efficiently computed in the Fourier domain and the effectiveness of the method is shown on simulated examples. Results show precise estimates for PSF parameters and hyperparameters as well as precise image estimates including restoration of high-frequencies and spatial details, within a global and coherent approach.
△ Less
Submitted 30 April, 2010;
originally announced April 2010.
-
Point target detection and subpixel position estimation in optical imagery
Authors:
Vincent Samson,
Frédéric Champagnat,
Jean-François Giovannelli
Abstract:
This paper addresses the issue of detecting point objects in a clutter background and estimating their position by image processing. We are interested in the specific context where the object signature significantly varies with its random subpixel location because of aliasing. Conventional matched filter neglects this phenomenon and causes consistent loss of detection performance. Thus, alternat…
▽ More
This paper addresses the issue of detecting point objects in a clutter background and estimating their position by image processing. We are interested in the specific context where the object signature significantly varies with its random subpixel location because of aliasing. Conventional matched filter neglects this phenomenon and causes consistent loss of detection performance. Thus, alternative detectors are proposed and numerical results show the improvement brought by approximate and generalized likelihood ratio tests in comparison with pixel matched filtering. We also study the performance of two types of subpixel position estimators. Finally, we put forward the major influence of sensor design on both estimation and point object detection performance.
△ Less
Submitted 6 November, 2009;
originally announced November 2009.
-
Bayesian interpretation of periodograms
Authors:
J. -F. Giovannelli,
J. Idier
Abstract:
The usual nonparametric approach to spectral analysis is revisited within the regularization framework. Both usual and windowed periodograms are obtained as the squared modulus of the minimizer of regularized least squares criteria. Then, particular attention is paid to their interpretation within the Bayesian statistical framework. Finally, the question of unsupervised hyperparameter and window…
▽ More
The usual nonparametric approach to spectral analysis is revisited within the regularization framework. Both usual and windowed periodograms are obtained as the squared modulus of the minimizer of regularized least squares criteria. Then, particular attention is paid to their interpretation within the Bayesian statistical framework. Finally, the question of unsupervised hyperparameter and window selection is addressed. It is shown that maximum likelihood solution is both formally achievable and practically useful.
△ Less
Submitted 22 August, 2009;
originally announced August 2009.
-
Regularized adaptive long autoregressive spectral analysis
Authors:
J. -F. Giovannelli,
J. Idier,
G. Desodt,
D. Muller
Abstract:
This paper is devoted to adaptive long autoregressive spectral analysis when (i) very few data are available, (ii) information does exist beforehand concerning the spectral smoothness and time continuity of the analyzed signals. The contribution is founded on two papers by Kitagawa and Gersch. The first one deals with spectral smoothness, in the regularization framework, while the second one is…
▽ More
This paper is devoted to adaptive long autoregressive spectral analysis when (i) very few data are available, (ii) information does exist beforehand concerning the spectral smoothness and time continuity of the analyzed signals. The contribution is founded on two papers by Kitagawa and Gersch. The first one deals with spectral smoothness, in the regularization framework, while the second one is devoted to time continuity, in the Kalman formalism. The present paper proposes an original synthesis of the two contributions: a new regularized criterion is introduced that takes both information into account. The criterion is efficiently optimized by a Kalman smoother. One of the major features of the method is that it is entirely unsupervised: the problem of automatically adjusting the hyperparameters that balance data-based versus prior-based information is solved by maximum likelihood. The improvement is quantified in the field of meteorological radar.
△ Less
Submitted 22 August, 2009;
originally announced August 2009.
-
Unsupervised Frequency Tracking beyond the Nyquist Limit using Markov Chains
Authors:
J. -F. Giovannelli,
J. Idier,
R. Boubertakh,
A. Herment
Abstract:
This paper deals with the estimation of a sequence of frequencies from a corresponding sequence of signals. This problem arises in fields such as Doppler imaging where its specificity is twofold. First, only short noisy data records are available (typically four sample long) and experimental constraints may cause spectral aliasing so that measurements provide unreliable, ambiguous information. S…
▽ More
This paper deals with the estimation of a sequence of frequencies from a corresponding sequence of signals. This problem arises in fields such as Doppler imaging where its specificity is twofold. First, only short noisy data records are available (typically four sample long) and experimental constraints may cause spectral aliasing so that measurements provide unreliable, ambiguous information. Second, the frequency sequence is smooth. Here, this information is accounted for by a Markov model and application of the Bayes rule yields the a posteriori density. The maximum a postariori is computed by a combination of Viterbi and descent procedures. One of the major features of the method is that it is entirely unsupervised. Adjusting the hyperparameters that balance data-based and prior-based information is done automatically by ML using an EM-based gradient algorithm. We compared the proposed estimate to a reference one and found that it performed better: variance was greatly reduced and tracking was correct, even beyond the Nyquist frequency.
△ Less
Submitted 22 August, 2009;
originally announced August 2009.
-
An Improved Observation Model for Super-Resolution under Affine Motion
Authors:
G. Rochefort,
F. Champagnat,
G. Le Besnerais,
J. -F. Giovannelli
Abstract:
Super-resolution (SR) techniques make use of subpixel shifts between frames in an image sequence to yield higher-resolution images. We propose an original observation model devoted to the case of non isometric inter-frame motion as required, for instance, in the context of airborne imaging sensors. First, we describe how the main observation models used in the SR literature deal with motion, and…
▽ More
Super-resolution (SR) techniques make use of subpixel shifts between frames in an image sequence to yield higher-resolution images. We propose an original observation model devoted to the case of non isometric inter-frame motion as required, for instance, in the context of airborne imaging sensors. First, we describe how the main observation models used in the SR literature deal with motion, and we explain why they are not suited for non isometric motion. Then, we propose an extension of the observation model by Elad and Feuer adapted to affine motion. This model is based on a decomposition of affine transforms into successive shear transforms, each one efficiently implemented by row-by-row or column-by-column 1-D affine transforms.
We demonstrate on synthetic and real sequences that our observation model incorporated in a SR reconstruction technique leads to better results in the case of variable scale motions and it provides equivalent results in the case of isometric motions.
△ Less
Submitted 22 August, 2009;
originally announced August 2009.
-
Unsupervised bayesian convex deconvolution based on a field with an explicit partition function
Authors:
Jean-Francois Giovannelli
Abstract:
This paper proposes a non-Gaussian Markov field with a special feature: an explicit partition function. To the best of our knowledge, this is an original contribution. Moreover, the explicit expression of the partition function enables the development of an unsupervised edge-preserving convex deconvolution method. The method is fully Bayesian, and produces an estimate in the sense of the posteri…
▽ More
This paper proposes a non-Gaussian Markov field with a special feature: an explicit partition function. To the best of our knowledge, this is an original contribution. Moreover, the explicit expression of the partition function enables the development of an unsupervised edge-preserving convex deconvolution method. The method is fully Bayesian, and produces an estimate in the sense of the posterior mean, numerically calculated by means of a Monte-Carlo Markov Chain technique. The approach is particularly effective and the computational practicability of the method is shown on a simple simulated example.
△ Less
Submitted 26 January, 2009; v1 submitted 21 January, 2009;
originally announced January 2009.
