-
Diffusion prior as a direct regularization term for FWI
Authors:
Yuke Xie,
Hervé Chauris,
Nicolas Desassis
Abstract:
Diffusion models have recently shown promise as powerful generative priors for inverse problems. However, conventional applications require solving the full reverse diffusion process and operating on noisy intermediate states, which poses challenges for physics-constrained computational seismic imaging. In particular, such instability is pronounced in non-linear solvers like those used in Full Wav…
▽ More
Diffusion models have recently shown promise as powerful generative priors for inverse problems. However, conventional applications require solving the full reverse diffusion process and operating on noisy intermediate states, which poses challenges for physics-constrained computational seismic imaging. In particular, such instability is pronounced in non-linear solvers like those used in Full Waveform Inversion (FWI), where wave propagation through noisy velocity fields can lead to numerical artifacts and poor inversion quality. In this work, we propose a simple yet effective framework that directly integrates a pretrained Denoising Diffusion Probabilistic Model (DDPM) as a score-based generative diffusion prior into FWI through a score rematching strategy. Unlike traditional diffusion approaches, our method avoids the reverse diffusion sampling and needs fewer iterations. We operate the image inversion entirely in the clean image space, eliminating the need to operate through noisy velocity models. The generative diffusion prior can be introduced as a simple regularization term in the standard FWI update rule, requiring minimal modification to existing FWI pipelines. This promotes stable wave propagation and can improve convergence behavior and inversion quality. Numerical experiments suggest that the proposed method offers enhanced fidelity and robustness compared to conventional and GAN-based FWI approaches, while remaining practical and computationally efficient for seismic imaging and other inverse problem tasks.
△ Less
Submitted 11 June, 2025;
originally announced June 2025.
-
The SPDE approach for spatio-temporal datasets with advection and diffusion
Authors:
Lucia Clarotto,
Denis Allard,
Thomas Romary,
Nicolas Desassis
Abstract:
In the task of predicting spatio-temporal fields in environmental science using statistical methods, introducing statistical models inspired by the physics of the underlying phenomena that are numerically efficient is of growing interest. Large space-time datasets call for new numerical methods to efficiently process them. The Stochastic Partial Differential Equation (SPDE) approach has proven to…
▽ More
In the task of predicting spatio-temporal fields in environmental science using statistical methods, introducing statistical models inspired by the physics of the underlying phenomena that are numerically efficient is of growing interest. Large space-time datasets call for new numerical methods to efficiently process them. The Stochastic Partial Differential Equation (SPDE) approach has proven to be effective for the estimation and the prediction in a spatial context. We present here the advection-diffusion SPDE with first order derivative in time which defines a large class of nonseparable spatio-temporal models. A Gaussian Markov random field approximation of the solution to the SPDE is built by discretizing the temporal derivative with a finite difference method (implicit Euler) and by solving the spatial SPDE with a finite element method (continuous Galerkin) at each time step. The ''Streamline Diffusion'' stabilization technique is introduced when the advection term dominates the diffusion. Computationally efficient methods are proposed to estimate the parameters of the SPDE and to predict the spatio-temporal field by kriging, as well as to perform conditional simulations. The approach is applied to a solar radiation dataset. Its advantages and limitations are discussed.
△ Less
Submitted 22 July, 2024; v1 submitted 30 August, 2022;
originally announced August 2022.
-
Geostatistics for large datasets on Riemannian manifolds: a matrix-free approach
Authors:
Mike Pereira,
Nicolas Desassis,
Denis Allard
Abstract:
Large or very large spatial (and spatio-temporal) datasets have become common place in many environmental and climate studies. These data are often collected in non-Euclidean spaces (such as the planet Earth) and they often present non-stationary anisotropies. This paper proposes a generic approach to model Gaussian Random Fields (GRFs) on compact Riemannian manifolds that bridges the gap between…
▽ More
Large or very large spatial (and spatio-temporal) datasets have become common place in many environmental and climate studies. These data are often collected in non-Euclidean spaces (such as the planet Earth) and they often present non-stationary anisotropies. This paper proposes a generic approach to model Gaussian Random Fields (GRFs) on compact Riemannian manifolds that bridges the gap between existing works on non-stationary GRFs and random fields on manifolds. This approach can be applied to any smooth compact manifolds, and in particular to any compact surface. By defining a Riemannian metric that accounts for the preferential directions of correlation, our approach yields an interpretation of the ''local anisotropies'' as resulting from ''local'' deformations of the domain. We provide scalable algorithms for the estimation of the parameters and for optimal prediction by kriging and simulation able to tackle very large grids. Stationary and non-stationary illustrations are provided.
△ Less
Submitted 6 January, 2023; v1 submitted 26 August, 2022;
originally announced August 2022.
-
A matrix-free approach to geostatistical filtering
Authors:
Mike Pereira,
Nicolas Desassis,
Cédric Magneron,
Nathan Palmer
Abstract:
In this paper, we present a novel approach to geostatistical filtering which tackles two challenges encountered when applying this method to complex spatial datasets: modeling the non-stationarity of the data while still being able to work with large datasets. The approach is based on a finite element approximation of Gaussian random fields expressed as an expansion of the eigenfunctions of a Lapl…
▽ More
In this paper, we present a novel approach to geostatistical filtering which tackles two challenges encountered when applying this method to complex spatial datasets: modeling the non-stationarity of the data while still being able to work with large datasets. The approach is based on a finite element approximation of Gaussian random fields expressed as an expansion of the eigenfunctions of a Laplace--Beltrami operator defined to account for local anisotropies. The numerical approximation of the resulting random fields using a finite element approach is then leveraged to solve the scalability issue through a matrix-free approach. Finally, two cases of application of this approach, on simulated and real seismic data are presented.
△ Less
Submitted 6 April, 2020;
originally announced April 2020.
-
Finite element approximation of non-Markovian random fields
Authors:
Mike Pereira,
Nicolas Desassis
Abstract:
In this paper, we present finite element approximations of a class of Generalized random fields defined over a bounded domain of R d or a smooth d-dimensional Riemannian manifold (d $\ge$ 1). An explicit expression for the covariance matrix of the weights of the finite element representation of these fields is provided and an analysis of the approximation error is carried out. Finally, a method to…
▽ More
In this paper, we present finite element approximations of a class of Generalized random fields defined over a bounded domain of R d or a smooth d-dimensional Riemannian manifold (d $\ge$ 1). An explicit expression for the covariance matrix of the weights of the finite element representation of these fields is provided and an analysis of the approximation error is carried out. Finally, a method to generate simulations of these weights while limiting computational and storage costs is presented.
△ Less
Submitted 6 November, 2018;
originally announced November 2018.
-
A general framework for SPDE-based stationary random fields
Authors:
Ricardo Carrizo Vergara,
Denis Allard,
Nicolas Desassis
Abstract:
This paper presents theoretical advances in the application of the Stochastic Partial Differential Equation (SPDE) approach in geostatistics. We show a general approach to construct stationary models related to a wide class of linear SPDEs, with applications to spatio-temporal models having non-trivial properties. Within the framework of Generalized Random Fields, a criterion for existence and uni…
▽ More
This paper presents theoretical advances in the application of the Stochastic Partial Differential Equation (SPDE) approach in geostatistics. We show a general approach to construct stationary models related to a wide class of linear SPDEs, with applications to spatio-temporal models having non-trivial properties. Within the framework of Generalized Random Fields, a criterion for existence and uniqueness of stationary solutions for this class of SPDEs is proposed and proven. Their covariance are then obtained through their spectral measure. We present a result relating the covariance in the case of a White Noise source term with that of a generic case through convolution. Then, we obtain a variety of SPDE-based stationary random fields. In particular, well-known results regarding the Matérn Model and Markovian models are recovered. A new relationship between the Stein model and a particular SPDE is obtained. New spatio-temporal models obtained from evolution SPDEs of arbitrary temporal derivative order are then obtained, for which properties of separability and symmetry can be controlled. We also obtain results concerning stationary solutions for physically inspired models, such as solutions to the heat equation, the advection-diffusion equation, some Langevin's equations and the wave equation.
△ Less
Submitted 27 July, 2018; v1 submitted 13 June, 2018;
originally announced June 2018.
-
Combining covariance tapering and lasso driven low rank decomposition for the kriging of large spatial datasets
Authors:
Thomas Romary,
Nicolas Desassis
Abstract:
Large spatial datasets are becoming ubiquitous in environmental sciences with the explosion in the amount of data produced by sensors that monitor and measure the Earth system. Consequently, the geostatistical analysis of these data requires adequate methods. Richer datasets lead to more complex modeling but may also prevent from using classical techniques. Indeed, the kriging predictor is…
▽ More
Large spatial datasets are becoming ubiquitous in environmental sciences with the explosion in the amount of data produced by sensors that monitor and measure the Earth system. Consequently, the geostatistical analysis of these data requires adequate methods. Richer datasets lead to more complex modeling but may also prevent from using classical techniques. Indeed, the kriging predictor is not straightforwarldly available as it requires the inversion of the covariance matrix of the data. The challenge of handling such datasets is therefore to extract the maximum of information they contain while ensuring the numerical tractability of the associated inference and prediction algorithms. The different approaches that have been developed in the literature to address this problem can be classified into two families, both aiming at making the inversion of the covariance matrix computationally feasible. The covariance tapering approach circumvents the problem by enforcing the sparsity of the covariance matrix, making it invertible in a reasonable computation time. The second available approach assumes a low rank representation of the covariance function. While both approaches have their drawbacks, we propose a way to combine them and benefit from their advantages. The covariance model is assumed to have the form low rank plus sparse. The choice of the basis functions sustaining the low rank component is data driven and is achieved through a selection procedure, thus alleviating the computational burden of the low rank part. This model expresses as a spatial random effects model and the estimation of the parameters is conducted through a step by step approach treating each scale separately. The resulting model can account for second order non stationarity and handle large volumes of data.
△ Less
Submitted 5 June, 2018;
originally announced June 2018.
-
Efficient simulation of Gaussian Markov random fields by Chebyshev polynomial approximation
Authors:
Mike Pereira,
Nicolas Desassis
Abstract:
This paper presents an algorithm to simulate Gaussian random vectors whose precision matrix can be expressed as a polynomial of a sparse matrix. This situation arises in particular when simulating Gaussian Markov random fields obtained by the discretization by finite elements of the solutions of some stochastic partial derivative equations. The proposed algorithm uses a Chebyshev polynomial approx…
▽ More
This paper presents an algorithm to simulate Gaussian random vectors whose precision matrix can be expressed as a polynomial of a sparse matrix. This situation arises in particular when simulating Gaussian Markov random fields obtained by the discretization by finite elements of the solutions of some stochastic partial derivative equations. The proposed algorithm uses a Chebyshev polynomial approximation to compute simulated vectors with a linear complexity. This method is asymptotically exact as the approximation order grows. Criteria based on tests of the statistical properties of the produced vectors are derived to determine minimal orders of approximation.
△ Less
Submitted 29 June, 2018; v1 submitted 17 May, 2018;
originally announced May 2018.
-
A pairwise likelihood approach for the empirical estimation of the underlyingvariograms in the plurigaussian models
Authors:
Nicolas Desassis,
Didier Renard,
Hélène Beucher,
Sylvain Petiteau,
Xavier Freulon
Abstract:
The plurigaussian model is particularly suited to describe categorical regionalized variables. Starting from a simple principle, the thresh-olding of one or several Gaussian random fields (GRFs) to obtain categories, the plurigaussian model is well adapted for a wide range ofsituations. By acting on the form of the thresholding rule and/or the threshold values (which can vary along space) and the…
▽ More
The plurigaussian model is particularly suited to describe categorical regionalized variables. Starting from a simple principle, the thresh-olding of one or several Gaussian random fields (GRFs) to obtain categories, the plurigaussian model is well adapted for a wide range ofsituations. By acting on the form of the thresholding rule and/or the threshold values (which can vary along space) and the variograms ofthe underlying GRFs, one can generate many spatial configurations for the categorical variables. One difficulty is to choose variogrammodel for the underlying GRFs. Indeed, these latter are hidden by the truncation and we only observe the simple and cross-variogramsof the category indicators. In this paper, we propose a semiparametric method based on the pairwise likelihood to estimate the empiricalvariogram of the GRFs. It provides an exploratory tool in order to choose a suitable model for each GRF and later to estimate its param-eters. We illustrate the efficiency of the method with a Monte-Carlo simulation study .The method presented in this paper is implemented in the R packageRGeostats.
△ Less
Submitted 16 October, 2015; v1 submitted 9 October, 2015;
originally announced October 2015.
-
Incorporating a contrast in the Bayesian formula: What consequences for the MAP estimator and the posterior distribution? Applications in spatial statistics
Authors:
S. Soubeyrand,
F. Carpentier,
N. Desassis,
J. Chadœuf
Abstract:
In order to estimate model parameters and circumvent possible difficulties encountered with the likelihood function, we propose to replace the likelihood in the formula of the posterior distribution by a function depending on a contrast. The properties of the contrast-based (CB) posterior distribution and MAP estimator are studied to understand what the consequences of incorporating a contrast i…
▽ More
In order to estimate model parameters and circumvent possible difficulties encountered with the likelihood function, we propose to replace the likelihood in the formula of the posterior distribution by a function depending on a contrast. The properties of the contrast-based (CB) posterior distribution and MAP estimator are studied to understand what the consequences of incorporating a contrast in the Bayesian formula are. We show that the proposed method can be used to make frequentist inference and allows the reduction of analytical calculations to get the limit variance matrix of the estimator. For specific contrasts, the CB--posterior distribution directly approximates the limit distribution of the estimator; the calculation of the limit variance matrix is then avoided. Moreover, for these contrasts, the CB--posterior distribution can also be used to make inference in the Bayesian way. The method is applied to three spatial data sets.
△ Less
Submitted 30 April, 2008;
originally announced April 2008.
