Showing 1–27 of 27 results for author: Ravasi, M

Geophysical inverse problems with measurement-guided diffusion models

Authors: Matteo Ravasi

Abstract: Solving inverse problems with the reverse process of a diffusion model represents an appealing avenue to produce highly realistic, yet diverse solutions from incomplete and possibly noisy measurements, ultimately enabling uncertainty quantification at scale. However, because of the intractable nature of the score function of the likelihood term (i.e.,… ▽ More Solving inverse problems with the reverse process of a diffusion model represents an appealing avenue to produce highly realistic, yet diverse solutions from incomplete and possibly noisy measurements, ultimately enabling uncertainty quantification at scale. However, because of the intractable nature of the score function of the likelihood term (i.e., $\nabla_{\mathbf{x}_t} p(\mathbf{y} | \mathbf{x}_t)$), various samplers have been proposed in the literature that use different (more or less accurate) approximations of such a gradient to guide the diffusion process towards solutions that match the observations. In this work, I consider two sampling algorithms recently proposed under the name of Diffusion Posterior Sampling (DPS) and Pseudo-inverse Guided Diffusion Model (PGDM), respectively. In DSP, the guidance term used at each step of the reverse diffusion process is obtained by applying the adjoint of the modeling operator to the residual obtained from a one-step denoising estimate of the solution. On the other hand, PGDM utilizes a pseudo-inverse operator that originates from the fact that the one-step denoised solution is not assumed to be deterministic, rather modeled as a Gaussian distribution. Through an extensive set of numerical examples on two geophysical inverse problems (namely, seismic interpolation and seismic inversion), I show that two key aspects for the success of any measurement-guided diffusion process are: i) our ability to re-parametrize the inverse problem such that the sought after model is bounded between -1 and 1 (a pre-requisite for any diffusion model); ii) the choice of the training dataset used to learn the implicit prior that guides the reverse diffusion process. Numerical examples on synthetic and field datasets reveal that PGDM outperforms DPS in both scenarios at limited additional cost. △ Less

Submitted 8 January, 2025; originally announced January 2025.

Reciprocity-aware adaptive tile low-rank factorization for large-scale 3D multidimensional deconvolution

Authors: Fuqiang Chen, Matteo Ravasi, David Keyes

Abstract: Low-rank regularization is an effective technique for addressing ill-posed inverse problems when the unknown variable exhibits low-rank characteristics. However, global low-rank assumptions do not always hold for seismic wavefields; in many practical situations, local low-rank features are instead more commonly observed. To leverage this insight, we propose partitioning the unknown variable into t… ▽ More Low-rank regularization is an effective technique for addressing ill-posed inverse problems when the unknown variable exhibits low-rank characteristics. However, global low-rank assumptions do not always hold for seismic wavefields; in many practical situations, local low-rank features are instead more commonly observed. To leverage this insight, we propose partitioning the unknown variable into tiles, each represented via low-rank factorization. We apply this framework to regularize multidimensional deconvolution in the frequency domain, considering two key factors. First, the unknown variable, referred to as the Green's function, must maintain symmetry according to the reciprocity principle of wave propagation. To ensure symmetry within the tile-based low-rank framework, diagonal tiles are formulated as the product of a low-rank factor and its transpose if numerically rank-deficient. Otherwise, they are represented by preconditioned dense forms. Symmetry in off-diagonal elements is achieved by parameterizing sub-diagonal tiles as the product of two distinct low-rank factors, with the corresponding super-diagonal tiles set as their transposes. Second, the rank of the Green's function varies with frequency; in other words, the Green's function has different ranks at different frequencies. To determine the numerical rank and optimal tile size for each frequency, we first solve the multidimensional deconvolution problem using a benchmark solver. Based on these results, we estimate the optimal tile size and numerical rank for our proposed solver. △ Less

Submitted 19 December, 2024; originally announced December 2024.

Annealed Stein Variational Gradient Descent for Improved Uncertainty Estimation in Full-Waveform Inversion

Authors: Miguel Corrales, Sean Berti, Bertrand Denel, Paul Williamson, Mattia Aleardi, Matteo Ravasi

Abstract: In recent years, Full-Waveform Inversion (FWI) has been extensively used to derive high-resolution subsurface velocity models from seismic data. However, due to the nonlinearity and ill-posed nature of the problem, FWI requires a good starting model to avoid producing non-physical solutions. Moreover, conventional optimization methods fail to quantify the uncertainty associated with the recovered… ▽ More In recent years, Full-Waveform Inversion (FWI) has been extensively used to derive high-resolution subsurface velocity models from seismic data. However, due to the nonlinearity and ill-posed nature of the problem, FWI requires a good starting model to avoid producing non-physical solutions. Moreover, conventional optimization methods fail to quantify the uncertainty associated with the recovered solution, which is critical for decision-making processes. Bayesian inference offers an alternative approach as it directly or indirectly evaluates the posterior probability density function. For example, Markov Chain Monte Carlo (MCMC) methods generate multiple sample chains to characterize the solution's uncertainty. Despite their ability to theoretically handle any form of distribution, MCMC methods require many sampling steps; this limits their usage in high-dimensional problems with computationally intensive forward modeling, as is the FWI case. Variational Inference (VI), on the other hand, provides an approximate solution to the posterior distribution in the form of a parametric or non-parametric proposal distribution. Among the various algorithms used in VI, Stein Variational Gradient Descent (SVGD) is recognized for its ability to iteratively refine a set of samples to approximate the target distribution. However, mode and variance-collapse issues affect SVGD in high-dimensional inverse problems. This study aims to improve the performance of SVGD within the context of FWI by utilizing, for the first time, an annealed variant of SVGD and combining it with a multi-scale strategy. Additionally, we demonstrate that Principal Component Analysis (PCA) can be used to evaluate the performance of the optimization process. Clustering techniques are also employed to provide more rigorous and meaningful statistical analysis of the particles in the presence of multi-modal distributions. △ Less

Submitted 17 October, 2024; originally announced October 2024.

Signal Enhancement in Distributed Acoustic Sensing Data Using a Guided Unsupervised Deep Learning Network

Authors: Omar M. Saad, Matteo Ravasi, Tariq Alkhalifah

Abstract: Distributed Acoustic Sensing (DAS) is a promising technology introducing a new paradigm in the acquisition of high-resolution seismic data. However, DAS data often show weak signals compared to the background noise, especially in tough installation environments. In this study, we propose a new approach to denoise DAS data that leverages an unsupervised deep learning (DL) model, eliminating the nee… ▽ More Distributed Acoustic Sensing (DAS) is a promising technology introducing a new paradigm in the acquisition of high-resolution seismic data. However, DAS data often show weak signals compared to the background noise, especially in tough installation environments. In this study, we propose a new approach to denoise DAS data that leverages an unsupervised deep learning (DL) model, eliminating the need for labeled training data. The DL model aims to reconstruct the DAS signal while simultaneously attenuating DAS noise. The input DAS data undergo band-pass filtering to eliminate high-frequency content. Subsequently, a continuous wavelet transform (CWT) is performed, and the finest scale is used to guide the DL model in reconstructing the DAS signal. First, we extract 2D patches from both the band-pass filtered data and the CWT scale of the data. Then, these patches are converted using an unrolling mechanism into 1D vectors to form the input of the DL model. The architecture of the proposed DL network is composed of several fully-connected layers. A self-attention layer is further included in each layer to extract the spatial relation between the band-pass filtered data and the CWT scale. Through an iterative process, the DL model tunes its parameters to suppress DAS noise, with the band-pass filtered data serving as the target for the network. We employ the log cosh as a loss function for the DL model, enhancing its robustness against erratic noise. The denoising performance of the proposed framework is validated using field examples from the San Andreas Fault Observatory at Depth (SAFOD) and Frontier Observatory for Research in Geothermal Energy (FORGE) datasets, where the data are recorded by a fiber-optic cable. Comparative analyses against three benchmark methods reveal the robust denoising performance of the proposed framework. △ Less

Submitted 13 May, 2024; originally announced May 2024.

Comments: This paper has been submitted to Geophysics

Journal ref: Geophysics 89 (2024) 1-62

Robust Full Waveform Inversion with deep Hessian deblurring

Authors: Mustafa Alfarhan, Matteo Ravasi, Fuqiang Chen, Tariq Alkhalifah

Abstract: Full Waveform Inversion (FWI) is a technique widely used in geophysics to obtain high-resolution subsurface velocity models from waveform seismic data. Due to its large computation cost, most flavors of FWI rely only on the computation of the gradient of the loss function to estimate the update direction, therefore ignoring the contribution of the Hessian. Depending on the level of computational r… ▽ More Full Waveform Inversion (FWI) is a technique widely used in geophysics to obtain high-resolution subsurface velocity models from waveform seismic data. Due to its large computation cost, most flavors of FWI rely only on the computation of the gradient of the loss function to estimate the update direction, therefore ignoring the contribution of the Hessian. Depending on the level of computational resources one can afford, an approximate of the inverse of the Hessian can be calculated and used to speed up the convergence of FWI towards the global (or a plausible local) minimum. In this work, we propose to use an approximate Hessian computed from a linearization of the wave-equation as commonly done in Least-Squares Migration (LSM). More precisely, we rely on the link between a migrated image and a doubly migrated image (i.e., an image obtained by demigration-migration of the migrated image) to estimate the inverse of the Hessian. However, instead of using non-stationary compact filters to link the two images and approximate the Hessian, we propose to use a deep neural network to directly learn the mapping between the FWI gradient (output) and its Hessian (blurred) counterpart (input). By doing so, the network learns to act as an approximate inverse Hessian: as such, when the trained network is applied to the FWI gradient, an enhanced update direction is obtained, which is shown to be beneficial for the convergence of FWI. The weights of the trained (deblurring) network are then transferred to the next FWI iteration to expedite convergence. We demonstrate the effectiveness of the proposed approach on two synthetic datasets and a field dataset. △ Less

Submitted 26 March, 2024; originally announced March 2024.

Upside down Rayleigh-Marchenko: a practical, yet exact redatuming scheme for seabed seismic acquisitions

Authors: Ning Wang, Matteo Ravasi

Abstract: Ocean-bottom seismic plays a crucial role in resource exploration and monitoring. However, despite its undoubted potential, the use of coarse receiver geometries poses challenges to accurate wavefield redatuming. This in turn, affects the quality of subsequent imaging and reservoir charactherization products. We propose a reciprocal version of the Rayleigh-Marchenko method, called upside down Rayl… ▽ More Ocean-bottom seismic plays a crucial role in resource exploration and monitoring. However, despite its undoubted potential, the use of coarse receiver geometries poses challenges to accurate wavefield redatuming. This in turn, affects the quality of subsequent imaging and reservoir charactherization products. We propose a reciprocal version of the Rayleigh-Marchenko method, called upside down Rayleigh-Marchenko, where all spatial integrals are performed over the (usually much better-sampled) source carpet; this results in a theoretically exact redatuming scheme, which can handle irregular and sparse receiver geometries. The proposed method requires availability of multi-component receivers and either dual-sensor sources or a pre-processing step of model-based source deghosting, and utilizes only the down-going component of the receiver-side wavefield; as such, it can be interpreted as a full-wavefield extension of the mirror imaging method commonly used in seabed settings. Two synthetic examples are used to showcase the effectiveness of the proposed method, starting from the ideal scenario of finely and regularly sampled sources and receivers, and later considering different levels of decimation for the receiver array. Migrated images as well as common-angle gathers reveal that our method can be used to produce structural and amplitude-friendly imaging outputs with minimal data pre-processing. △ Less

Submitted 11 January, 2024; originally announced January 2024.

Plug-and-Play regularized 3D seismic inversion with 2D pre-trained denoisers

Authors: Nick Luiken, Juan Romero, Miguel Corrales, Matteo Ravasi

Abstract: Post-stack seismic inversion is a widely used technique to retrieve high-resolution acoustic impedance models from migrated seismic data. Its modelling operator assumes that a migrated seismic data can be generated from the convolution of a source wavelet and the time derivative of the acoustic impedance model. Given the band-limited nature of the seismic wavelet, the convolutional model acts as a… ▽ More Post-stack seismic inversion is a widely used technique to retrieve high-resolution acoustic impedance models from migrated seismic data. Its modelling operator assumes that a migrated seismic data can be generated from the convolution of a source wavelet and the time derivative of the acoustic impedance model. Given the band-limited nature of the seismic wavelet, the convolutional model acts as a filtering operator on the acoustic impedance model, thereby making the problem of retrieving acoustic impedances from seismic data ambiguous. In order to compensate for missing frequencies, post-stack seismic inversion is often regularized, meaning that prior information about the structure of the subsurface is included in the inversion process. Recently, the Plug-and-Play methodology has gained wide interest in the inverse problem community as a new form of implicit regularization, often outperforming state-of-the-art regularization. Plug-and-Play can be applied to any proximal algorithm by simply replacing the proximal operator of the regularizer with any denoiser of choice. We propose to use Plug-and-Play regularization with a 2D pre-trained, deep denoiser for 2D post-stack seismic inversion. Additionally, we show that a generalization of Plug-and-Play, called Multi-Agent Consensus Equilibrium, can be adopted to solve 3D post-stack inversion whilst leveraging the same 2D pre-trained denoiser used in the 2D case. More precisely, Multi-Agent Consensus Equilibrium combines the results of applying such 2D denoiser in the inline, crossline, and time directions in an optimal manner. We verify the proposed methods on a portion of the SEAM Phase 1 velocity model and the Sleipner field dataset. 1 △ Less

Submitted 1 January, 2024; originally announced January 2024.

Comments: 24 pages, 10 figures

A reciprocity-aware, low-rank regularization for multidimensional deconvolution

Authors: Fuqiang Chen, Matteo Ravasi, David Keyes

Abstract: This paper presents a novel factorization-based, low-rank regularization method for solving multidimensional deconvolution problems in the frequency domain. In this approach, each frequency component of the unknown wavefield is represented as a complex-valued square matrix and approximated using the product of one rectangular matrix and its transpose. The benefit of such a parametrization is two-f… ▽ More This paper presents a novel factorization-based, low-rank regularization method for solving multidimensional deconvolution problems in the frequency domain. In this approach, each frequency component of the unknown wavefield is represented as a complex-valued square matrix and approximated using the product of one rectangular matrix and its transpose. The benefit of such a parametrization is two-fold: first, the size of the unknown matrix is greatly reduced compared to that of the original wavefield of interest (and halved compared to conventional factorization-based, low-rank approximations); second, the retrieved wavefield is implicitly guaranteed to comply with the reciprocity principle, as expected from theory. We further show that the proposed objective function can be successfully optimized using the accelerated proximal gradient algorithm and discuss a robust strategy to define the initial guess of the solution. Numerical examples on synthetic and field data demonstrate the effectiveness of the proposed method in compressing the retrieved Green's function while preserving its accuracy. △ Less

Submitted 28 October, 2024; v1 submitted 18 December, 2023; originally announced December 2023.

IntraSeismic: a coordinate-based learning approach to seismic inversion

Authors: Juan Romero, Wolfgang Heidrich, Nick Luiken, Matteo Ravasi

Abstract: Seismic imaging is the numerical process of creating a volumetric representation of the subsurface geological structures from elastic waves recorded at the surface of the Earth. As such, it is widely utilized in the energy and construction sectors for applications ranging from oil and gas prospection, to geothermal production and carbon capture and storage monitoring, to geotechnical assessment of… ▽ More Seismic imaging is the numerical process of creating a volumetric representation of the subsurface geological structures from elastic waves recorded at the surface of the Earth. As such, it is widely utilized in the energy and construction sectors for applications ranging from oil and gas prospection, to geothermal production and carbon capture and storage monitoring, to geotechnical assessment of infrastructures. Extracting quantitative information from seismic recordings, such as an acoustic impedance model, is however a highly ill-posed inverse problem, due to the band-limited and noisy nature of the data. This paper introduces IntraSeismic, a novel hybrid seismic inversion method that seamlessly combines coordinate-based learning with the physics of the post-stack modeling operator. Key features of IntraSeismic are i) unparalleled performance in 2D and 3D post-stack seismic inversion, ii) rapid convergence rates, iii) ability to seamlessly include hard constraints (i.e., well data) and perform uncertainty quantification, and iv) potential data compression and fast randomized access to portions of the inverted model. Synthetic and field data applications of IntraSeismic are presented to validate the effectiveness of the proposed method. △ Less

Submitted 16 December, 2023; originally announced December 2023.

Comments: -

Laterally constrained low-rank seismic data completion via cyclic-shear transform

Authors: David Vargas, Ivan Vasconcelos, Nick Luiken, Matteo Ravasi

Abstract: A crucial step in seismic data processing consists in reconstructing the wavefields at spatial locations where faulty or absent sources and/or receivers result in missing data. Several developments in seismic acquisition and interpolation strive to restore signals fragmented by sampling limitations; still, seismic data frequently remain poorly sampled in the source, receiver, or both coordinates.… ▽ More A crucial step in seismic data processing consists in reconstructing the wavefields at spatial locations where faulty or absent sources and/or receivers result in missing data. Several developments in seismic acquisition and interpolation strive to restore signals fragmented by sampling limitations; still, seismic data frequently remain poorly sampled in the source, receiver, or both coordinates. An intrinsic limitation of real-life dense acquisition systems, which are often exceedingly expensive, is that they remain unable to circumvent various physical and environmental obstacles, ultimately hindering a proper recording scheme. In many situations, when the preferred reconstruction method fails to render the actual continuous signals, subsequent imaging studies are negatively affected by sampling artefacts. A recent alternative builds on low-rank completion techniques to deliver superior restoration results on seismic data, paving the way for data kernel compression that can potentially unlock multiple modern processing methods so far prohibited in 3D field scenarios. In this work, we propose a novel transform domain revealing the low-rank character of seismic data that prevents the inherent matrix enlargement introduced when the data are sorted in the midpoint-offset domain and develop a robust extension of the current matrix completion framework to account for lateral physical constraints that ensure a degree of proximity similarity among neighbouring points. Our strategy successfully interpolates missing sources and receivers simultaneously in synthetic and field data. △ Less

Submitted 14 November, 2023; originally announced November 2023.

Seis2Rock: A Data-Driven Approach to Direct Petrophysical Inversion of Pre-Stack Seismic Data

Authors: Miguel Corrales, Hussein Hoteit, Matteo Ravasi

Abstract: The inversion of petrophysical parameters from seismic data represents a fundamental step in the process of characterizing the subsurface. We propose a novel, data-driven approach named Seis2Rock that utilizes optimal basis functions learned from well log information to directly link band-limited petrophysical reflectivities to pre-stack seismic data. Seis2Rock is composed of two stages: training… ▽ More The inversion of petrophysical parameters from seismic data represents a fundamental step in the process of characterizing the subsurface. We propose a novel, data-driven approach named Seis2Rock that utilizes optimal basis functions learned from well log information to directly link band-limited petrophysical reflectivities to pre-stack seismic data. Seis2Rock is composed of two stages: training and inference. During training, a set of optimal basis functions are identified by performing singular value decomposition on one or more synthetic AVO gathers created from measured or rock-physics synthesized elastic well-logs. In inference, seismic pre-stack data are first projected into a set of band-limited petrophysical properties using the previously computed basis functions; this is followed by regularized post-stack seismic inversion of the individual properties. In this work, we apply the Seis2Rock methodology to a synthetic dataset based on the Smeaheia reservoir model and the open Volve field dataset. Numerical results reveal the ability of the proposed method in recovering accurate porosity, shale content, and water saturation models. Finally, the proposed methodology is applied in the context of reservoir monitoring to invert time-lapse, pre-stack seismic data for water saturation changes. △ Less

Submitted 5 September, 2023; v1 submitted 16 July, 2023; originally announced July 2023.

Explainable Artificial Intelligence driven mask design for self-supervised seismic denoising

Authors: Claire Birnie, Matteo Ravasi

Abstract: The presence of coherent noise in seismic data leads to errors and uncertainties, and as such it is paramount to suppress noise as early and efficiently as possible. Self-supervised denoising circumvents the common requirement of deep learning procedures of having noisy-clean training pairs. However, self-supervised coherent noise suppression methods require extensive knowledge of the noise statis… ▽ More The presence of coherent noise in seismic data leads to errors and uncertainties, and as such it is paramount to suppress noise as early and efficiently as possible. Self-supervised denoising circumvents the common requirement of deep learning procedures of having noisy-clean training pairs. However, self-supervised coherent noise suppression methods require extensive knowledge of the noise statistics. We propose the use of explainable artificial intelligence approaches to see inside the black box that is the denoising network and use the gained knowledge to replace the need for any prior knowledge of the noise itself. This is achieved in practice by leveraging bias-free networks and the direct linear link between input and output provided by the associated Jacobian matrix; we show that a simple averaging of the Jacobian contributions over a number of randomly selected input pixels, provides an indication of the most effective mask to suppress noise present in the data. The proposed method therefore becomes a fully automated denoising procedure requiring no clean training labels or prior knowledge. Realistic synthetic examples with noise signals of varying complexities, ranging from simple time-correlated noise to complex pseudo rig noise propagating at the velocity of the ocean, are used to validate the proposed approach. Its automated nature is highlighted further by an application to two field datasets. Without any substantial pre-processing or any knowledge of the acquisition environment, the automatically identified blind-masks are shown to perform well in suppressing both trace-wise noise in common shot gathers from the Volve marine dataset and colored noise in post stack seismic images from a land seismic survey. △ Less

Submitted 13 July, 2023; originally announced July 2023.

PINNslope: seismic data interpolation and local slope estimation with physics informed neural networks

Authors: Francesco Brandolin, Matteo Ravasi, Tariq Alkhalifah

Abstract: Interpolation of aliased seismic data constitutes a key step in a seismic processing workflow to obtain high quality velocity models and seismic images. Building on the idea of describing seismic wavefields as a superposition of local plane waves, we propose to interpolate seismic data by utilizing a physics informed neural network (PINN). In the proposed framework, two feed-forward neural network… ▽ More Interpolation of aliased seismic data constitutes a key step in a seismic processing workflow to obtain high quality velocity models and seismic images. Building on the idea of describing seismic wavefields as a superposition of local plane waves, we propose to interpolate seismic data by utilizing a physics informed neural network (PINN). In the proposed framework, two feed-forward neural networks are jointly trained using the local plane wave differential equation as well as the available data as two terms in the objective function: a primary network assisted by positional encoding is tasked with reconstructing the seismic data, whilst an auxiliary, smaller network estimates the associated local slopes. Results on synthetic and field data validate the effectiveness of the proposed method in handling aliased (coarsely sampled) data and data with large gaps. Our method compares favorably against a classic least-squares inversion approach regularized by the local plane-wave equation as well as a PINN-based approach with a single network and pre-computed local slopes. We find that introducing a second network to estimate the local slopes whilst at the same time interpolating the aliased data enhances the overall reconstruction capabilities and convergence behavior of the primary network. Moreover, an additional positional encoding layer embedded as the first layer of the wavefield network confers to the network the ability to converge faster improving the accuracy of the data term. △ Less

Submitted 9 December, 2023; v1 submitted 25 May, 2023; originally announced May 2023.

Deep Learning-based extraction of surface wave dispersion curves from seismic shot gathers

Authors: Danilo Chamorro, Jiahua Zhao, Claire Birnie, Myrna Staring, Fliedner Moritz, Matteo Ravasi

Abstract: Multi-channel Analysis of Surface Waves (MASW) is a seismic method employed to obtain useful information about shear-wave velocities in the near surface. A fundamental step in this methodology is the extraction of dispersion curves from dispersion spectra, which are obtained after applying specific processing algorithms onto the recorded shot gathers. Whilst this extraction process can be automate… ▽ More Multi-channel Analysis of Surface Waves (MASW) is a seismic method employed to obtain useful information about shear-wave velocities in the near surface. A fundamental step in this methodology is the extraction of dispersion curves from dispersion spectra, which are obtained after applying specific processing algorithms onto the recorded shot gathers. Whilst this extraction process can be automated to some extent, it usually requires extensive quality control, which can be arduous for large datasets. We present a novel approach that leverages deep learning to identify a direct mapping between seismic shot gathers and their associated dispersion curves (for both fundamental and first modes), by-passing therefore the need to compute dispersion spectra. Given a site of interest, a set of 1D velocity and density models are created using prior knowledge of the local geology; pairs of seismic shot gathers and Rayleigh-wave phase dispersion curves are then numerically modeled and used to train a simplified residual network. The proposed approach is shown to achieve high quality predictions of dispersion curves on a synthetic test dataset and is, ultimately, successfully deployed on a field dataset. Various uncertainty quantification and CNN visualization techniques are also developed to assess the quality of the inference process and better understand the underlying learning process of the network. The predicted dispersion curves are finally inverted, and the resulting shear-wave velocity model is shown to be plausible and consistent with prior geological knowledge of the area. △ Less

Submitted 23 May, 2023; originally announced May 2023.

Physics reliable frugal uncertainty analysis for full waveform inversion

Authors: Muhammad Izzatullah, Matteo Ravasi, Tariq Alkhalifah

Abstract: Full waveform inversion (FWI) enables us to obtain high-resolution velocity models of the subsurface. However, estimating the associated uncertainties in the process is not trivial. Commonly, uncertainty estimation is performed within the Bayesian framework through sampling algorithms to estimate the posterior distribution and identify the associated uncertainty. Nevertheless, such an approach has… ▽ More Full waveform inversion (FWI) enables us to obtain high-resolution velocity models of the subsurface. However, estimating the associated uncertainties in the process is not trivial. Commonly, uncertainty estimation is performed within the Bayesian framework through sampling algorithms to estimate the posterior distribution and identify the associated uncertainty. Nevertheless, such an approach has to deal with complex posterior structures (e.g., multimodality), high-dimensional model parameters, and large-scale datasets, which lead to high computational demands and time-consuming procedures. As a result, uncertainty analysis is rarely performed, especially at the industrial scale, and thus, it drives practitioners away from utilizing it for decision-making. This work proposes a frugal approach to estimate uncertainty in FWI through the Stein Variational Gradient Descent (SVGD) algorithm by utilizing a relatively small number of velocity model particles. We warm-start the SVGD algorithm by perturbing the optimized velocity model obtained from a deterministic FWI procedure with random field-based perturbations. Such perturbations cover the scattering (i.e., high wavenumber) and the transmission (i.e., low wavenumber) components of FWI and, thus, represent the uncertainty of the FWI holistically. We demonstrate the proposed approach on the Marmousi model; we have learned that by utilizing a relatively small number of particles, the uncertainty map presents qualitatively reliable information that honours the physics of wave propagation at a reasonable cost, allowing for the potential for industrial-scale applications. Nevertheless, given that uncertainties are underestimated, we must be careful when incorporating them into downstream tasks of seismic-driven geological and reservoir modelling. △ Less

Submitted 13 May, 2023; originally announced May 2023.

Comments: Submitted to Geophysical Journal International (GJI)

Why POCS works, and how to make it better

Authors: Matteo Ravasi, Nick Luiken

Abstract: Projection Over Convex Sets (POCS) is one of the most widely used algorithms in geophysical data processing to interpolate seismic data. Whilst usually described as a modification of the Gerchberg-Saxton algorithm, a formal understanding of the underlying objective function and its implication for the associated optimization process is lacking to date in the literature. We show that the POCS algor… ▽ More Projection Over Convex Sets (POCS) is one of the most widely used algorithms in geophysical data processing to interpolate seismic data. Whilst usually described as a modification of the Gerchberg-Saxton algorithm, a formal understanding of the underlying objective function and its implication for the associated optimization process is lacking to date in the literature. We show that the POCS algorithm can be interpreted as the application of the Half-Quadratic Splitting (HQS) method to the $L_0$ norm of the projected sought after data (where the projection can be any orthonormal transformation), constrained on the available traces. Similarly, the popular, apparently heuristic strategy of using a decaying threshold in POCS is revealed to be the result of the continuation strategy that HQS must employ to converge to a solution of the minimizer. Finally, we prove that for off-the-grid receivers, the POCS algorithms must operate in an inner-outer fashion (i.e., an inverse problem is solved at each outer iteration). In light of our new theoretical understanding, we suggest the use of a modern solver such as the Chambolle-Pock Primal-Dual algorithm and show that this can lead to a new POCS-like method with superior interpolation capabilities at nearly the same computational cost of the industry-standard POCS method. △ Less

Submitted 21 April, 2023; v1 submitted 19 April, 2023; originally announced April 2023.

Comments: Journal paper

Seeing through the CO2 plume: joint inversion-segmentation of the Sleipner 4D Seismic Dataset

Authors: Juan Romero, Nick Luiken, Matteo Ravasi

Abstract: 4D seismic inversion is the leading method to quantitatively monitor fluid flow dynamics in the subsurface, with applications ranging from enhanced oil recovery to subsurface CO2 storage. The process of inverting seismic data for reservoir properties is, however, a notoriously ill-posed inverse problem due to the band-limited and noisy nature of seismic data. This comes with additional challenges… ▽ More 4D seismic inversion is the leading method to quantitatively monitor fluid flow dynamics in the subsurface, with applications ranging from enhanced oil recovery to subsurface CO2 storage. The process of inverting seismic data for reservoir properties is, however, a notoriously ill-posed inverse problem due to the band-limited and noisy nature of seismic data. This comes with additional challenges for 4D applications, given inaccuracies in the repeatability of the time-lapse acquisition surveys. Consequently, adding prior information to the inversion process in the form of properly crafted regularization terms is essential to obtain geologically meaningful subsurface models. Motivated by recent advances in the field of convex optimization, we propose a joint inversion-segmentation algorithm for 4D seismic inversion, which integrates Total-Variation and segmentation priors as a way to counteract the missing frequencies and noise present in 4D seismic data. The proposed inversion framework is applied to a pair of surveys from the open Sleipner 4D Seismic Dataset. Our method presents three main advantages over state-of-the-art least-squares inversion methods: 1. it produces high-resolution baseline and monitor acoustic models, 2. by leveraging similarities between multiple data, it mitigates the non-repeatable noise and better highlights the real time-lapse changes, and 3. it provides a volumetric classification of the acoustic impedance 4D difference model (time-lapse changes) based on user-defined classes. Such advantages may enable more robust stratigraphic and quantitative 4D seismic interpretation and provide more accurate inputs for dynamic reservoir simulations. Alongside our novel inversion method, in this work, we introduce a streamlined data pre-processing sequence for the 4D Sleipner post-stack seismic dataset, which includes time-shift estimation and well-to-seismic tie. △ Less

Submitted 21 March, 2023; originally announced March 2023.

Comments: This paper proposes a novel algorithm to jointly regularize a 4D seismic inversion problem and segment the 4D difference volume into percentages of acoustic impedance changes. We validate our algorithm with the 4D Sleipner seismic dataset. Furthermore, this paper comprehensively explains the data preparation workflow for 4D seismic inversion

Journal ref: Volume 42 Issue 7 Jul 2023 Pages 446 516

Posterior sampling with CNN-based, Plug-and-Play regularization with applications to Post-Stack Seismic Inversion

Authors: Muhammad Izzatullah, Tariq Alkhalifah, Juan Romero, Miguel Corrales, Nick Luiken, Matteo Ravasi

Abstract: Uncertainty quantification is crucial to inverse problems, as it could provide decision-makers with valuable information about the inversion results. For example, seismic inversion is a notoriously ill-posed inverse problem due to the band-limited and noisy nature of seismic data. It is therefore of paramount importance to quantify the uncertainties associated to the inversion process to ease the… ▽ More Uncertainty quantification is crucial to inverse problems, as it could provide decision-makers with valuable information about the inversion results. For example, seismic inversion is a notoriously ill-posed inverse problem due to the band-limited and noisy nature of seismic data. It is therefore of paramount importance to quantify the uncertainties associated to the inversion process to ease the subsequent interpretation and decision making processes. Within this framework of reference, sampling from a target posterior provides a fundamental approach to quantifying the uncertainty in seismic inversion. However, selecting appropriate prior information in a probabilistic inversion is crucial, yet non-trivial, as it influences the ability of a sampling-based inference in providing geological realism in the posterior samples. To overcome such limitations, we present a regularized variational inference framework that performs posterior inference by implicitly regularizing the Kullback-Leibler divergence loss with a CNN-based denoiser by means of the Plug-and-Play methods. We call this new algorithm Plug-and-Play Stein Variational Gradient Descent (PnP-SVGD) and demonstrate its ability in producing high-resolution, trustworthy samples representative of the subsurface structures, which we argue could be used for post-inference tasks such as reservoir modelling and history matching. To validate the proposed method, numerical tests are performed on both synthetic and field post-stack seismic data. △ Less

Submitted 30 December, 2022; originally announced December 2022.

Comments: It will be submitted for journal publication

Wavefield reconstruction inversion modelling of Marchenko focusing functions

Authors: Ruhul F. Hajjaj, Sjoerd A. L. de Ridder, Philip W. Livermore, Matteo Ravasi

Abstract: Marchenko focusing functions are in their essence wavefields that satisfy the wave equation subject to a set of boundary, initial, and focusing conditions. Here, we show how Marchenko focusing functions can be modeled by finding the solution to a wavefield reconstruction inversion problem. Our solution yields all elements of the focusing function including evanescent, refracted, and trapped waves… ▽ More Marchenko focusing functions are in their essence wavefields that satisfy the wave equation subject to a set of boundary, initial, and focusing conditions. Here, we show how Marchenko focusing functions can be modeled by finding the solution to a wavefield reconstruction inversion problem. Our solution yields all elements of the focusing function including evanescent, refracted, and trapped waves (tunneling). Our examples indicate that focusing function solutions in higher dimensions are however challenging to compute by numerical means due to the appearance of strong evanescent waves. △ Less

Submitted 26 October, 2022; originally announced October 2022.

Comments: This document constitutes a summary of results in the PhD Transfer Report of R.F. Hajjaj, successfully defended on October 19th, 2022

Deep Preconditioners and their application to seismic wavefield processing

Authors: Matteo Ravasi

Abstract: Seismic data processing heavily relies on the solution of physics-driven inverse problems. In the presence of unfavourable data acquisition conditions (e.g., regular or irregular coarse sampling of sources and/or receivers), the underlying inverse problem becomes very ill-posed and prior information is required to obtain a satisfactory solution. Sparsity-promoting inversion, coupled with fixed-bas… ▽ More Seismic data processing heavily relies on the solution of physics-driven inverse problems. In the presence of unfavourable data acquisition conditions (e.g., regular or irregular coarse sampling of sources and/or receivers), the underlying inverse problem becomes very ill-posed and prior information is required to obtain a satisfactory solution. Sparsity-promoting inversion, coupled with fixed-basis sparsifying transforms, represent the go-to approach for many processing tasks due to its simplicity of implementation and proven successful application in a variety of acquisition scenarios. Leveraging the ability of deep neural networks to find compact representations of complex, multi-dimensional vector spaces, we propose to train an AutoEncoder network to learn a direct mapping between the input seismic data and a representative latent manifold. The trained decoder is subsequently used as a nonlinear preconditioner for the physics-driven inverse problem at hand. Synthetic and field data are presented for a variety of seismic processing tasks and the proposed nonlinear, learned transformations are shown to outperform fixed-basis transforms and convergence faster to the sought solution. △ Less

Submitted 20 July, 2022; originally announced July 2022.

A hybrid approach to seismic deblending: when physics meets self-supervision

Authors: Nick Luiken, Matteo Ravasi, Claire E. Birnie

Abstract: To limit the time, cost, and environmental impact associated with the acquisition of seismic data, in recent decades considerable effort has been put into so-called simultaneous shooting acquisitions, where seismic sources are fired at short time intervals between each other. As a consequence, waves originating from consecutive shots are entangled within the seismic recordings, yielding so-called… ▽ More To limit the time, cost, and environmental impact associated with the acquisition of seismic data, in recent decades considerable effort has been put into so-called simultaneous shooting acquisitions, where seismic sources are fired at short time intervals between each other. As a consequence, waves originating from consecutive shots are entangled within the seismic recordings, yielding so-called blended data. For processing and imaging purposes, the data generated by each individual shot must be retrieved. This process, called deblending, is achieved by solving an inverse problem which is heavily underdetermined. Conventional approaches rely on transformations that render the blending noise into burst-like noise, whilst preserving the signal of interest. Compressed sensing type regularization is then applied, where sparsity in some domain is assumed for the signal of interest. The domain of choice depends on the geometry of the acquisition and the properties of seismic data within the chosen domain. In this work, we introduce a new concept that consists of embedding a self-supervised denoising network into the Plug-and-Play (PnP) framework. A novel network is introduced whose design extends the blind-spot network architecture of [28 ] for partially coherent noise (i.e., correlated in time). The network is then trained directly on the noisy input data at each step of the PnP algorithm. By leveraging both the underlying physics of the problem and the great denoising capabilities of our blind-spot network, the proposed algorithm is shown to outperform an industry-standard method whilst being comparable in terms of computational cost. Moreover, being independent on the acquisition geometry, our method can be easily applied to both marine and land data without any significant modification. △ Less

Submitted 30 May, 2022; originally announced May 2022.

Comments: 21 pages, 15 figures

Stochastic Multi-Dimensional Deconvolution

Authors: Matteo Ravasi, Tamil Selvan, Nick Luiken

Abstract: Seismic datasets contain valuable information that originate from areas of interest in the subsurface; such seismic reflections are however inevitably contaminated by other events created by waves reverberating in the overburden. Multi-Dimensional Deconvolution (MDD) is a powerful technique used at various stages of the seismic processing sequence to create ideal datasets deprived of such overburd… ▽ More Seismic datasets contain valuable information that originate from areas of interest in the subsurface; such seismic reflections are however inevitably contaminated by other events created by waves reverberating in the overburden. Multi-Dimensional Deconvolution (MDD) is a powerful technique used at various stages of the seismic processing sequence to create ideal datasets deprived of such overburden effects. Whilst the underlying forward problem is well defined for a single source, a successful inversion of the MDD equations requires availability of a large number of sources alongside prior information introduced in the form of physical preconditioners (e.g., reciprocity). In this work, we reinterpret the cost function of time-domain MDD as a finite-sum functional, and solve the associated inverse problem by means of stochastic gradient descent algorithms, where gradients are computed using a small subset of randomly selected sources. Through synthetic and field data examples, the proposed method is shown to converge more stably than the conventional approach based on full gradients. Stochastic MDD represents a novel, efficient, and robust strategy to deconvolve seismic wavefields in a multi-dimensional fashion. △ Less

Submitted 9 February, 2022; originally announced February 2022.

Target-enclosing inversion using an interferometric objective function

Authors: Polina Zheglova, Matteo Ravasi, Ivan Vasconcelos, Alison Malcolm

Abstract: Full waveform inversion is a high-resolution subsurface imaging technique, in which full seismic waveforms are used to infer subsurface physical properties. We present a novel, target-enclosing, full-waveform inversion framework based on an interferometric objective function. This objective function exploits the equivalence between the convolution and correlation representation formulas, using dat… ▽ More Full waveform inversion is a high-resolution subsurface imaging technique, in which full seismic waveforms are used to infer subsurface physical properties. We present a novel, target-enclosing, full-waveform inversion framework based on an interferometric objective function. This objective function exploits the equivalence between the convolution and correlation representation formulas, using data from a closed boundary around the target area of interest. Because such equivalence is violated when the knowledge of the enclosed medium is incorrect, we propose to minimize the mismatch between the wavefields independently reconstructed by the two representation formulas. The proposed method requires only kinematic knowledge of the subsurface model, specifically the overburden for redatuming, and does not require prior knowledge of the model below the target area. In this sense it is truly local: sensitive only to the medium parameters within the chosen target, with no assumptions about the medium or scattering regime outside the target. We present the theoretical framework and derive the gradient of the new objective function via the adjoint-state method and apply it to a synthetic example with exactly redatumed wavefields. A comparison with FWI of surface data and target-oriented FWI based on the convolution representation theorem only shows the superiority of our method both in terms of the quality of target recovery and reduction in computational cost. △ Less

Submitted 18 January, 2022; originally announced January 2022.

The potential of self-supervised networks for random noise suppression in seismic data

Authors: Claire Birnie, Matteo Ravasi, Tariq Alkhalifah, Sixiu Liu

Abstract: Noise suppression is an essential step in any seismic processing workflow. A portion of this noise, particularly in land datasets, presents itself as random noise. In recent years, neural networks have been successfully used to denoise seismic data in a supervised fashion. However, supervised learning always comes with the often unachievable requirement of having noisy-clean data pairs for trainin… ▽ More Noise suppression is an essential step in any seismic processing workflow. A portion of this noise, particularly in land datasets, presents itself as random noise. In recent years, neural networks have been successfully used to denoise seismic data in a supervised fashion. However, supervised learning always comes with the often unachievable requirement of having noisy-clean data pairs for training. Using blind-spot networks, we redefine the denoising task as a self-supervised procedure where the network uses the surrounding noisy samples to estimate the noise-free value of a central sample. Based on the assumption that noise is statistically independent between samples, the network struggles to predict the noise component of the sample due to its randomnicity, whilst the signal component is accurately predicted due to its spatio-temporal coherency. Illustrated on synthetic examples, the blind-spot network is shown to be an efficient denoiser of seismic data contaminated by random noise with minimal damage to the signal; therefore, providing improvements in both the image domain and down-the-line tasks, such as inversion. To conclude the study, the suggested approach is applied to field data and the results are compared with two commonly used random denoising techniques: FX-deconvolution and Curvelet transform. By demonstrating that blind-spot networks are an efficient suppressor of random noise, we believe this is just the beginning of utilising self-supervised learning in seismic applications. △ Less

Submitted 15 September, 2021; originally announced September 2021.

Cycle-skipping mitigation using misfit measurements based on differentiable dynamic time warping

Authors: Fuqiang Chen, Daniel Peter, Matteo Ravasi

Abstract: The dynamic time warping (DTW) distance has been used as a misfit function for wave-equation inversion to mitigate the local minima issue. However, the original DTW distance is not smooth; therefore it can yield a strong discontinuity in the adjoint source. Such a weakness does not help nonlinear inverse problems converge to a plausible minimum by any means. We therefore introduce for the first ti… ▽ More The dynamic time warping (DTW) distance has been used as a misfit function for wave-equation inversion to mitigate the local minima issue. However, the original DTW distance is not smooth; therefore it can yield a strong discontinuity in the adjoint source. Such a weakness does not help nonlinear inverse problems converge to a plausible minimum by any means. We therefore introduce for the first time in geophysics the smooth DTW distance, which has demonstrated its performance in time series classification, clustering, and prediction as the loss function. The fundamental idea of such a distance is to replace the $\min$ operator with its smooth relaxation. Then it becomes possible to define the analytic derivative of DTW distance. The new misfit function is entitled to the differentiable DTW distance. Moreover, considering that the warping path is an indicator of the traveltime difference between the observed and synthetic trace, a penalization term is constructed based on the warping path such that the misfit accumulation by the penalized differentiable DTW distance is weighted in favor of the traveltime difference. Numerical examples demonstrate the advantage of the penalized differentiable DTW misfit function over the conventional non-differentiable one. △ Less

Submitted 7 December, 2021; v1 submitted 9 September, 2021; originally announced September 2021.

A Joint Inversion-Segmentation approach to Assisted Seismic Interpretation

Authors: Matteo Ravasi, Claire Emma Birnie

Abstract: Structural seismic interpretation and quantitative characterization are historically intertwined processes. The latter provides estimates of properties of the subsurface which can be used to aid structural interpretation alongside the original seismic data and a number of other seismic attributes. In this work, we redefine this process as a inverse problem which tries to jointly estimate subsurfac… ▽ More Structural seismic interpretation and quantitative characterization are historically intertwined processes. The latter provides estimates of properties of the subsurface which can be used to aid structural interpretation alongside the original seismic data and a number of other seismic attributes. In this work, we redefine this process as a inverse problem which tries to jointly estimate subsurface properties (i.e., acoustic impedance) and a piece-wise segmented representation of the subsurface based on user-defined macro-classes. By inverting for the quantities simultaneously, the inversion is primed with prior knowledge about the regions of interest, whilst at the same time it constrains this belief with the actual seismic measurements. As the proposed functional is separable in the two quantities, these are optimized in an alternating fashion, where each subproblem is solved using a Primal-Dual algorithm. Subsequently, each class is used as input to a workflow which aims to extract the perimeter of the detected shapes and to produce unique horizons. The effectiveness of the proposed method is illustrated through numerical examples on synthetic and field datasets. △ Less

Submitted 7 February, 2021; originally announced February 2021.

On the implementation of large-scale integral operators with modern HPC solutions -- Application to 3D Marchenko imaging by least-squares inversion

Authors: Matteo Ravasi, Ivan Vasconcelos

Abstract: Numerical integral operators of convolution type form the basis of most wave-equation-based methods for processing and imaging of seismic data. As several of these methods require the solution of an inverse problem, multiple forward and adjoint passes of the modelling operator must be performed to converge to a satisfactory solution. This work highlights the challenges that arise when implementing… ▽ More Numerical integral operators of convolution type form the basis of most wave-equation-based methods for processing and imaging of seismic data. As several of these methods require the solution of an inverse problem, multiple forward and adjoint passes of the modelling operator must be performed to converge to a satisfactory solution. This work highlights the challenges that arise when implementing such operators on 3D seismic datasets and it provides insights into their usage for solving large systems of integral equations. A Python framework is presented that leverages libraries for distributed storage and computing, and provides an high-level symbolic representation of linear operators. To validate its effectiveness, the forward and adjoint implementations of a multi-dimensional convolution operator are evaluated with respect to increasing size of the kernel and number of computational resources. Our computational framework is further shown to be suitable for both classic on-premise High-Performance Computing and cloud computing architectures. An example of target-oriented imaging of a 3D synthetic dataset which comprises of two subsequent steps of seismic redatuming is finally presented. In both cases, the redatumed fields are estimated by means of least-squares inversion using the full dataset as well as spatially decimated versions of the dataset as a way to investigate the robustness of both inverse problems to spatial aliasing in the input dataset. We observe that less strict sampling requirements apply in three dimensions for these algorithms compared to their two dimensions counterparts. Whilst aliasing introduces noise in the redatumed fields, they are however deprived of the well-known spurious artefacts arising from incorrect handling of the overburden propagation in cheaper, adjoint-based redatuming techniques. △ Less

Submitted 22 November, 2020; originally announced November 2020.