Showing 1–12 of 12 results for author: Wildey, T

Optimal Experimental Design Criteria for Data-Consistent Inversion

Authors: Troy Butler, John Jakeman, Michael Pilosov, Scott Walsh, Timothy Wildey

Abstract: The ability to design effective experiments is crucial for obtaining data that can substantially reduce the uncertainty in the predictions made using computational models. An optimal experimental design (OED) refers to the choice of a particular experiment that optimizes a particular design criteria, e.g., maximizing a utility function, which measures the information content of the data. However,… ▽ More The ability to design effective experiments is crucial for obtaining data that can substantially reduce the uncertainty in the predictions made using computational models. An optimal experimental design (OED) refers to the choice of a particular experiment that optimizes a particular design criteria, e.g., maximizing a utility function, which measures the information content of the data. However, traditional approaches for optimal experimental design typically require solving a large number of computationally intensive inverse problems to find the data that maximizes the utility function. Here, we introduce two novel OED criteria that are specifically crafted for the data consistent inversion (DCI) framework, but do not require solving inverse problems. DCI is a specific approach for solving a class of stochastic inverse problems by constructing a pullback measure on uncertain parameters from an observed probability measure on the outputs of a quantity of interest (QoI) map. While expected information gain (EIG) has been used for both DCI and Bayesian based OED, the characteristics and properties of DCI solutions differ from those of solutions to Bayesian inverse problems which should be reflected in the OED criteria. The new design criteria developed in this study, called the expected scaling effect and the expected skewness effect, leverage the geometric structure of pre-images associated with observable data sets, allowing for an intuitive and computationally efficient approach to OED. These criteria utilize singular value computations derived from sampled and approximated Jacobians of the experimental designs. We present both simultaneous and sequential (greedy) formulations of OED based on these innovative criteria. Numerical results demonstrate the effectiveness in our approach for solving stochastic inverse problems. △ Less

Submitted 13 June, 2025; originally announced June 2025.

R-Adaptive Mesh Optimization to Enhance Finite Element Basis Compression

Authors: Graham Harper, Denis Ridzal, Tim Wildey

Abstract: Modern computing systems are capable of exascale calculations, which are revolutionizing the development and application of high-fidelity numerical models in computational science and engineering. While these systems continue to grow in processing power, the available system memory has not increased commensurately, and electrical power consumption continues to grow. A predominant approach to limit… ▽ More Modern computing systems are capable of exascale calculations, which are revolutionizing the development and application of high-fidelity numerical models in computational science and engineering. While these systems continue to grow in processing power, the available system memory has not increased commensurately, and electrical power consumption continues to grow. A predominant approach to limit the memory usage in large-scale applications is to exploit the abundant processing power and continually recompute many low-level simulation quantities, rather than storing them. However, this approach can adversely impact the throughput of the simulation and diminish the benefits of modern computing architectures. We present two novel contributions to reduce the memory burden while maintaining performance in simulations based on finite element discretizations. The first contribution develops dictionary-based data compression schemes that detect and exploit the structure of the discretization, due to redundancies across the finite element mesh. These schemes are shown to reduce memory requirements by more than 99 percent on meshes with large numbers of nearly identical mesh cells. For applications where this structure does not exist, our second contribution leverages a recently developed augmented Lagrangian sequential quadratic programming algorithm to enable r-adaptive mesh optimization, with the goal of enhancing redundancies in the mesh. Numerical results demonstrate the effectiveness of the proposed methods to detect, exploit and enhance mesh structure on examples inspired by large-scale applications. △ Less

Submitted 10 October, 2024; originally announced October 2024.

Comments: 22 pages

A Distributions-based Approach for Data-Consistent Inversion

Authors: Kirana Bergstrom, Troy Butler, Tim Wildey

Abstract: We formulate a novel approach to solve a class of stochastic problems, referred to as data-consistent inverse (DCI) problems, which involve the characterization of a probability measure on the parameters of a computational model whose subsequent push-forward matches an observed probability measure on specified quantities of interest (QoI) typically associated with the outputs from the computationa… ▽ More We formulate a novel approach to solve a class of stochastic problems, referred to as data-consistent inverse (DCI) problems, which involve the characterization of a probability measure on the parameters of a computational model whose subsequent push-forward matches an observed probability measure on specified quantities of interest (QoI) typically associated with the outputs from the computational model. Whereas prior DCI solution methodologies focused on either constructing non-parametric estimates of the densities or the probabilities of events associated with the pre-image of the QoI map, we develop and analyze a constrained quadratic optimization approach based on estimating push-forward measures using weighted empirical distribution functions. The method proposed here is more suitable for low-data regimes or high-dimensional problems than the density-based method, as well as for problems where the probability measure does not admit a density. Numerical examples are included to demonstrate the performance of the method and to compare with the density-based approach where applicable. △ Less

Submitted 18 April, 2024; originally announced April 2024.

Comments: 26 pages, 19 figures

MSC Class: 28A50; 65K10; 62G07

Convergence of Probability Densities using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification: Extensions to $L^p$

Authors: Troy Butler, Tim Wildey, Wenjuan Zhang

Abstract: A previous study analyzed the convergence of probability densities for forward and inverse problems when a sequence of approximate maps between model inputs and outputs converges in $L^\infty$. This work generalizes the analysis to cases where the approximate maps converge in $L^p$ for any $1\leq p < \infty$. Specifically, under the assumption that the approximate maps converge in $L^p$, the conve… ▽ More A previous study analyzed the convergence of probability densities for forward and inverse problems when a sequence of approximate maps between model inputs and outputs converges in $L^\infty$. This work generalizes the analysis to cases where the approximate maps converge in $L^p$ for any $1\leq p < \infty$. Specifically, under the assumption that the approximate maps converge in $L^p$, the convergence of probability density functions solving either forward or inverse problems is proven in $L^q$ where the value of $1\leq q<\infty$ may even be greater than $p$ in certain cases. This greatly expands the applicability of the previous results to commonly used methods for approximating models (such as polynomial chaos expansions) that only guarantee $L^p$ convergence for some $1\leq p<\infty$. Several numerical examples are also included along with numerical diagnostics of solutions and verification of assumptions made in the analysis. △ Less

Submitted 13 January, 2020; originally announced January 2020.

Unified geometric multigrid algorithm for hybridized high-order finite element methods

Authors: Tim Wildey, Sriramkrishnan Muralikrishnan, Tan Bui-Thanh

Abstract: We consider a standard elliptic partial differential equation and propose a geometric multigrid algorithm based on Dirichlet-to-Neumann (DtN) maps for hybridized high-order finite element methods. The proposed unified approach is applicable to any locally conservative hybridized finite element method including multinumerics with different hybridized methods in different parts of the domain. For th… ▽ More We consider a standard elliptic partial differential equation and propose a geometric multigrid algorithm based on Dirichlet-to-Neumann (DtN) maps for hybridized high-order finite element methods. The proposed unified approach is applicable to any locally conservative hybridized finite element method including multinumerics with different hybridized methods in different parts of the domain. For these methods, the linear system involves only the unknowns residing on the mesh skeleton, and constructing intergrid transfer operators is therefore not trivial. The key to our geometric multigrid algorithm is the physics-based energy-preserving intergrid transfer operators which depend only on the fine scale DtN maps. Thanks to these operators, we completely avoid upscaling of parameters and no information regarding subgrid physics is explicitly required on coarse meshes. Moreover, our algorithm is agglomeration-based and can straightforwardly handle unstructured meshes. We perform extensive numerical studies with hybridized mixed methods, hybridized discontinuous Galerkin method, weak Galerkin method, and a hybridized version of interior penalty discontinuous Galerkin methods on a range of elliptic problems including subsurface flow through highly heterogeneous porous media. We compare the performance of different smoothers and analyze the effect of stabilization parameters on the scalability of the multigrid algorithm. △ Less

Submitted 24 November, 2018; originally announced November 2018.

Convergence of Probability Densities using Approximate Models for Forward and Inverse Problems in Uncertainty Quantification

Authors: T. Butler, J. D. Jakeman, T. Wildey

Abstract: We analyze the convergence of probability density functions utilizing approximate models for both forward and inverse problems. We consider the standard forward uncertainty quantification problem where an assumed probability density on parameters is propagated through the approximate model to produce a probability density, often called a push-forward probability density, on a set of quantities of… ▽ More We analyze the convergence of probability density functions utilizing approximate models for both forward and inverse problems. We consider the standard forward uncertainty quantification problem where an assumed probability density on parameters is propagated through the approximate model to produce a probability density, often called a push-forward probability density, on a set of quantities of interest (QoI). The inverse problem considered in this paper seeks a posterior probability density on model input parameters such that the subsequent push-forward density through the parameter-to-QoI map matches a given probability density on the QoI. We prove that the probability densities obtained from solving the forward and inverse problems, using approximate models, converge to the true probability densities as the approximate models converges to the true models. Numerical results are presented to demonstrate optimal convergence of probability densities for sparse grid approximations of parameter-to-QoI maps and standard spatial and temporal discretizations of PDEs and ODEs. △ Less

Submitted 1 July, 2018; originally announced July 2018.

MSC Class: 60H30; 60H35; 60B10

Optimal Experimental Design Using A Consistent Bayesian Approach

Authors: Scott N. Walsh, Tim M. Wildey, John D. Jakeman

Abstract: We consider the utilization of a computational model to guide the optimal acquisition of experimental data to inform the stochastic description of model input parameters. Our formulation is based on the recently developed consistent Bayesian approach for solving stochastic inverse problems which seeks a posterior probability density that is consistent with the model and the data in the sense that… ▽ More We consider the utilization of a computational model to guide the optimal acquisition of experimental data to inform the stochastic description of model input parameters. Our formulation is based on the recently developed consistent Bayesian approach for solving stochastic inverse problems which seeks a posterior probability density that is consistent with the model and the data in the sense that the push-forward of the posterior (through the computational model) matches the observed density on the observations almost everywhere. Given a set a potential observations, our optimal experimental design (OED) seeks the observation, or set of observations, that maximizes the expected information gain from the prior probability density on the model parameters. We discuss the characterization of the space of observed densities and a computationally efficient approach for rescaling observed densities to satisfy the fundamental assumptions of the consistent Bayesian approach. Numerical results are presented to compare our approach with existing OED methodologies using the classical/statistical Bayesian approach and to demonstrate our OED on a set of representative PDE-based models. △ Less

Submitted 25 May, 2017; originally announced May 2017.

MSC Class: 60H30; 60H35; 60B10

A Consistent Bayesian Formulation for Stochastic Inverse Problems Based on Push-forward Measures

Authors: T. Butler, J. D. Jakeman, T. Wildey

Abstract: We formulate, and present a numerical method for solving, an inverse problem for inferring parameters of a deterministic model from stochastic observational data (quantities of interest). The solution, given as a probability measure, is derived using a Bayesian updating approach for measurable maps that finds a posterior probability measure, that when propagated through the deterministic model pro… ▽ More We formulate, and present a numerical method for solving, an inverse problem for inferring parameters of a deterministic model from stochastic observational data (quantities of interest). The solution, given as a probability measure, is derived using a Bayesian updating approach for measurable maps that finds a posterior probability measure, that when propagated through the deterministic model produces a push-forward measure that exactly matches the observed probability measure on the data. Our approach for finding such posterior measures, which we call consistent Bayesian inference, is simple and only requires the computation of the push-forward probability measure induced by the combination of a prior probability measure and the deterministic model. We establish existence and uniqueness of observation-consistent posteriors and present stability and error analysis. We also discuss the relationships between consistent Bayesian inference, classical/statistical Bayesian inference, and a recently developed measure-theoretic approach for inference. Finally, analytical and numerical results are presented to highlight certain properties of the consistent Bayesian approach and the differences between this approach and the two aforementioned alternatives for inference. △ Less

Submitted 3 April, 2017; originally announced April 2017.

MSC Class: 60H30; 60H35; 60B10

Dimension reduction in MHD power generation models: dimensional analysis and active subspaces

Authors: Andrew Glaws, Paul G. Constantine, John Shadid, Timothy M. Wildey

Abstract: Magnetohydrodynamics (MHD)---the study of electrically conducting fluids---can be harnessed to produce efficient, low-emissions power generation. Today, computational modeling assists engineers in studying candidate designs for such generators. However, these models are computationally expensive, so studying the effects of the model's many input parameters on output predictions is typically infeas… ▽ More Magnetohydrodynamics (MHD)---the study of electrically conducting fluids---can be harnessed to produce efficient, low-emissions power generation. Today, computational modeling assists engineers in studying candidate designs for such generators. However, these models are computationally expensive, so studying the effects of the model's many input parameters on output predictions is typically infeasible. We study two approaches for reducing the input dimension of the models: (i) classical dimensional analysis based on the inputs' units and (ii) active subspaces, which reveal low-dimensional subspaces in the space of inputs that affect the outputs the most. We also review the mathematical connection between the two approaches that leads to consistent application. The dimension reduction yields insights into the driving factors in the MHD power generation models. We study both the simplified Hartmann problem, which admits closed form expressions for the quantities of interest, and a large-scale computational model with adjoint capabilities that enable the derivative computations needed to estimate the active subspaces. △ Less

Submitted 5 September, 2016; originally announced September 2016.

Solving Stochastic Inverse Problems using Sigma-Algebras on Contour Maps

Authors: Troy Butler, Don Estep, Simon Tavener, Timothy Wildey, Clint Dawson, Lindley Graham

Abstract: We compute approximate solutions to inverse problems for determining parameters in differential equation models with stochastic data on output quantities. The formulation of the problem and modeling framework define a solution as a probability measure on the parameter domain for a given $σ-$algebra. In the case where the number of output quantities is less than the number of parameters, the invers… ▽ More We compute approximate solutions to inverse problems for determining parameters in differential equation models with stochastic data on output quantities. The formulation of the problem and modeling framework define a solution as a probability measure on the parameter domain for a given $σ-$algebra. In the case where the number of output quantities is less than the number of parameters, the inverse of the map from parameters to data defines a type of generalized contour map. The approximate contour maps define a geometric structure on events in the $σ-$algebra for the parameter domain. We develop and analyze an inherently non-intrusive method of sampling the parameter domain and events in the given $σ-$algebra to approximate the probability measure. We use results from stochastic geometry for point processes to prove convergence of a random sample based approximation method. We define a numerical $σ-$algebra on which we compute probabilities and derive computable estimates for the error in the probability measure. We present numerical results to illustrate the various sources of error for a model of fluid flow past a cylinder. △ Less

Submitted 14 July, 2014; originally announced July 2014.

Comments: 26 pages, 24 figures

MSC Class: 28-02; 28C99; 97N40; 34A45; 60F99

Enhancing adaptive sparse grid approximations and improving refinement strategies using adjoint-based a posteriori error estimates

Authors: John D. Jakeman, Timothy Wildey

Abstract: In this paper we present an algorithm for adaptive sparse grid approximations of quantities of interest computed from discretized partial differential equations. We use adjoint-based a posteriori error estimates of the physical discretization error and the interpolation error in the sparse grid to enhance the sparse grid approximation and to drive adaptivity of the sparse grid. Utilizing these err… ▽ More In this paper we present an algorithm for adaptive sparse grid approximations of quantities of interest computed from discretized partial differential equations. We use adjoint-based a posteriori error estimates of the physical discretization error and the interpolation error in the sparse grid to enhance the sparse grid approximation and to drive adaptivity of the sparse grid. Utilizing these error estimates provides significantly more accurate functional values for random samples of the sparse grid approximation. We also demonstrate that alternative refinement strategies based upon a posteriori error estimates can lead to further increases in accuracy in the approximation over traditional hierarchical surplus based strategies. Throughout this paper we also provide and test a framework for balancing the physical discretization error with the stochastic interpolation error of the enhanced sparse grid approximation. △ Less

Submitted 3 July, 2014; originally announced July 2014.

Efficient uncertainty propagation for network multiphysics systems

Authors: Paul G. Constantine, Eric T. Phipps, Timothy M. Wildey

Abstract: We consider a multiphysics system with multiple component models coupled together through network coupling interfaces, i.e., a handful of scalars. If each component model contains uncertainties represented by a set of parameters, a straightfoward uncertainty quantification (UQ) study would collect all uncertainties into a single set and treat the multiphysics model as a black box. Such an approach… ▽ More We consider a multiphysics system with multiple component models coupled together through network coupling interfaces, i.e., a handful of scalars. If each component model contains uncertainties represented by a set of parameters, a straightfoward uncertainty quantification (UQ) study would collect all uncertainties into a single set and treat the multiphysics model as a black box. Such an approach ignores the rich structure of the multiphysics system, and the combined space of uncertainties can have a large dimension that prohibits the use of polynomial surrogate models. We propose an intrusive methodology that exploits the structure of the network coupled multiphysics system to efficiently construct a polynomial surrogate of the model output as a function of uncertain inputs. Using a nonlinear elimination strategy, we treat the solution as a composite function: the model outputs are functions of the coupling terms which are functions of the uncertain parameters. The composite structure allows us to construct and employ a reduced polynomial basis that depends on the coupling terms; the basis can be constructed with many fewer system solves than the naive approach, which results in substantial computational savings. We demonstrate the method on an idealized model of a nuclear reactor. △ Less

Submitted 29 August, 2013; originally announced August 2013.