-
Conditional Korhunen-Loéve regression model with Basis Adaptation for high-dimensional problems: uncertainty quantification and inverse modeling
Authors:
Yu-Hong Yeung,
Ramakrishna Tipireddy,
David A. Barajas-Solano,
Alexandre M. Tartakovsky
Abstract:
We propose a methodology for improving the accuracy of surrogate models of the observable response of physical systems as a function of the systems' spatially heterogeneous parameter fields with applications to uncertainty quantification and parameter estimation in high-dimensional problems. Practitioners often formulate finite-dimensional representations of spatially heterogeneous parameter field…
▽ More
We propose a methodology for improving the accuracy of surrogate models of the observable response of physical systems as a function of the systems' spatially heterogeneous parameter fields with applications to uncertainty quantification and parameter estimation in high-dimensional problems. Practitioners often formulate finite-dimensional representations of spatially heterogeneous parameter fields using truncated unconditional Karhunen-Loéve expansions (KLEs) for a certain choice of unconditional covariance kernel and construct surrogate models of the observable response with respect to the random variables in the KLE. When direct measurements of the parameter fields are available, we propose improving the accuracy of these surrogate models by representing the parameter fields via conditional Karhunen-Loéve expansions (CKLEs). CKLEs are constructed by conditioning the covariance kernel of the unconditional expansion on the direct measurements via Gaussian process regression and then truncating the corresponding KLE. We apply the proposed methodology to constructing surrogate models via the Basis Adaptation (BA) method of the stationary hydraulic head response, measured at spatially discrete observation locations, of a groundwater flow model of the Hanford Site, as a function of the 1,000-dimensional representation of the model's log-transmissivity field. We find that BA surrogate models of the hydraulic head based on CKLEs are more accurate than BA surrogate models based on unconditional expansions for forward uncertainty quantification tasks. Furthermore, we find that inverse estimates of the hydraulic transmissivity field computed using CKLE-based BA surrogate models are more accurate than those computed using unconditional BA surrogate models.
△ Less
Submitted 5 July, 2023;
originally announced July 2023.
-
Lorenz System State Stability Identification using Neural Networks
Authors:
Megha Subramanian,
Ramakrishna Tipireddy,
Samrat Chatterjee
Abstract:
Nonlinear dynamical systems such as Lorenz63 equations are known to be chaotic in nature and sensitive to initial conditions. As a result, a small perturbation in the initial conditions results in deviation in state trajectory after a few time steps. The algorithms and computational resources needed to accurately identify the system states vary depending on whether the solution is in transition re…
▽ More
Nonlinear dynamical systems such as Lorenz63 equations are known to be chaotic in nature and sensitive to initial conditions. As a result, a small perturbation in the initial conditions results in deviation in state trajectory after a few time steps. The algorithms and computational resources needed to accurately identify the system states vary depending on whether the solution is in transition region or not. We refer to the transition and non-transition regions as unstable and stable regions respectively. We label a system state to be stable if it's immediate past and future states reside in the same regime. However, at a given time step we don't have the prior knowledge about whether system is in stable or unstable region. In this paper, we develop and train a feed forward (multi-layer perceptron) Neural Network to classify the system states of a Lorenz system as stable and unstable. We pose this task as a supervised learning problem where we train the neural network on Lorenz system which have states labeled as stable or unstable. We then test the ability of the neural network models to identify the stable and unstable states on a different Lorenz system that is generated using different initial conditions. We also evaluate the classification performance in the mismatched case i.e., when the initial conditions for training and validation data are sampled from different intervals. We show that certain normalization schemes can greatly improve the performance of neural networks in especially these mismatched scenarios. The classification framework developed in the paper can be a preprocessor for a larger context of sequential decision making framework where the decision making is performed based on observed stable or unstable states.
△ Less
Submitted 15 June, 2021;
originally announced June 2021.
-
Time-dependent stochastic basis adaptation for uncertainty quantification
Authors:
Ramakrishna Tipireddy,
Panos Stinis,
Alexandre M. Tartakovsky
Abstract:
We extend stochastic basis adaptation and spatial domain decomposition methods to solve time varying stochastic partial differential equations (SPDEs) with a large number of input random parameters. Stochastic basis adaptation allows the determination of a low dimensional stochastic basis representation of a quantity of interest (QoI). Extending basis adaptation to time-dependent problems is chall…
▽ More
We extend stochastic basis adaptation and spatial domain decomposition methods to solve time varying stochastic partial differential equations (SPDEs) with a large number of input random parameters. Stochastic basis adaptation allows the determination of a low dimensional stochastic basis representation of a quantity of interest (QoI). Extending basis adaptation to time-dependent problems is challenging because small errors introduced in the previous time steps of the low dimensional approximate solution accumulate over time and cause divergence from the true solution. To address this issue we have introduced an approach where the basis adaptation varies at every time step so that the low dimensional basis is adapted to the QoI at that time step. We have coupled the time-dependent basis adaptation with domain decomposition to further increase the accuracy in the representation of the QoI. To illustrate the construction, we present numerical results for one-dimensional time varying linear and nonlinear diffusion equations with random space-dependent diffusion coefficients. Stochastic dimension reduction techniques proposed in the literature have mainly focused on quantifying the uncertainty in time independent and scalar QoI. To the best of our knowledge, this is the first attempt to extend dimensional reduction techniques to time varying and spatially dependent quantities such as the solution of SPDEs.
△ Less
Submitted 4 March, 2021;
originally announced March 2021.
-
An efficient epistemic uncertainty quantification algorithm for a class of stochastic models: A post-processing and domain decomposition framework
Authors:
Mahadevan Ganesh,
Stuart C Hawkins,
Alexandre Tartakovsky,
Ramakrishna Tipireddy
Abstract:
Partial differential equations (PDEs) are fundamental for theoretically describing numerous physical processes that are based on some input fields in spatial configurations. Understanding the physical process, in general, requires computational modeling of the PDE. Uncertainty in the computational model manifests through lack of precise knowledge of the input field or configuration. Uncertainty qu…
▽ More
Partial differential equations (PDEs) are fundamental for theoretically describing numerous physical processes that are based on some input fields in spatial configurations. Understanding the physical process, in general, requires computational modeling of the PDE. Uncertainty in the computational model manifests through lack of precise knowledge of the input field or configuration. Uncertainty quantification (UQ) in the output physical process is typically carried out by modeling the uncertainty using a random field, governed by an appropriate covariance function. This leads to solving high-dimensional stochastic counterparts of the PDE computational models. Such UQ-PDE models require a large number of simulations of the PDE in conjunction with samples in the high-dimensional probability space, with probability distribution associated with the covariance function. Those UQ computational models having explicit knowledge of the covariance function are known as aleatoric UQ (AUQ) models. The lack of such explicit knowledge leads to epistemic UQ (EUQ) models, which typically require solution of a large number of AUQ models. In this article, using a surrogate, post-processing, and domain decomposition framework with coarse stochastic solution adaptation, we develop an offline/online algorithm for efficiently simulating a class of EUQ-PDE models.
△ Less
Submitted 15 October, 2020;
originally announced October 2020.
-
Bayesian phase estimation with adaptive grid refinement
Authors:
Ramakrishna Tipireddy,
Nathan Wiebe
Abstract:
We introduce a novel Bayesian phase estimation technique based on adaptive grid refinement method. This method automatically chooses the number particles needed for accurate phase estimation using grid refinement and cell merging strategies such that the total number of particles needed at each step is minimal. The proposed method provides a powerful alternative to traditional sampling based seque…
▽ More
We introduce a novel Bayesian phase estimation technique based on adaptive grid refinement method. This method automatically chooses the number particles needed for accurate phase estimation using grid refinement and cell merging strategies such that the total number of particles needed at each step is minimal. The proposed method provides a powerful alternative to traditional sampling based sequential Monte Carlo method which tend to fail in certain instances such as when the posterior distribution is bimodal. We also combine grid based and sampling based methods as hybrid particle filter where grid based method can be used to estimate a small but dominant set of parameters and Liu-West (LW) based SMC for the remaining set of parameters. Principal kurtosis analysis can be used to decide the choice of parameters for grid refinement method and for sampling based methods. We provide numerical results comparing the performance of the proposed grid refinement method with Liu-West resampling based SMC. Numerical results suggest that the proposed method is quite promising for quantum phase estimation. It can be easily adapted to Hamiltonian learning which is a very useful technique for estimating unknown parameters of a Hamiltonian and for characterizing unknown quantum devices.
△ Less
Submitted 16 September, 2020;
originally announced September 2020.
-
FPDetect: Efficient Reasoning About Stencil Programs Using Selective Direct Evaluation
Authors:
Arnab Das,
Sriram Krishnamoorthy,
Ian Briggs,
Ganesh Gopalakrishnan,
Ramakrishna Tipireddy
Abstract:
We present FPDetect, a low overhead approach for detecting logical errors and soft errors affecting stencil computations without generating false positives. We develop an offline analysis that tightly estimates the number of floating-point bits preserved across stencil applications. This estimate rigorously bounds the values expected in the data space of the computation. Violations of this bound c…
▽ More
We present FPDetect, a low overhead approach for detecting logical errors and soft errors affecting stencil computations without generating false positives. We develop an offline analysis that tightly estimates the number of floating-point bits preserved across stencil applications. This estimate rigorously bounds the values expected in the data space of the computation. Violations of this bound can be attributed with certainty to errors. FPDetect helps synthesize error detectors customized for user-specified levels of accuracy and coverage. FPDetect also enables overhead reduction techniques based on deploying these detectors coarsely in space and time. Experimental evaluations demonstrate the practicality of our approach.
△ Less
Submitted 4 August, 2020; v1 submitted 9 April, 2020;
originally announced April 2020.
-
Conditional Karhunen-Loève expansion for uncertainty quantification and active learning in partial differential equation models
Authors:
Ramakrishna Tipireddy,
David A Barajas-Solano,
Alexandre M. Tartakovsky
Abstract:
We use a conditional Karhunen-Loève (KL) model to quantify and reduce uncertainty in a stochastic partial differential equation (SPDE) problem with partially-known space-dependent coefficient, $Y(x)$.
We assume that a small number of $Y(x)$ measurements are available and model $Y(x)$ with a KL expansion.
We achieve reduction in uncertainty by conditioning the KL expansion coefficients on measu…
▽ More
We use a conditional Karhunen-Loève (KL) model to quantify and reduce uncertainty in a stochastic partial differential equation (SPDE) problem with partially-known space-dependent coefficient, $Y(x)$.
We assume that a small number of $Y(x)$ measurements are available and model $Y(x)$ with a KL expansion.
We achieve reduction in uncertainty by conditioning the KL expansion coefficients on measurements.
We consider two approaches for conditioning the KL expansion: In Approach 1, we condition the KL model first and then truncate it.
In Approach 2, we first truncate the KL expansion and then condition it.
We employ the conditional KL expansion together with Monte Carlo and sparse grid collocation methods to compute the moments of the solution of the SPDE problem.
Uncertainty of the problem is further reduced by adaptively selecting additional observation locations using two active learning methods.
Method 1 minimizes the variance of the PDE coefficient, while Method 2 minimizes the variance of the solution of the PDE.
We demonstrate that conditioning leads to dimension reduction of the KL representation of $Y(x)$.
For a linear diffusion SPDE with uncertain log-normal coefficient, we show that Approach 1 provides a more accurate approximation of the conditional log-normal coefficient and solution of the SPDE than Approach 2 for the same number of random dimensions in a conditional KL expansion.
Furthermore, Approach 2 provides a good estimate for the number of terms of the truncated KL expansion of the conditional field of Approach 1.
Finally, we demonstrate that active learning based on Method 2 is more efficient for uncertainty reduction in the SPDE's states (i.e., it leads to a larger reduction of the variance) than active learning using Method 2.
△ Less
Submitted 16 April, 2019;
originally announced April 2019.
-
Solvers and precondtioners based on Gauss-Seidel and Jacobi algorithms for non-symmetric stochastic Galerkin system of equations
Authors:
Ramakrishna Tipireddy,
Eric T. Phipps,
Roger G. Ghanem
Abstract:
In this work, solvers and preconditioners based on Gauss-Seidel and Jacobi algorithms are explored for stochastic Galerkin discretization of partial differential equations (PDEs) with random input data. Gauss-Seidel and Jacobi algorithms are formulated such that the existing software is leveraged in the computational effort. These algorithms are also used as preconditioners to Krylov iterative met…
▽ More
In this work, solvers and preconditioners based on Gauss-Seidel and Jacobi algorithms are explored for stochastic Galerkin discretization of partial differential equations (PDEs) with random input data. Gauss-Seidel and Jacobi algorithms are formulated such that the existing software is leveraged in the computational effort. These algorithms are also used as preconditioners to Krylov iterative methods. The solvers and preconditiners are compared with Krylov based iterative methods with the traditional mean-based preconditioner [13] and Kronecker-product preconditioner [17] by solving a steady state state advection-diffusion equation, which upon discretization, results in a non-symmetric positive definite matrix on left-hand-side. Numerical results show that an approximate version of Gauss-Seidel algorithm is a good preconditioner for GMRES to solve non-symmetric Galerkin system of equations.
△ Less
Submitted 13 April, 2019;
originally announced April 2019.
-
A comparative study of physics-informed neural network models for learning unknown dynamics and constitutive relations
Authors:
Ramakrishna Tipireddy,
Paris Perdikaris,
Panos Stinis,
Alexandre Tartakovsky
Abstract:
We investigate the use of discrete and continuous versions of physics-informed neural network methods for learning unknown dynamics or constitutive relations of a dynamical system. For the case of unknown dynamics, we represent all the dynamics with a deep neural network (DNN). When the dynamics of the system are known up to the specification of constitutive relations (that can depend on the state…
▽ More
We investigate the use of discrete and continuous versions of physics-informed neural network methods for learning unknown dynamics or constitutive relations of a dynamical system. For the case of unknown dynamics, we represent all the dynamics with a deep neural network (DNN). When the dynamics of the system are known up to the specification of constitutive relations (that can depend on the state of the system), we represent these constitutive relations with a DNN. The discrete versions combine classical multistep discretization methods for dynamical systems with neural network based machine learning methods. On the other hand, the continuous versions utilize deep neural networks to minimize the residual function for the continuous governing equations. We use the case of a fedbatch bioreactor system to study the effectiveness of these approaches and discuss conditions for their applicability. Our results indicate that the accuracy of the trained neural network models is much higher for the cases where we only have to learn a constitutive relation instead of the whole dynamics. This finding corroborates the well-known fact from scientific computing that building as much structural information is available into an algorithm can enhance its efficiency and/or accuracy.
△ Less
Submitted 2 April, 2019;
originally announced April 2019.
-
Stochastic basis adaptation and spatial domain decomposition for PDEs with random coefficients
Authors:
Ramakrishna Tipireddy,
Panos Stinis,
Alexandre Tartakovsky
Abstract:
We present a novel uncertainty quantification approach for high-dimensional stochastic partial differential equations that reduces the computational cost of polynomial chaos methods by decomposing the computational domain into non-overlapping subdomains and adapting the stochastic basis in each subdomain so the local solution has a lower dimensional random space representation. The local solutions…
▽ More
We present a novel uncertainty quantification approach for high-dimensional stochastic partial differential equations that reduces the computational cost of polynomial chaos methods by decomposing the computational domain into non-overlapping subdomains and adapting the stochastic basis in each subdomain so the local solution has a lower dimensional random space representation. The local solutions are coupled using the Neumann-Neumann algorithm, where we first estimate the interface solution then evaluate the interior solution in each subdomain using the interface solution as a boundary condition. The interior solutions in each subdomain are computed independently of each other, which reduces the operation count from $O(N^α)$ to $O(M^α),$ where $N$ is the total number of degrees of freedom, $M$ is the number of degrees of freedom in each subdomain, and the exponent $α>1$ depends on the uncertainty quantification method used. In addition, the localized nature of solutions makes the proposed approach highly parallelizable. We illustrate the accuracy and efficiency of the approach for linear and nonlinear differential equations with random coefficients.
△ Less
Submitted 7 September, 2017;
originally announced September 2017.
-
Basis adaptation and domain decomposition for steady partial differential equations with random coefficients
Authors:
Ramkrishna Tipireddy,
Panos Stinis,
Alexandre Tartakovsky
Abstract:
We present a novel approach for solving steady-state stochastic partial differential equations (PDEs) with high-dimensional random parameter space. The proposed approach combines spatial domain decomposition with basis adaptation for each subdomain. The basis adaptation is used to address the curse of dimensionality by constructing an accurate low-dimensional representation of the stochastic PDE s…
▽ More
We present a novel approach for solving steady-state stochastic partial differential equations (PDEs) with high-dimensional random parameter space. The proposed approach combines spatial domain decomposition with basis adaptation for each subdomain. The basis adaptation is used to address the curse of dimensionality by constructing an accurate low-dimensional representation of the stochastic PDE solution (probability density function and/or its leading statistical moments) in each subdomain. Restricting the basis adaptation to a specific subdomain affords finding a locally accurate solution. Then, the solutions from all of the subdomains are stitched together to provide a global solution. We support our construction with numerical experiments for a steady-state diffusion equation with a random spatially dependent coefficient. Our results show that highly accurate global solutions can be obtained with significantly reduced computational costs.
△ Less
Submitted 27 July, 2016;
originally announced July 2016.