-
Bayesian quadrature for $H^1(μ)$ with Poincaré inequality on a compact interval
Authors:
Olivier Roustant,
Nora Lüthen,
Fabrice Gamboa
Abstract:
Motivated by uncertainty quantification of complex systems, we aim at finding quadrature formulas of the form $\int_a^b f(x) dμ(x) = \sum_{i=1}^n w_i f(x_i)$ where $f$ belongs to $H^1(μ)$. Here, $μ$ belongs to a class of continuous probability distributions on $[a, b] \subset \mathbb{R}$ and $\sum_{i=1}^n w_i δ_{x_i}$ is a discrete probability distribution on $[a, b]$. We show that $H^1(μ)$ is a r…
▽ More
Motivated by uncertainty quantification of complex systems, we aim at finding quadrature formulas of the form $\int_a^b f(x) dμ(x) = \sum_{i=1}^n w_i f(x_i)$ where $f$ belongs to $H^1(μ)$. Here, $μ$ belongs to a class of continuous probability distributions on $[a, b] \subset \mathbb{R}$ and $\sum_{i=1}^n w_i δ_{x_i}$ is a discrete probability distribution on $[a, b]$. We show that $H^1(μ)$ is a reproducing kernel Hilbert space with a continuous kernel $K$, which allows to reformulate the quadrature question as a Bayesian (or kernel) quadrature problem. Although $K$ has not an easy closed form in general, we establish a correspondence between its spectral decomposition and the one associated to Poincaré inequalities, whose common eigenfunctions form a $T$-system (Karlin and Studden, 1966). The quadrature problem can then be solved in the finite-dimensional proxy space spanned by the first eigenfunctions. The solution is given by a generalized Gaussian quadrature, which we call Poincaré quadrature. We derive several results for the Poincaré quadrature weights and the associated worst-case error. When $μ$ is the uniform distribution, the results are explicit: the Poincaré quadrature is equivalent to the midpoint (rectangle) quadrature rule. Its nodes coincide with the zeros of an eigenfunction and the worst-case error scales as $\frac{b-a}{2\sqrt{3}}n^{-1}$ for large $n$. By comparison with known results for $H^1(0,1)$, this shows that the Poincaré quadrature is asymptotically optimal. For a general $μ$, we provide an efficient numerical procedure, based on finite elements and linear programming. Numerical experiments provide useful insights: nodes are nearly evenly spaced, weights are close to the probability density at nodes, and the worst-case error is approximately $O(n^{-1})$ for large $n$.
△ Less
Submitted 29 July, 2022;
originally announced July 2022.
-
A spectral surrogate model for stochastic simulators computed from trajectory samples
Authors:
Nora Lüthen,
Stefano Marelli,
Bruno Sudret
Abstract:
Stochastic simulators are non-deterministic computer models which provide a different response each time they are run, even when the input parameters are held at fixed values. They arise when additional sources of uncertainty are affecting the computer model, which are not explicitly modeled as input parameters. The uncertainty analysis of stochastic simulators requires their repeated evaluation f…
▽ More
Stochastic simulators are non-deterministic computer models which provide a different response each time they are run, even when the input parameters are held at fixed values. They arise when additional sources of uncertainty are affecting the computer model, which are not explicitly modeled as input parameters. The uncertainty analysis of stochastic simulators requires their repeated evaluation for different values of the input variables, as well as for different realizations of the underlying latent stochasticity. The computational cost of such analyses can be considerable, which motivates the construction of surrogate models that can approximate the original model and its stochastic response, but can be evaluated at much lower cost.
We propose a surrogate model for stochastic simulators based on spectral expansions. Considering a certain class of stochastic simulators that can be repeatedly evaluated for the same underlying random event, we view the simulator as a random field indexed by the input parameter space. For a fixed realization of the latent stochasticity, the response of the simulator is a deterministic function, called trajectory. Based on samples from several such trajectories, we approximate the latter by sparse polynomial chaos expansion and compute analytically an extended Karhunen-Loève expansion (KLE) to reduce its dimensionality. The uncorrelated but dependent random variables of the KLE are modeled by advanced statistical techniques such as parametric inference, vine copula modeling, and kernel density estimation. The resulting surrogate model approximates the marginals and the covariance function, and allows to obtain new realizations at low computational cost. We observe that in our numerical examples, the first mode of the KLE is by far the most important, and investigate this phenomenon and its implications.
△ Less
Submitted 12 July, 2022;
originally announced July 2022.
-
Global sensitivity analysis using derivative-based sparse Poincaré chaos expansions
Authors:
Nora Lüthen,
Olivier Roustant,
Fabrice Gamboa,
Bertrand Iooss,
Stefano Marelli,
Bruno Sudret
Abstract:
Variance-based global sensitivity analysis, in particular Sobol' analysis, is widely used for determining the importance of input variables to a computational model. Sobol' indices can be computed cheaply based on spectral methods like polynomial chaos expansions (PCE). Another choice are the recently developed Poincaré chaos expansions (PoinCE), whose orthonormal tensor-product basis is generated…
▽ More
Variance-based global sensitivity analysis, in particular Sobol' analysis, is widely used for determining the importance of input variables to a computational model. Sobol' indices can be computed cheaply based on spectral methods like polynomial chaos expansions (PCE). Another choice are the recently developed Poincaré chaos expansions (PoinCE), whose orthonormal tensor-product basis is generated from the eigenfunctions of one-dimensional Poincaré differential operators. In this paper, we show that the Poincaré basis is the unique orthonormal basis with the property that partial derivatives of the basis form again an orthogonal basis with respect to the same measure as the original basis. This special property makes PoinCE ideally suited for incorporating derivative information into the surrogate modelling process. Assuming that partial derivative evaluations of the computational model are available, we compute spectral expansions in terms of Poincaré basis functions or basis partial derivatives, respectively, by sparse regression. We show on two numerical examples that the derivative-based expansions provide accurate estimates for Sobol' indices, even outperforming PCE in terms of bias and variance. In addition, we derive an analytical expression based on the PoinCE coefficients for a second popular sensitivity index, the derivative-based sensitivity measure (DGSM), and explore its performance as upper bound to the corresponding total Sobol' indices.
△ Less
Submitted 9 June, 2023; v1 submitted 1 July, 2021;
originally announced July 2021.
-
Automatic selection of basis-adaptive sparse polynomial chaos expansions for engineering applications
Authors:
Nora Lüthen,
Stefano Marelli,
Bruno Sudret
Abstract:
Sparse polynomial chaos expansions (PCE) are an efficient and widely used surrogate modeling method in uncertainty quantification for engineering problems with computationally expensive models. To make use of the available information in the most efficient way, several approaches for so-called basis-adaptive sparse PCE have been proposed to determine the set of polynomial regressors ("basis") for…
▽ More
Sparse polynomial chaos expansions (PCE) are an efficient and widely used surrogate modeling method in uncertainty quantification for engineering problems with computationally expensive models. To make use of the available information in the most efficient way, several approaches for so-called basis-adaptive sparse PCE have been proposed to determine the set of polynomial regressors ("basis") for PCE adaptively.
The goal of this paper is to help practitioners identify the most suitable methods for constructing a surrogate PCE for their model. We describe three state-of-the-art basis-adaptive approaches from the recent sparse PCE literature and conduct an extensive benchmark in terms of global approximation accuracy on a large set of computational models. Investigating the synergies between sparse regression solvers and basis adaptivity schemes, we find that the choice of the proper solver and basis-adaptive scheme is very important, as it can result in more than one order of magnitude difference in performance. No single method significantly outperforms the others, but dividing the analysis into classes (regarding input dimension and experimental design size), we are able to identify specific sparse solver and basis adaptivity combinations for each class that show comparatively good performance.
To further improve on these findings, we introduce a novel solver and basis adaptivity selection scheme guided by cross-validation error. We demonstrate that this automatic selection procedure provides close-to-optimal results in terms of accuracy, and significantly more robust solutions, while being more general than the case-by-case recommendations obtained by the benchmark.
△ Less
Submitted 23 July, 2021; v1 submitted 10 September, 2020;
originally announced September 2020.
-
Sparse Polynomial Chaos Expansions: Literature Survey and Benchmark
Authors:
Nora Lüthen,
Stefano Marelli,
Bruno Sudret
Abstract:
Sparse polynomial chaos expansions (PCE) are a popular surrogate modelling method that takes advantage of the properties of PCE, the sparsity-of-effects principle, and powerful sparse regression solvers to approximate computer models with many input parameters, relying on only few model evaluations. Within the last decade, a large number of algorithms for the computation of sparse PCE have been pu…
▽ More
Sparse polynomial chaos expansions (PCE) are a popular surrogate modelling method that takes advantage of the properties of PCE, the sparsity-of-effects principle, and powerful sparse regression solvers to approximate computer models with many input parameters, relying on only few model evaluations. Within the last decade, a large number of algorithms for the computation of sparse PCE have been published in the applied math and engineering literature. We present an extensive review of the existing methods and develop a framework for classifying the algorithms. Furthermore, we conduct a unique benchmark on a selection of methods to identify which approaches work best in practical applications. Comparing their accuracy on several benchmark models of varying dimensionality and complexity, we find that the choice of sparse regression solver and sampling scheme for the computation of a sparse PCE surrogate can make a significant difference, of up to several orders of magnitude in the resulting mean-squared error. Different methods seem to be superior in different regimes of model dimensionality and experimental design size.
△ Less
Submitted 19 May, 2021; v1 submitted 4 February, 2020;
originally announced February 2020.
-
Geometry of martensite needles in shape memory alloys
Authors:
Sergio Conti,
Martin Lenz,
Nora Lüthen,
Martin Rumpf,
Barbara Zwicknagl
Abstract:
We study the geometry of needle-shaped domains in shape-memory alloys. Needle-shaped domains are ubiquitously found in martensites around macroscopic interfaces between regions which are laminated in different directions, or close to macroscopic austenite/twinned-martensite interfaces. Their geometry results from the interplay of the local nonconvexity of the effective energy density with long-ran…
▽ More
We study the geometry of needle-shaped domains in shape-memory alloys. Needle-shaped domains are ubiquitously found in martensites around macroscopic interfaces between regions which are laminated in different directions, or close to macroscopic austenite/twinned-martensite interfaces. Their geometry results from the interplay of the local nonconvexity of the effective energy density with long-range (linear) interactions mediated by the elastic strain field, and is up to now poorly understood. We present a two-dimensional shape optimization model based on finite elasticity and discuss its numerical solution. Our results indicate that the tapering profile of the needles can be understood within finite elasticity, but not with linearized elasticity. The resulting tapering and bending reproduce the main features of experimental observations on NiAl.
△ Less
Submitted 3 December, 2019;
originally announced December 2019.
-
Branching Structures in Elastic Shape Optimization
Authors:
Nora Lüthen,
Martin Rumpf,
Sascha Tölkes,
Orestis Vantzos
Abstract:
Fine scale elastic structures are widespread in nature, for instances in plants or bones, whenever stiffness and low weight are required. These patterns frequently refine towards a Dirichlet boundary to ensure an effective load transfer. The paper discusses the optimization of such supporting structures in a specific class of domain patterns in 2D, which composes of periodic and branching period t…
▽ More
Fine scale elastic structures are widespread in nature, for instances in plants or bones, whenever stiffness and low weight are required. These patterns frequently refine towards a Dirichlet boundary to ensure an effective load transfer. The paper discusses the optimization of such supporting structures in a specific class of domain patterns in 2D, which composes of periodic and branching period transitions on subdomain facets. These investigations can be considered as a case study to display examples of optimal branching domain patterns.
In explicit, a rectangular domain is decomposed into rectangular subdomains, which share facets with neighbouring subdomains or with facets which split on one side into equally sized facets of two different subdomains. On each subdomain one considers an elastic material phase with stiff elasticity coefficients and an approximate void phase with orders of magnitude softer material. For given load on the outer domain boundary, which is distributed on a prescribed fine scale pattern representing the contact area of the shape, the interior elastic phase is optimized with respect to the compliance cost. The elastic stress is supposed to be continuous on the domain and a stress based finite volume discretization is used for the optimization. If in one direction equally sized subdomains with equal adjacent subdomain topology line up, these subdomains are consider as equal copies including the enforced boundary conditions for the stress and form a locally periodic substructure.
An alternating descent algorithm is employed for a discrete characteristic function describing the stiff elastic subset on the subdomains and the solution of the elastic state equation. Numerical experiments are shown for compression and shear load on the boundary of a quadratic domain.
△ Less
Submitted 10 November, 2017;
originally announced November 2017.
-
An improved a priori error analysis of Nitsche's method for Robin boundary conditions
Authors:
Nora Lüthen,
Mika Juntunen,
Rolf Stenberg
Abstract:
In a previous paper [6] we have extended Nitsche's method [8] for the Poisson equation with general Robin boundary conditions. The analysis required that the solution is in H^s, with s > 3/2. Here we give an improved error analysis using a technique proposed by Gudi [5].
In a previous paper [6] we have extended Nitsche's method [8] for the Poisson equation with general Robin boundary conditions. The analysis required that the solution is in H^s, with s > 3/2. Here we give an improved error analysis using a technique proposed by Gudi [5].
△ Less
Submitted 24 February, 2015; v1 submitted 23 February, 2015;
originally announced February 2015.
