-
Extreme learning machines for variance-based global sensitivity analysis
Authors:
John Darges,
Alen Alexanderian,
Pierre Gremaud
Abstract:
Variance-based global sensitivity analysis (GSA) can provide a wealth of information when applied to complex models. A well-known Achilles' heel of this approach is its computational cost which often renders it unfeasible in practice. An appealing alternative is to analyze instead the sensitivity of a surrogate model with the goal of lowering computational costs while maintaining sufficient accura…
▽ More
Variance-based global sensitivity analysis (GSA) can provide a wealth of information when applied to complex models. A well-known Achilles' heel of this approach is its computational cost which often renders it unfeasible in practice. An appealing alternative is to analyze instead the sensitivity of a surrogate model with the goal of lowering computational costs while maintaining sufficient accuracy. Should a surrogate be "simple" enough to be amenable to the analytical calculations of its Sobol' indices, the cost of GSA is essentially reduced to the construction of the surrogate. We propose a new class of sparse weight Extreme Learning Machines (SW-ELMs) which, when considered as surrogates in the context of GSA, admit analytical formulas for their Sobol' indices and, unlike the standard ELMs, yield accurate approximations of these indices. The effectiveness of this approach is illustrated through both traditional benchmarks in the field and on a chemical reaction network.
△ Less
Submitted 1 May, 2023; v1 submitted 14 January, 2022;
originally announced January 2022.
-
Global sensitivity analysis of rare event probabilities
Authors:
Michael Merritt,
Alen Alexanderian,
Pierre Gremaud
Abstract:
By their very nature, rare event probabilities are expensive to compute; they are also delicate to estimate as their value strongly depends on distributional assumptions on the model parameters. Hence, understanding the sensitivity of the computed rare event probabilities to the hyper-parameters that define the distribution law of the model parameters is crucial. We show that by (i) accelerating t…
▽ More
By their very nature, rare event probabilities are expensive to compute; they are also delicate to estimate as their value strongly depends on distributional assumptions on the model parameters. Hence, understanding the sensitivity of the computed rare event probabilities to the hyper-parameters that define the distribution law of the model parameters is crucial. We show that by (i) accelerating the calculation of rare event probabilities through subset simulation and (ii) approximating the resulting probabilities through a polynomial chaos expansion, the global sensitivity of such problems can be analyzed through a double-loop sampling approach. The resulting method is conceptually simple and computationally efficient; its performance is illustrated on a subsurface flow application and on an analytical example.
△ Less
Submitted 26 October, 2021;
originally announced October 2021.
-
Multiscale global sensitivity analysis for stochastic chemical systems
Authors:
Michael Merritt,
Alen Alexanderian,
Pierre A. Gremaud
Abstract:
Sensitivity analysis is routinely performed on simplified surrogate models as the cost of such analysis on the original model may be prohibitive. Little is known in general about the induced bias on the sensitivity results. Within the framework of chemical kinetics, we provide a full justification of the above approach in the case of variance based methods provided the surrogate model results from…
▽ More
Sensitivity analysis is routinely performed on simplified surrogate models as the cost of such analysis on the original model may be prohibitive. Little is known in general about the induced bias on the sensitivity results. Within the framework of chemical kinetics, we provide a full justification of the above approach in the case of variance based methods provided the surrogate model results from the original one through the thermodynamic limit. We also provide illustrative numerical examples in context of a Michaelis--Menten system and a biochemical reaction network describing a genetic oscillator.
△ Less
Submitted 17 March, 2020;
originally announced March 2020.
-
Global Sensitivity Analysis: a new generation of mighty estimators based on rank statistics
Authors:
Fabrice Gamboa,
Pierre Gremaud,
Thierry Klein,
Agnès Lagnoux
Abstract:
We propose a new statistical estimation framework for a large family of global sensitivity analysis methods. Our approach is based on rank statistics and uses an empirical correlation coefficient recently introduced by Sourav Chatterjee. We show how to apply this approach to compute not only the Cramér-von-Mises indices, which are directly related to Chatterjee's notion of correlation, but also So…
▽ More
We propose a new statistical estimation framework for a large family of global sensitivity analysis methods. Our approach is based on rank statistics and uses an empirical correlation coefficient recently introduced by Sourav Chatterjee. We show how to apply this approach to compute not only the Cramér-von-Mises indices, which are directly related to Chatterjee's notion of correlation, but also Sobol indices at any order, higher-order moment indices, and Shapley effects. We establish consistency of the resulting estimators and demonstrate their numerical efficiency, especially for small sample sizes.
△ Less
Submitted 28 June, 2023; v1 submitted 3 March, 2020;
originally announced March 2020.
-
Robustness of the Sobol' indices to distributional uncertainty
Authors:
Joseph Hart,
Pierre Gremaud
Abstract:
Global sensitivity analysis (GSA) is used to quantify the influence of uncertain variables in a mathematical model. Prior to performing GSA, the user must specify (or implicitly assume), a probability distribution to model the uncertainty, and possibly statistical dependencies, of the variables. Determining this distribution is challenging in practice as the user has limited and imprecise knowledg…
▽ More
Global sensitivity analysis (GSA) is used to quantify the influence of uncertain variables in a mathematical model. Prior to performing GSA, the user must specify (or implicitly assume), a probability distribution to model the uncertainty, and possibly statistical dependencies, of the variables. Determining this distribution is challenging in practice as the user has limited and imprecise knowledge of the uncertain variables. This article analyzes the robustness of the Sobol' indices, a commonly used tool in GSA, to changes in the distribution of the uncertain variables. A method for assessing such robustness is developed which requires minimal user specification and no additional evaluations of the model. Theoretical and computational aspects of the method are considered and illustrated through examples.
△ Less
Submitted 20 November, 2018; v1 submitted 29 March, 2018;
originally announced March 2018.