-
Bayesian calibration with summary statistics for the prediction of xenon diffusion in UO2 nuclear fuel
Authors:
Pieterjan Robbe,
David Andersson,
Luc Bonnet,
Tiernan Casey,
Michael W D Cooper,
Christopher Matthews,
Khachik Sargsyan,
Habib N Najm
Abstract:
The evolution and release of fission gas impacts the performance of UO2 nuclear fuel. We have created a Bayesian framework to calibrate a novel model for fission gas transport that predicts diffusion rates of uranium and xenon in UO2 under both thermal equilibrium and irradiation conditions. Data sets are taken from historical diffusion, gas release, and thermodynamic experiments. These data sets…
▽ More
The evolution and release of fission gas impacts the performance of UO2 nuclear fuel. We have created a Bayesian framework to calibrate a novel model for fission gas transport that predicts diffusion rates of uranium and xenon in UO2 under both thermal equilibrium and irradiation conditions. Data sets are taken from historical diffusion, gas release, and thermodynamic experiments. These data sets consist invariably of summary statistics, including a measurement value with an associated uncertainty. Our calibration strategy uses synthetic data sets in order to estimate the parameters in the model, such that the resulting model predictions agree with the reported summary statistics. In doing so, the reported uncertainties are effectively reflected in the inferred uncertain parameters. Furthermore, to keep our approach computationally tractable, we replace the fission gas evolution model by a polynomial surrogate model with a reduced number of parameters, which are identified using global sensitivity analysis. We discuss the efficacy of our calibration strategy, and investigate how the contribution of the different data sets, taken from multiple sources in the literature, can be weighted in the likelihood function constructed as part of our Bayesian calibration setup, in order to account for the different number of data points in each set of data summaries. Our results indicate a good match between the calibrated diffusivity and non-stoichiometry predictions and the given data summaries. We demonstrate a good agreement between the calibrated xenon diffusivity and the established fit from Turnbull et al. (1982), indicating that the dominant uranium vacancy diffusion mechanism in the model is able to capture the trends in the data.
△ Less
Submitted 16 February, 2023;
originally announced February 2023.
-
Trade-offs in the design and communication of flood-risk information
Authors:
Courtney M. Cooper,
Sanjib Sharma,
Robert E. Nicholas,
Klaus Keller
Abstract:
There is an increasingly urgent need to develop knowledge and practices to manage climate risks. For example, flood-risk information can inform household decisions such as purchasing a home or flood insurance. However, flood-risk estimates are deeply uncertain, meaning that they are subject to sizeable disagreement. Available flood-risk estimates provide inconsistent and incomplete information and…
▽ More
There is an increasingly urgent need to develop knowledge and practices to manage climate risks. For example, flood-risk information can inform household decisions such as purchasing a home or flood insurance. However, flood-risk estimates are deeply uncertain, meaning that they are subject to sizeable disagreement. Available flood-risk estimates provide inconsistent and incomplete information and pose communication challenges. The effects of different choices of design and communication options can create confusion in decision-making processes. The climate services literature includes insights into desirable features for producing information that is credible and relevant. Using examples of riverine (fluvial) flood-risk information products and studies in the United States, we assess how existing risk characterizations integrate desirable features outlined in the climate services literature. Improved characterization and communication of decision-relevant (and often deep) uncertainties, including those arising from human decisions, is a crucial next step. We argue that producing relevant flood-risk information requires applying principles of open science and co-production.
△ Less
Submitted 4 January, 2022;
originally announced January 2022.
-
Explanations for Monotonic Classifiers
Authors:
Joao Marques-Silva,
Thomas Gerspacher,
Martin Cooper,
Alexey Ignatiev,
Nina Narodytska
Abstract:
In many classification tasks there is a requirement of monotonicity. Concretely, if all else remains constant, increasing (resp. decreasing) the value of one or more features must not decrease (resp. increase) the value of the prediction. Despite comprehensive efforts on learning monotonic classifiers, dedicated approaches for explaining monotonic classifiers are scarce and classifier-specific. Th…
▽ More
In many classification tasks there is a requirement of monotonicity. Concretely, if all else remains constant, increasing (resp. decreasing) the value of one or more features must not decrease (resp. increase) the value of the prediction. Despite comprehensive efforts on learning monotonic classifiers, dedicated approaches for explaining monotonic classifiers are scarce and classifier-specific. This paper describes novel algorithms for the computation of one formal explanation of a (black-box) monotonic classifier. These novel algorithms are polynomial in the run time complexity of the classifier and the number of features. Furthermore, the paper presents a practically efficient model-agnostic algorithm for enumerating formal explanations.
△ Less
Submitted 31 May, 2021;
originally announced June 2021.
-
Explaining Naive Bayes and Other Linear Classifiers with Polynomial Time and Delay
Authors:
Joao Marques-Silva,
Thomas Gerspacher,
Martin C. Cooper,
Alexey Ignatiev,
Nina Narodytska
Abstract:
Recent work proposed the computation of so-called PI-explanations of Naive Bayes Classifiers (NBCs). PI-explanations are subset-minimal sets of feature-value pairs that are sufficient for the prediction, and have been computed with state-of-the-art exact algorithms that are worst-case exponential in time and space. In contrast, we show that the computation of one PI-explanation for an NBC can be a…
▽ More
Recent work proposed the computation of so-called PI-explanations of Naive Bayes Classifiers (NBCs). PI-explanations are subset-minimal sets of feature-value pairs that are sufficient for the prediction, and have been computed with state-of-the-art exact algorithms that are worst-case exponential in time and space. In contrast, we show that the computation of one PI-explanation for an NBC can be achieved in log-linear time, and that the same result also applies to the more general class of linear classifiers. Furthermore, we show that the enumeration of PI-explanations can be obtained with polynomial delay. Experimental results demonstrate the performance gains of the new algorithms when compared with earlier work. The experimental results also investigate ways to measure the quality of heuristic explanations
△ Less
Submitted 4 November, 2020; v1 submitted 13 August, 2020;
originally announced August 2020.
-
Can visualization alleviate dichotomous thinking? Effects of visual representations on the cliff effect
Authors:
Jouni Helske,
Satu Helske,
Matthew Cooper,
Anders Ynnerman,
Lonni Besançon
Abstract:
Common reporting styles for statistical results in scientific articles, such as p-values and confidence intervals (CI), have been reported to be prone to dichotomous interpretations, especially with respect to the null hypothesis significance testing framework. For example when the p-value is small enough or the CIs of the mean effects of a studied drug and a placebo are not overlapping, scientist…
▽ More
Common reporting styles for statistical results in scientific articles, such as p-values and confidence intervals (CI), have been reported to be prone to dichotomous interpretations, especially with respect to the null hypothesis significance testing framework. For example when the p-value is small enough or the CIs of the mean effects of a studied drug and a placebo are not overlapping, scientists tend to claim significant differences while often disregarding the magnitudes and absolute differences in the effect sizes. This type of reasoning has been shown to be potentially harmful to science. Techniques relying on the visual estimation of the strength of evidence have been recommended to reduce such dichotomous interpretations but their effectiveness has also been challenged. We ran two experiments on researchers with expertise in statistical analysis to compare several alternative representations of confidence intervals and used Bayesian multilevel models to estimate the effects of the representation styles on differences in researchers' subjective confidence in the results. We also asked the respondents' opinions and preferences in representation styles. Our results suggest that adding visual information to classic CI representation can decrease the tendency towards dichotomous interpretations - measured as the `cliff effect': the sudden drop in confidence around p-value 0.05 - compared with classic CI visualization and textual representation of the CI with p-values. All data and analyses are publicly available at https://github.com/helske/statvis.
△ Less
Submitted 28 May, 2021; v1 submitted 17 February, 2020;
originally announced February 2020.
