-
Enhancing Approximate Modular Bayesian Inference by Emulating the Conditional Posterior
Authors:
Grant Hutchings,
Kellin Rumsey,
Derek Bingham,
Gabriel Huerta
Abstract:
In modular Bayesian analyses, complex models are composed of distinct modules, each representing different aspects of the data or prior information. In this context, fully Bayesian approaches can sometimes lead to undesirable feedback between modules, compromising the integrity of the inference. This paper focuses on the "cut-distribution" which prevents unwanted influence between modules by "cutt…
▽ More
In modular Bayesian analyses, complex models are composed of distinct modules, each representing different aspects of the data or prior information. In this context, fully Bayesian approaches can sometimes lead to undesirable feedback between modules, compromising the integrity of the inference. This paper focuses on the "cut-distribution" which prevents unwanted influence between modules by "cutting" feedback. The multiple imputation (DS) algorithm is standard practice for approximating the cut-distribution, but it can be computationally intensive, especially when the number of imputations required is large. An enhanced method is proposed, the Emulating the Conditional Posterior (ECP) algorithm, which leverages emulation to increase the number of imputations. Through numerical experiment it is demonstrated that the ECP algorithm outperforms the traditional DS approach in terms of accuracy and computational efficiency, particularly when resources are constrained. It is also shown how the DS algorithm can be improved using ideas from design of experiments. This work also provides practical recommendations on algorithm choice based on the computational demands of sampling from the prior and cut-distributions.
△ Less
Submitted 24 October, 2024;
originally announced October 2024.
-
A Multivariate Space-Time Dynamic Model for Characterizing the Atmospheric Impacts Following the Mt Pinatubo Eruptio
Authors:
Robert Garrett,
Lyndsay Shand,
J. Gabriel Huerta
Abstract:
The June 1991 Mt. Pinatubo eruption resulted in a massive increase of sulfate aerosols in the atmosphere, absorbing radiation and leading to global changes in surface and stratospheric temperatures. A volcanic eruption of this magnitude serves as a natural analog for stratospheric aerosol injection, a proposed solar radiation modification method to combat the warming climate. The impacts of such a…
▽ More
The June 1991 Mt. Pinatubo eruption resulted in a massive increase of sulfate aerosols in the atmosphere, absorbing radiation and leading to global changes in surface and stratospheric temperatures. A volcanic eruption of this magnitude serves as a natural analog for stratospheric aerosol injection, a proposed solar radiation modification method to combat the warming climate. The impacts of such an event are multifaceted and region-specific. Our goal is to characterize the multivariate and dynamic nature of the climate impacts following the Mt. Pinatubo eruption. We developed a multivariate space-time dynamic linear model to understand the full extent of the spatially- and temporally-varying impacts. Specifically, spatial variation is modeled using a flexible set of basis functions for which the basis coefficients are allowed to vary in time through a vector autoregressive (VAR) structure. This novel model is caste in a Dynamic Linear Model (DLM) framework and estimated via a customized MCMC approach. We demonstrate how the model quantifies the relationships between key atmospheric parameters following the Mt. Pinatubo eruption with reanalysis data from MERRA-2 and highlight when such model is advantageous over univariate models.
△ Less
Submitted 23 August, 2024;
originally announced August 2024.
-
Elastic Bayesian Model Calibration
Authors:
Devin Francom,
J. Derek Tucker,
Gabriel Huerta,
Kurtis Shuler,
Daniel Ries
Abstract:
Functional data are ubiquitous in scientific modeling. For instance, quantities of interest are modeled as functions of time, space, energy, density, etc. Uncertainty quantification methods for computer models with functional response have resulted in tools for emulation, sensitivity analysis, and calibration that are widely used. However, many of these tools do not perform well when the computer…
▽ More
Functional data are ubiquitous in scientific modeling. For instance, quantities of interest are modeled as functions of time, space, energy, density, etc. Uncertainty quantification methods for computer models with functional response have resulted in tools for emulation, sensitivity analysis, and calibration that are widely used. However, many of these tools do not perform well when the computer model's parameters control both the amplitude variation of the functional output and its alignment (or phase variation). This paper introduces a framework for Bayesian model calibration when the model responses are misaligned functional data. The approach generates two types of data out of the misaligned functional responses: (1) aligned functions so that the amplitude variation is isolated and (2) warping functions that isolate the phase variation. These two types of data are created for the computer simulation data (both of which may be emulated) and the experimental data. The calibration approach uses both types so that it seeks to match both the amplitude and phase of the experimental data. The framework is careful to respect constraints that arise especially when modeling phase variation, and is framed in a way that it can be done with readily available calibration software. We demonstrate the techniques on two simulated data examples and on two dynamic material science problems: a strength model calibration using flyer plate experiments and an equation of state model calibration using experiments performed on the Sandia National Laboratories' Z-machine.
△ Less
Submitted 23 September, 2024; v1 submitted 15 May, 2023;
originally announced May 2023.
-
Cyber Catalysis: N$_2$ Dissociation over Ruthenium Catalyst with Strong Metal-Support Interaction
Authors:
Gerardo Valadez Huerta,
Kaoru Hisama,
Katsutoshi Sato,
Katsutoshi Nagaoka,
Michihisa Koyama
Abstract:
Catalysis informatics is constantly developing, and significant advances in data mining, molecular simulation, and automation for computational design and high-throughput experimentation have been achieved. However, efforts to reveal the mechanisms of complex supported nanoparticle catalysts in cyberspace have proven to be unsuccessful thus far. This study fills this gap by exploring N$_2$ dissoci…
▽ More
Catalysis informatics is constantly developing, and significant advances in data mining, molecular simulation, and automation for computational design and high-throughput experimentation have been achieved. However, efforts to reveal the mechanisms of complex supported nanoparticle catalysts in cyberspace have proven to be unsuccessful thus far. This study fills this gap by exploring N$_2$ dissociation on a supported Ru nanoparticle as an example using a universal neural network potential. We calculated 200 catalyst configurations considering the reduction of the support and strong metal-support interaction (SMSI), eventually performing 15,600 calculations for various N$_2$ adsorption states. After successfully validating our results with experimental IR spectral data, we clarified key N$_2$ dissociation pathways behind the high activity of the SMSI surface and disclosed the maximum activity of catalysts reduced at 650 °C. Our method is well applicable to other complex systems, and we believe it represents a key first step toward the digital transformation of investigations on heterogeneous catalysis.
△ Less
Submitted 29 August, 2022;
originally announced August 2022.
-
Work-From-Home is Here to Stay: Call for Flexibility in Post-Pandemic Work Policies
Authors:
Darja Smite,
Nils Brede Moe,
Jarle Hildrum,
Javier Gonzalez Huerta,
Daniel Mendez
Abstract:
In early 2020, the Covid-19 pandemic forced employees in tech companies worldwide to abruptly transition from working in offices to working from their homes. During two years of predominantly working from home, employees and managers alike formed expectations about what post-pandemic working life should look like. Many companies are currently experimenting with new work policies that balance both…
▽ More
In early 2020, the Covid-19 pandemic forced employees in tech companies worldwide to abruptly transition from working in offices to working from their homes. During two years of predominantly working from home, employees and managers alike formed expectations about what post-pandemic working life should look like. Many companies are currently experimenting with new work policies that balance both employee- and manager expectations to where, when and how work should be done in the future. In this article, we gather experiences from 17 companies and their sites, covering 12 countries. We share the results of corporate surveys of employee preferences for working from home and analyse new work policies. Our results are threefold. First, through the new work policies all companies are formally giving more flexibility to the employees with regards to working time and work location. Second, there is a great variation in how much flexibility the companies are willing to yield to the employees. The variation is related both to industry type, size of the companies, and company culture. Third, we document a change in the psychological contract between employees and managers, where the option of working from home is converted from an exclusive perk that managers could choose to give to the few, to a core privilege that all employees feel they are entitled to. Finally, there are indications that as the companies learn and solicit feedback regarding the efficiency of the chosen strategies, we might see further developments and changes of the work policies with respect to how much flexibility to work whenever and from anywhere they grant. Through these findings, the paper contributes to a growing literature about the new trends emerging from the pandemic in tech companies and spells out practical implications onwards.
△ Less
Submitted 21 March, 2022;
originally announced March 2022.
-
Spatio-temporal extreme event modeling of terror insurgencies
Authors:
Lekha Patel,
Lyndsay Shand,
J. Derek Tucker,
Gabriel Huerta
Abstract:
Extreme events with potential deadly outcomes, such as those organized by terror groups, are highly unpredictable in nature and an imminent threat to society. In particular, quantifying the likelihood of a terror attack occurring in an arbitrary space-time region and its relative societal risk, would facilitate informed measures that would strengthen national security. This paper introduces a nove…
▽ More
Extreme events with potential deadly outcomes, such as those organized by terror groups, are highly unpredictable in nature and an imminent threat to society. In particular, quantifying the likelihood of a terror attack occurring in an arbitrary space-time region and its relative societal risk, would facilitate informed measures that would strengthen national security. This paper introduces a novel self-exciting marked spatio-temporal model for attacks whose inhomogeneous baseline intensity is written as a function of covariates. Its triggering intensity is succinctly modeled with a Gaussian Process prior distribution to flexibly capture intricate spatio-temporal dependencies between an arbitrary attack and previous terror events. By inferring the parameters of this model, we highlight specific space-time areas in which attacks are likely to occur. Furthermore, by measuring the outcome of an attack in terms of the number of casualties it produces, we introduce a novel mixture distribution for the number of casualties. This distribution flexibly handles low and high number of casualties and the discrete nature of the data through a {\it Generalized ZipF} distribution. We rely on a customized Markov chain Monte Carlo (MCMC) method to estimate the model parameters. We illustrate the methodology with data from the open source Global Terrorism Database (GTD) that correspond to attacks in Afghanistan from 2013-2018. We show that our model is able to predict the intensity of future attacks for 2019-2021 while considering various covariates of interest such as population density, number of regional languages spoken, and the density of population supporting the opposing government.
△ Less
Submitted 29 October, 2021; v1 submitted 15 October, 2021;
originally announced October 2021.
-
Calculations of Real-System Nanoparticles Using Universal Neural Network Potential PFP
Authors:
Gerardo Valadez Huerta,
Yusuke Nanba,
Iori Kurata,
Kosuke Nakago,
So Takamoto,
Chikashi Shinagawa,
Michihisa Koyama
Abstract:
It is essential to explore the stability and activity of real-system nanoparticles theoretically. While applications of theoretical methods for this purpose can be found in literature, the expensive computational costs of conventional theoretical methods hinder their massive applications to practical materials design. With the recent development of neural network algorithms along with the advancem…
▽ More
It is essential to explore the stability and activity of real-system nanoparticles theoretically. While applications of theoretical methods for this purpose can be found in literature, the expensive computational costs of conventional theoretical methods hinder their massive applications to practical materials design. With the recent development of neural network algorithms along with the advancement of computer systems, neural network potentials have emerged as a promising candidate for the description of a wide range of materials, including metals and molecules, with a reasonable computational time. In this study, we successfully validate a universal neural network potential, PFP, for the description of monometallic Ru nanoparticles, PdRuCu ternary alloy nanoparticles, and the NO adsorption on Rh nanoparticles against first-principles calculations. We further conduct molecular dynamics simulations on the NO-Rh system and challenge the PFP to describe a large, supported Pt nanoparticle system.
△ Less
Submitted 2 July, 2021;
originally announced July 2021.
-
Sequential Monte Carlo Smoothing with Parameter Estimation
Authors:
Biao Yang,
Jonathan R. Stroud,
Gabriel Huerta
Abstract:
We propose two new Bayesian smoothing methods for general state-space models with unknown parameters. The first approach is based on the particle learning and smoothing algorithm, but with an adjustment in the backward resampling weights. The second is a new method combining sequential parameter learning and smoothing algorithms for general state-space models. This method is straightforward but ef…
▽ More
We propose two new Bayesian smoothing methods for general state-space models with unknown parameters. The first approach is based on the particle learning and smoothing algorithm, but with an adjustment in the backward resampling weights. The second is a new method combining sequential parameter learning and smoothing algorithms for general state-space models. This method is straightforward but effective, and we find it is the best existing Sequential Monte Carlo algorithm to solve the joint Bayesian smoothing problem. We first illustrate the methods on three benchmark models using simulated data, and then apply them to a stochastic volatility model for daily S&P 500 index returns during the financial crisis.
△ Less
Submitted 19 April, 2016;
originally announced April 2016.