Showing 1–10 of 10 results for author: Shin, M

A Gibbs Sampler for Efficient Bayesian Inference in Sign-Identified SVARs

Authors: Jonas E. Arias, Juan F. Rubio-Ramírez, Minchul Shin

Abstract: We develop a new algorithm for inference based on structural vector autoregressions (SVARs) identified with sign restrictions. The key insight of our algorithm is to break apart from the accept-reject tradition associated with sign-identified SVARs. We show that embedding an elliptical slice sampling within a Gibbs sampler approach can deliver dramatic gains in speed and turn previously infeasible… ▽ More We develop a new algorithm for inference based on structural vector autoregressions (SVARs) identified with sign restrictions. The key insight of our algorithm is to break apart from the accept-reject tradition associated with sign-identified SVARs. We show that embedding an elliptical slice sampling within a Gibbs sampler approach can deliver dramatic gains in speed and turn previously infeasible applications into feasible ones. We provide a tractable example to illustrate the power of the elliptical slice sampling applied to sign-identified SVARs. We demonstrate the usefulness of our algorithm by applying it to a well-known small-SVAR model of the oil market featuring a tight identified set, as well as to a large SVAR model with more than 100 sign restrictions. △ Less

Submitted 30 May, 2025; v1 submitted 29 May, 2025; originally announced May 2025.

On the Wisdom of Crowds (of Economists)

Authors: Francis X. Diebold, Aaron Mora, Minchul Shin

Abstract: We study the properties of macroeconomic survey forecast response averages as the number of survey respondents grows. Such averages are "portfolios" of forecasts. We characterize the speed and pattern of the gains from diversification and their eventual decrease with portfolio size (the number of survey respondents) in both (1) the key real-world data-based environment of the U.S. Survey of Profes… ▽ More We study the properties of macroeconomic survey forecast response averages as the number of survey respondents grows. Such averages are "portfolios" of forecasts. We characterize the speed and pattern of the gains from diversification and their eventual decrease with portfolio size (the number of survey respondents) in both (1) the key real-world data-based environment of the U.S. Survey of Professional Forecasters (SPF), and (2) the theoretical model-based environment of equicorrelated forecast errors. We proceed by proposing and comparing various direct and model-based "crowd size signature plots," which summarize the forecasting performance of k-average forecasts as a function of k, where k is the number of forecasts in the average. We then estimate the equicorrelation model for growth and inflation forecast errors by choosing model parameters to minimize the divergence between direct and model-based signature plots. The results indicate near-perfect equicorrelation model fit for both growth and inflation, which we explicate by showing analytically that, under conditions, the direct and fitted equicorrelation model-based signature plots are identical at a particular model parameter configuration, which we characterize. We find that the gains from diversification are greater for inflation forecasts than for growth forecasts, but that both gains nevertheless decrease quite quickly, so that fewer SPF respondents than currently used may be adequate. △ Less

Submitted 12 March, 2025; originally announced March 2025.

Identification of a Rank-dependent Peer Effect Model

Authors: Eyo I. Herstad, Myungkou Shin

Abstract: We develop a model that captures peer effect heterogeneity by modeling the endogenous spillover to be linear in ordered peer outcomes. Unlike the canonical linear-in-means model, our approach accounts for the distribution of peer outcomes as well as the size of peer groups. Under a minimal condition, our model admits a unique equilibrium and is therefore tractable and identified. Simulations show… ▽ More We develop a model that captures peer effect heterogeneity by modeling the endogenous spillover to be linear in ordered peer outcomes. Unlike the canonical linear-in-means model, our approach accounts for the distribution of peer outcomes as well as the size of peer groups. Under a minimal condition, our model admits a unique equilibrium and is therefore tractable and identified. Simulations show our estimator has good finite sample performance. Finally, we apply our model to educational data from Norway, finding that higher-performing friends disproportionately drive GPA spillovers. Our framework provides new insights into the structure of peer effects beyond aggregate measures. △ Less

Submitted 28 February, 2025; v1 submitted 18 October, 2024; originally announced October 2024.

Distributional Treatment Effect with Latent Rank Invariance

Authors: Myungkou Shin

Abstract: Treatment effect heterogeneity is of a great concern when evaluating the treatment. However, even with a simple case of a binary random treatment, the distribution of treatment effect is difficult to identify due to the fundamental limitation that we cannot observe both treated potential outcome and untreated potential outcome for a given individual. This paper assumes a conditional independence a… ▽ More Treatment effect heterogeneity is of a great concern when evaluating the treatment. However, even with a simple case of a binary random treatment, the distribution of treatment effect is difficult to identify due to the fundamental limitation that we cannot observe both treated potential outcome and untreated potential outcome for a given individual. This paper assumes a conditional independence assumption that the two potential outcomes are independent of each other given a scalar latent variable. Using two proxy variables, we identify conditional distribution of the potential outcomes given the latent variable. To pin down the location of the latent variable, we assume strict monotonicty on some functional of the conditional distribution; with specific example of strictly increasing conditional expectation, we label the latent variable as 'latent rank' and motivate the identifying assumption as 'latent rank invariance.' △ Less

Submitted 6 June, 2024; v1 submitted 27 March, 2024; originally announced March 2024.

Superhuman Artificial Intelligence Can Improve Human Decision Making by Increasing Novelty

Authors: Minkyu Shin, Jin Kim, Bas van Opheusden, Thomas L. Griffiths

Abstract: How will superhuman artificial intelligence (AI) affect human decision making? And what will be the mechanisms behind this effect? We address these questions in a domain where AI already exceeds human performance, analyzing more than 5.8 million move decisions made by professional Go players over the past 71 years (1950-2021). To address the first question, we use a superhuman AI program to estima… ▽ More How will superhuman artificial intelligence (AI) affect human decision making? And what will be the mechanisms behind this effect? We address these questions in a domain where AI already exceeds human performance, analyzing more than 5.8 million move decisions made by professional Go players over the past 71 years (1950-2021). To address the first question, we use a superhuman AI program to estimate the quality of human decisions across time, generating 58 billion counterfactual game patterns and comparing the win rates of actual human decisions with those of counterfactual AI decisions. We find that humans began to make significantly better decisions following the advent of superhuman AI. We then examine human players' strategies across time and find that novel decisions (i.e., previously unobserved moves) occurred more frequently and became associated with higher decision quality after the advent of superhuman AI. Our findings suggest that the development of superhuman AI programs may have prompted human players to break away from traditional strategies and induced them to explore novel moves, which in turn may have improved their decision-making. △ Less

Submitted 14 April, 2023; v1 submitted 13 March, 2023; originally announced March 2023.

Comments: This paper is published in PNAS: https://www.pnas.org/doi/10.1073/pnas.2214840120 Minor edits to v1 include the addition of watermark and link to the published paper in the footer

MSC Class: 68T01; 68T05; 68T35; 68T99 ACM Class: I.2.0; I.2.1; I.2.6; I.2.m

Journal ref: Proceedings of the National Academy of Sciences, 120 (12), e2214840120 (2023)

Finitely Heterogeneous Treatment Effect in Event-study

Authors: Myungkou Shin

Abstract: A key assumption of the differences-in-differences designs is that the average evolution of untreated potential outcomes is the same across different treatment cohorts: a parallel trends assumption. In this paper, we relax the parallel trend assumption by assuming a latent type variable and developing a type-specific parallel trend assumption. With a finite support assumption on the latent type va… ▽ More A key assumption of the differences-in-differences designs is that the average evolution of untreated potential outcomes is the same across different treatment cohorts: a parallel trends assumption. In this paper, we relax the parallel trend assumption by assuming a latent type variable and developing a type-specific parallel trend assumption. With a finite support assumption on the latent type variable and long pretreatment time periods, we show that an extremum classifier consistently estimates the type assignment. Based on the classification result, we propose a type-specific diff-in-diff estimator for type-specific ATT. By estimating the type-specific ATT, we study heterogeneity in treatment effect, in addition to heterogeneity in baseline outcomes. △ Less

Submitted 9 October, 2024; v1 submitted 5 April, 2022; originally announced April 2022.

Bayesian Estimation and Comparison of Conditional Moment Models

Authors: Siddhartha Chib, Minchul Shin, Anna Simoni

Abstract: We consider the Bayesian analysis of models in which the unknown distribution of the outcomes is specified up to a set of conditional moment restrictions. The nonparametric exponentially tilted empirical likelihood function is constructed to satisfy a sequence of unconditional moments based on an increasing (in sample size) vector of approximating functions (such as tensor splines based on the spl… ▽ More We consider the Bayesian analysis of models in which the unknown distribution of the outcomes is specified up to a set of conditional moment restrictions. The nonparametric exponentially tilted empirical likelihood function is constructed to satisfy a sequence of unconditional moments based on an increasing (in sample size) vector of approximating functions (such as tensor splines based on the splines of each conditioning variable). For any given sample size, results are robust to the number of expanded moments. We derive Bernstein-von Mises theorems for the behavior of the posterior distribution under both correct and incorrect specification of the conditional moments, subject to growth rate conditions (slower under misspecification) on the number of approximating functions. A large-sample theory for comparing different conditional moment models is also developed. The central result is that the marginal likelihood criterion selects the model that is less misspecified. We also introduce sparsity-based model search for high-dimensional conditioning variables, and provide efficient MCMC computations for high-dimensional parameters. Along with clarifying examples, the framework is illustrated with real-data applications to risk-factor determination in finance, and causal inference under conditional ignorability. △ Less

Submitted 26 October, 2021; originally announced October 2021.

Overnight GARCH-Itô Volatility Models

Authors: Donggyu Kim, Minseok Shin, Yazhen Wang

Abstract: Various parametric volatility models for financial data have been developed to incorporate high-frequency realized volatilities and better capture market dynamics. However, because high-frequency trading data are not available during the close-to-open period, the volatility models often ignore volatility information over the close-to-open period and thus may suffer from loss of important informati… ▽ More Various parametric volatility models for financial data have been developed to incorporate high-frequency realized volatilities and better capture market dynamics. However, because high-frequency trading data are not available during the close-to-open period, the volatility models often ignore volatility information over the close-to-open period and thus may suffer from loss of important information relevant to market dynamics. In this paper, to account for whole-day market dynamics, we propose an overnight volatility model based on Itô diffusions to accommodate two different instantaneous volatility processes for the open-to-close and close-to-open periods. We develop a weighted least squares method to estimate model parameters for two different periods and investigate its asymptotic properties. We conduct a simulation study to check the finite sample performance of the proposed model and method. Finally, we apply the proposed approaches to real trading data. △ Less

Submitted 17 June, 2022; v1 submitted 24 February, 2021; originally announced February 2021.

Measuring Human Adaptation to AI in Decision Making: Application to Evaluate Changes after AlphaGo

Authors: Minkyu Shin, Jin Kim, Minkyung Kim

Abstract: Across a growing number of domains, human experts are expected to learn from and adapt to AI with superior decision making abilities. But how can we quantify such human adaptation to AI? We develop a simple measure of human adaptation to AI and test its usefulness in two case studies. In Study 1, we analyze 1.3 million move decisions made by professional Go players and find that a positive form of… ▽ More Across a growing number of domains, human experts are expected to learn from and adapt to AI with superior decision making abilities. But how can we quantify such human adaptation to AI? We develop a simple measure of human adaptation to AI and test its usefulness in two case studies. In Study 1, we analyze 1.3 million move decisions made by professional Go players and find that a positive form of adaptation to AI (learning) occurred after the players could observe the reasoning processes of AI, rather than mere actions of AI. These findings based on our measure highlight the importance of explainability for human learning from AI. In Study 2, we test whether our measure is sufficiently sensitive to capture a negative form of adaptation to AI (cheating aided by AI), which occurred in a match between professional Go players. We discuss our measure's applications in domains other than Go, especially in domains in which AI's decision making ability will likely surpass that of human experts. △ Less

Submitted 31 January, 2021; v1 submitted 29 December, 2020; originally announced December 2020.

On the Aggregation of Probability Assessments: Regularized Mixtures of Predictive Densities for Eurozone Inflation and Real Interest Rates

Authors: Francis X. Diebold, Minchul Shin, Boyuan Zhang

Abstract: We propose methods for constructing regularized mixtures of density forecasts. We explore a variety of objectives and regularization penalties, and we use them in a substantive exploration of Eurozone inflation and real interest rate density forecasts. All individual inflation forecasters (even the ex post best forecaster) are outperformed by our regularized mixtures. From the Great Recession onwa… ▽ More We propose methods for constructing regularized mixtures of density forecasts. We explore a variety of objectives and regularization penalties, and we use them in a substantive exploration of Eurozone inflation and real interest rate density forecasts. All individual inflation forecasters (even the ex post best forecaster) are outperformed by our regularized mixtures. From the Great Recession onward, the optimal regularization tends to move density forecasts' probability mass from the centers to the tails, correcting for overconfidence. △ Less

Submitted 30 June, 2022; v1 submitted 21 December, 2020; originally announced December 2020.