-
Bayesian Estimation and Comparison of Conditional Moment Models
Authors:
Siddhartha Chib,
Minchul Shin,
Anna Simoni
Abstract:
We consider the Bayesian analysis of models in which the unknown distribution of the outcomes is specified up to a set of conditional moment restrictions. The nonparametric exponentially tilted empirical likelihood function is constructed to satisfy a sequence of unconditional moments based on an increasing (in sample size) vector of approximating functions (such as tensor splines based on the spl…
▽ More
We consider the Bayesian analysis of models in which the unknown distribution of the outcomes is specified up to a set of conditional moment restrictions. The nonparametric exponentially tilted empirical likelihood function is constructed to satisfy a sequence of unconditional moments based on an increasing (in sample size) vector of approximating functions (such as tensor splines based on the splines of each conditioning variable). For any given sample size, results are robust to the number of expanded moments. We derive Bernstein-von Mises theorems for the behavior of the posterior distribution under both correct and incorrect specification of the conditional moments, subject to growth rate conditions (slower under misspecification) on the number of approximating functions. A large-sample theory for comparing different conditional moment models is also developed. The central result is that the marginal likelihood criterion selects the model that is less misspecified. We also introduce sparsity-based model search for high-dimensional conditioning variables, and provide efficient MCMC computations for high-dimensional parameters. Along with clarifying examples, the framework is illustrated with real-data applications to risk-factor determination in finance, and causal inference under conditional ignorability.
△ Less
Submitted 26 October, 2021;
originally announced October 2021.
-
Gaussian processes and Bayesian moment estimation
Authors:
Jean-Pierre Florens,
Anna Simoni
Abstract:
Given a set of moment restrictions (MRs) that overidentify a parameter $θ$, we investigate a semiparametric Bayesian approach for inference on $θ$ that does not restrict the data distribution $F$ apart from the MRs. As main contribution, we construct a degenerate Gaussian process prior that, conditionally on $θ$, restricts the $F$ generated by this prior to satisfy the MRs with probability one. Ou…
▽ More
Given a set of moment restrictions (MRs) that overidentify a parameter $θ$, we investigate a semiparametric Bayesian approach for inference on $θ$ that does not restrict the data distribution $F$ apart from the MRs. As main contribution, we construct a degenerate Gaussian process prior that, conditionally on $θ$, restricts the $F$ generated by this prior to satisfy the MRs with probability one. Our prior works even in the more involved case where the number of MRs is larger than the dimension of $θ$. We demonstrate that the corresponding posterior for $θ$ is computationally convenient. Moreover, we show that there exists a link between our procedure, the Generalized Empirical Likelihood with quadratic criterion and the limited information likelihood-based procedures. We provide a frequentist validation of our procedure by showing consistency and asymptotic normality of the posterior distribution of $θ$. The finite sample properties of our method are illustrated through Monte Carlo experiments and we provide an application to demand estimation in the airline market.
△ Less
Submitted 10 September, 2019; v1 submitted 25 July, 2016;
originally announced July 2016.
-
Bayesian Estimation and Comparison of Moment Condition Models
Authors:
Siddhartha Chib,
Minchul Shin,
Anna Simoni
Abstract:
In this paper we consider the problem of inference in statistical models characterized by moment restrictions by casting the problem within the Exponentially Tilted Empirical Likelihood (ETEL) framework. Because the ETEL function has a well defined probabilistic interpretation and plays the role of a nonparametric likelihood, a fully Bayesian semiparametric framework can be developed. We establish…
▽ More
In this paper we consider the problem of inference in statistical models characterized by moment restrictions by casting the problem within the Exponentially Tilted Empirical Likelihood (ETEL) framework. Because the ETEL function has a well defined probabilistic interpretation and plays the role of a nonparametric likelihood, a fully Bayesian semiparametric framework can be developed. We establish a number of powerful results surrounding the Bayesian ETEL framework in such models. One major concern driving our work is the possibility of misspecification. To accommodate this possibility, we show how the moment conditions can be reexpressed in terms of additional nuisance parameters and that, even under misspecification, the Bayesian ETEL posterior distribution satisfies a Bernstein-von Mises result. A second key contribution of the paper is the development of a framework based on marginal likelihoods and Bayes factors to compare models defined by different moment conditions. Computation of the marginal likelihoods is by the method of Chib (1995) as extended to Metropolis-Hastings samplers in Chib and Jeliazkov (2001). We establish the model selection consistency of the marginal likelihood and show that the marginal likelihood favors the model with the minimum number of parameters and the maximum number of valid moment restrictions. When the models are misspecified, the marginal likelihood model selection procedure selects the model that is closer to the (unknown) true data generating process in terms of the Kullback-Leibler divergence. The ideas and results in this paper provide a further broadening of the theoretical underpinning and value of the Bayesian ETEL framework with likely far-reaching practical consequences. The discussion is illuminated through several examples.
△ Less
Submitted 7 April, 2017; v1 submitted 9 June, 2016;
originally announced June 2016.
-
Adaptive Bayesian estimation in indirect Gaussian sequence space models
Authors:
Jan Johannes,
Anna Simoni,
Rudolf Schenk
Abstract:
In an indirect Gaussian sequence space model lower and upper bounds are derived for the concentration rate of the posterior distribution of the parameter of interest shrinking to the parameter value $θ^\circ$ that generates the data. While this establishes posterior consistency, however, the concentration rate depends on both $θ^\circ$ and a tuning parameter which enters the prior distribution. We…
▽ More
In an indirect Gaussian sequence space model lower and upper bounds are derived for the concentration rate of the posterior distribution of the parameter of interest shrinking to the parameter value $θ^\circ$ that generates the data. While this establishes posterior consistency, however, the concentration rate depends on both $θ^\circ$ and a tuning parameter which enters the prior distribution. We first provide an oracle optimal choice of the tuning parameter, i.e., optimized for each $θ^\circ$ separately. The optimal choice of the prior distribution allows us to derive an oracle optimal concentration rate of the associated posterior distribution. Moreover, for a given class of parameters and a suitable choice of the tuning parameter, we show that the resulting uniform concentration rate over the given class is optimal in a minimax sense. Finally, we construct a hierarchical prior that is adaptive. This means that, given a parameter $θ^\circ$ or a class of parameters, respectively, the posterior distribution contracts at the oracle rate or at the minimax rate over the class. Notably, the hierarchical prior does not depend neither on $θ^\circ$ nor on the given class. Moreover, convergence of the fully data-driven Bayes estimator at the oracle or at the minimax rate is established.
△ Less
Submitted 31 January, 2015;
originally announced February 2015.
-
Semi-parametric Bayesian Partially Identified Models based on Support Function
Authors:
Yuan Liao,
Anna Simoni
Abstract:
We provide a comprehensive semi-parametric study of Bayesian partially identified econometric models. While the existing literature on Bayesian partial identification has mostly focused on the structural parameter, our primary focus is on Bayesian credible sets (BCS's) of the unknown identified set and the posterior distribution of its support function. We construct a (two-sided) BCS based on the…
▽ More
We provide a comprehensive semi-parametric study of Bayesian partially identified econometric models. While the existing literature on Bayesian partial identification has mostly focused on the structural parameter, our primary focus is on Bayesian credible sets (BCS's) of the unknown identified set and the posterior distribution of its support function. We construct a (two-sided) BCS based on the support function of the identified set. We prove the Bernstein-von Mises theorem for the posterior distribution of the support function. This powerful result in turn infers that, while the BCS and the frequentist confidence set for the partially identified parameter are asymptotically different, our constructed BCS for the identified set has an asymptotically correct frequentist coverage probability. Importantly, we illustrate that the constructed BCS for the identified set does not require a prior on the structural parameter. It can be computed efficiently for subset inference, especially when the target of interest is a sub-vector of the partially identified parameter, where projecting to a low-dimensional subset is often required. Hence, the proposed methods are useful in many applications.
The Bayesian partial identification literature has been assuming a known parametric likelihood function. However, econometric models usually only identify a set of moment inequalities, and therefore using an incorrect likelihood function may result in misleading inferences. In contrast, with a nonparametric prior on the unknown likelihood function, our proposed Bayesian procedure only requires a set of moment conditions, and can efficiently make inference about both the partially identified parameter and its identified set. This makes it widely applicable in general moment inequality models. Finally, the proposed method is illustrated in a financial asset pricing problem.
△ Less
Submitted 22 November, 2013; v1 submitted 13 December, 2012;
originally announced December 2012.
-
Lorentz Transformations as Lie-Poisson Symmetries
Authors:
A. Simoni,
A. Stern,
I. Yakushin
Abstract:
We write down the Poisson structure for a relativistic particle where the Lorentz group does not act canonically, but instead as a Poisson-Lie group. In so doing we obtain the classical limit of a particle moving on a noncommutative space possessing $SL_q(2,C)$ invariance. We show that if the standard mass shell constraint is chosen for the Hamiltonian function, then the particle interacts with…
▽ More
We write down the Poisson structure for a relativistic particle where the Lorentz group does not act canonically, but instead as a Poisson-Lie group. In so doing we obtain the classical limit of a particle moving on a noncommutative space possessing $SL_q(2,C)$ invariance. We show that if the standard mass shell constraint is chosen for the Hamiltonian function, then the particle interacts with the space-time. We solve for the trajectory and find that it originates and terminates at singularities.
△ Less
Submitted 25 January, 1995;
originally announced January 1995.