Showing 1–4 of 4 results for author: Ramamoorthi, R V

On posterior concentration rates for Bayesian quantile regression based on the misspecified asymmetric Laplace likelihood

Authors: Karthik Sriram, R. V. Ramamoorthi

Abstract: The asymmetric Laplace density (ALD) is used as a working likelihood for Bayesian quantile regression. Sriram et al.(2013) derived posterior consistency for Bayesian linear quantile regression based on the misspecified ALD. While their paper also argued for $\sqrt{n}-$consistency, Sriram and Ramamoorthi (2017) highlighted that the argument was only valid for a rate less than $\sqrt{n}$. So, the qu… ▽ More The asymmetric Laplace density (ALD) is used as a working likelihood for Bayesian quantile regression. Sriram et al.(2013) derived posterior consistency for Bayesian linear quantile regression based on the misspecified ALD. While their paper also argued for $\sqrt{n}-$consistency, Sriram and Ramamoorthi (2017) highlighted that the argument was only valid for a rate less than $\sqrt{n}$. So, the question of $\sqrt{n}-$rate has remained unaddressed, but is necessary to carry out meaningful Bayesian inference based on the ALD. In this paper, we derive results to obtain posterior consistency rates for Bayesian quantile regression based on the misspecified ALD. We derive our results in a slightly general setting where the quantile function can possibly be non-linear. In particular, we give sufficient conditions for $\sqrt{n}-$consistency for the Bayesian linear quantile regression using ALD. We also provide examples of Bayesian non-linear quantile regression. △ Less

Submitted 8 August, 2020; v1 submitted 10 December, 2018; originally announced December 2018.

Comments: There is an error in the paper. We have realized that Assumption 2b in page 5 of the paper may be incorrect and the issue remains unresolved as of August 8, 2020

Posterior consistency in misspecified models for i.n.i.d response

Authors: Karthik Sriram, R. V. Ramamoorthi

Abstract: We derive conditions for posterior consistency when the responses are independent but not identically distributed ($i.n.i.d$) and the model is "misspecified" to be a family of densities parametrized by a possibly infinite dimensional parameter. Our approach has connections to key ideas developed for $i.i.d$ models in Kleijn and van der Vaart(2006) and it's subsequent simplification in Ramamoorthi,… ▽ More We derive conditions for posterior consistency when the responses are independent but not identically distributed ($i.n.i.d$) and the model is "misspecified" to be a family of densities parametrized by a possibly infinite dimensional parameter. Our approach has connections to key ideas developed for $i.i.d$ models in Kleijn and van der Vaart(2006) and it's subsequent simplification in Ramamoorthi, et al.(2014) (unpublished manuscript). While key results in these two papers rely heavily on the convexity of the specified family of densities, parametric families are seldom convex. In this note, we take a direct approach to deriving posterior consistency with respect to natural topologies on the parameter space without having to impose conditions on the convex hull of the parametric family. We first derive our results for the case when the responses are $i.i.d$ and then extend it to the $i.n.i.d$ case. As an example, we demonstrate the applicability of the results to the Bayesian quantile estimation problem. △ Less

Submitted 26 August, 2014; originally announced August 2014.

On Posterior Concentration in Misspecified Models

Authors: R. V. Ramamoorthi, Karthik Sriram, Ryan Martin

Abstract: We investigate the asymptotic behavior of Bayesian posterior distributions under independent and identically distributed ($i.i.d.$) misspecified models. More specifically, we study the concentration of the posterior distribution on neighborhoods of $f^{\star}$, the density that is closest in the Kullback--Leibler sense to the true model $f_0$. We note, through examples, the need for assumptions be… ▽ More We investigate the asymptotic behavior of Bayesian posterior distributions under independent and identically distributed ($i.i.d.$) misspecified models. More specifically, we study the concentration of the posterior distribution on neighborhoods of $f^{\star}$, the density that is closest in the Kullback--Leibler sense to the true model $f_0$. We note, through examples, the need for assumptions beyond the usual Kullback--Leibler support assumption. We then investigate consistency with respect to a general metric under three assumptions, each based on a notion of divergence measure, and then apply these to a weighted $L_1$-metric in convex models and non-convex models. Although a few results on this topic are available, we believe that these are somewhat inaccessible due, in part, to the technicalities and the subtle differences compared to the more familiar well-specified model case. One of our goals is to make some of the available results, especially that of , more accessible. Unlike their paper, our approach does not require construction of test sequences. We also discuss a preliminary extension of the $i.i.d.$ results to the independent but not identically distributed ($i.n.i.d.$) case. △ Less

Submitted 3 December, 2015; v1 submitted 16 December, 2013; originally announced December 2013.

Comments: Published at http://dx.doi.org/10.1214/15-BA941 in the Bayesian Analysis (http://projecteuclid.org/euclid.ba) by the International Society of Bayesian Analysis (http://bayesian.org/)

Report number: VTeX-BA-BA941

Journal ref: Bayesian Analysis 2015, Vol. 10, No. 4, 759-789

Remarks on consistency of posterior distributions

Authors: Taeryon Choi, R. V. Ramamoorthi

Abstract: In recent years, the literature in the area of Bayesian asymptotics has been rapidly growing. It is increasingly important to understand the concept of posterior consistency and validate specific Bayesian methods, in terms of consistency of posterior distributions. In this paper, we build up some conceptual issues in consistency of posterior distributions, and discuss panoramic views of them by… ▽ More In recent years, the literature in the area of Bayesian asymptotics has been rapidly growing. It is increasingly important to understand the concept of posterior consistency and validate specific Bayesian methods, in terms of consistency of posterior distributions. In this paper, we build up some conceptual issues in consistency of posterior distributions, and discuss panoramic views of them by comparing various approaches to posterior consistency that have been investigated in the literature. In addition, we provide interesting results on posterior consistency that deal with non-exponential consistency, improper priors and non i.i.d. (independent but not identically distributed) observations. We describe a few examples for illustrative purposes. △ Less

Submitted 21 May, 2008; originally announced May 2008.

Comments: Published in at http://dx.doi.org/10.1214/074921708000000138 the IMS Collections (http://www.imstat.org/publications/imscollections.htm) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-COLL3-IMSCOLL313 MSC Class: 62G20 (Primary) 62C10; 62F15 (Secondary)

Journal ref: IMS Collections 2008, Vol. 3, 170-186