Showing 1–10 of 10 results for author: Lindqvist, B H

Conditional Monte Carlo revisited

Authors: Bo Henry Lindqvist, Rasmus Erlemann, Gunnar Taraldsen

Abstract: Conditional Monte Carlo refers to sampling from the conditional distribution of a random vector X given the value T(X) = t for a function T(X). Classical conditional Monte Carlo methods were designed for estimating conditional expectations of functions of X by sampling from unconditional distributions obtained by certain weighting schemes. The basic ingredients were the use of importance sampling… ▽ More Conditional Monte Carlo refers to sampling from the conditional distribution of a random vector X given the value T(X) = t for a function T(X). Classical conditional Monte Carlo methods were designed for estimating conditional expectations of functions of X by sampling from unconditional distributions obtained by certain weighting schemes. The basic ingredients were the use of importance sampling and change of variables. In the present paper we reformulate the problem by introducing an artificial parametric model, representing the conditional distribution of X given T(X)=t within this new model. The key is to provide the parameter of the artificial model by a distribution. The approach is illustrated by several examples, which are particularly chosen to illustrate conditional sampling in cases where such sampling is not straightforward. A simulation study and an application to goodness-of-fit testing of real data are also given. △ Less

Submitted 14 October, 2020; originally announced October 2020.

Conditional Goodness-of-Fit Tests for Discrete Distributions

Authors: Rasmus Erlemann, Bo Henry Lindqvist

Abstract: In this paper, we address the problem of testing goodness-of-fit for discrete distributions, where we focus on the geometric distribution. We define new likelihood-based goodness-of-fit tests using the beta-geometric distribution and the type I discrete Weibull distribution as alternative distributions. The tests are compared in a simulation study, where also the classical goodness-of-fit tests ar… ▽ More In this paper, we address the problem of testing goodness-of-fit for discrete distributions, where we focus on the geometric distribution. We define new likelihood-based goodness-of-fit tests using the beta-geometric distribution and the type I discrete Weibull distribution as alternative distributions. The tests are compared in a simulation study, where also the classical goodness-of-fit tests are considered for comparison. Throughout the paper we consider conditional testing given a minimal sufficient statistic under the null hypothesis, which enables the calculation of exact p-values. For this purpose, a new method is developed for drawing conditional samples from the geometric distribution and the negative binomial distribution. We also explain briefly how the conditional approach can be modified for the binomial, negative binomial and Poisson distributions. It is finally noted that the simulation method may be extended to other discrete distributions having the same sufficient statistic, by using the Metropolis-Hastings algorithm. △ Less

Submitted 8 October, 2020; originally announced October 2020.

Fiducial and Posterior Sampling

Authors: Gunnar Taraldsen, Bo H. Lindqvist

Abstract: The fiducial coincides with the posterior in a group model equipped with the right Haar prior. This result is here generalized. For this the underlying probability space of Kolmogorov is replaced by a $σ$-finite measure space and fiducial theory is presented within this frame. Examples are presented that demonstrate that this also gives good alternatives to existing Bayesian sampling methods. It i… ▽ More The fiducial coincides with the posterior in a group model equipped with the right Haar prior. This result is here generalized. For this the underlying probability space of Kolmogorov is replaced by a $σ$-finite measure space and fiducial theory is presented within this frame. Examples are presented that demonstrate that this also gives good alternatives to existing Bayesian sampling methods. It is proved that the results provided here for fiducial models imply that the theory of invariant measures for groups cannot be generalized directly to loops: There exist a smooth one-dimensional loop where an invariant measure does not exist. Keywords: Conditional sampling, Improper prior, Haar prior, Sufficient statistic, Quasi-group △ Less

Submitted 11 June, 2020; originally announced June 2020.

Journal ref: Communications in Statistics - Theory and Methods, 44: 3754-3767, 2015

Conditional probability and improper priors

Authors: Gunnar Taraldsen, Bo H. Lindqvist

Abstract: The purpose of this paper is to present a mathematical theory that can be used as a foundation for statistics that include improper priors. This theory includes improper laws in the initial axioms and has in particular Bayes theorem as a consequence. Another consequence is that some of the usual calculation rules are modified. This is important in relation to common statistical practice which usua… ▽ More The purpose of this paper is to present a mathematical theory that can be used as a foundation for statistics that include improper priors. This theory includes improper laws in the initial axioms and has in particular Bayes theorem as a consequence. Another consequence is that some of the usual calculation rules are modified. This is important in relation to common statistical practice which usually include improper priors, but tends to use unaltered calculation rules. In some cases the results are valid, but in other cases inconsistencies may appear. The famous marginalization paradoxes exemplify this latter case. An alternative mathematical theory for the foundations of statistics can be formulated in terms of conditional probability spaces. In this case the appearance of improper laws is a consequence of the theory. It is proved here that the resulting mathematical structures for the two theories are equivalent. The conclusion is that the choice of the first or the second formulation for the initial axioms can be considered a matter of personal preference. Readers that initially have concerns regarding improper priors can possibly be more open toward a formulation of the initial axioms in terms of conditional probabilities. The interpretation of an improper law is given by the corresponding conditional probabilities. Keywords: Axioms of statistics, Conditional probability space, Improper prior, Projective space △ Less

Submitted 7 June, 2020; originally announced June 2020.

Journal ref: Communications in Statistics - Theory and Methods, 45:17, 5007-5016

Discussion of "Nonparametric generalized fiducial inference for survival functions under censoring"

Authors: G. Taraldsen, B. H. Lindqvist

Abstract: The following discussion is inspired by the paper Nonparametric generalized fiducial inference for survival functions under censoring by Cui and Hannig. The discussion consists of comments on the results, but also indicates it's importance more generally in the context of fiducial inference. A two page introduction to fiducial inference is given to provide a context. The following discussion is inspired by the paper Nonparametric generalized fiducial inference for survival functions under censoring by Cui and Hannig. The discussion consists of comments on the results, but also indicates it's importance more generally in the context of fiducial inference. A two page introduction to fiducial inference is given to provide a context. △ Less

Submitted 21 May, 2019; originally announced May 2019.

Statistics with improper posteriors

Authors: Gunnar Taraldsen, Jarle Tufto, Bo H. Lindqvist

Abstract: In 1933 Kolmogorov constructed a general theory that defines the modern concept of conditional probability. In 1955 Renyi fomulated a new axiomatic theory for probability motivated by the need to include unbounded measures. We introduce a general concept of conditional probability in Renyi spaces. In this theory improper priors are allowed, and the resulting posteriors can also be improper. In 1933 Kolmogorov constructed a general theory that defines the modern concept of conditional probability. In 1955 Renyi fomulated a new axiomatic theory for probability motivated by the need to include unbounded measures. We introduce a general concept of conditional probability in Renyi spaces. In this theory improper priors are allowed, and the resulting posteriors can also be improper. △ Less

Submitted 4 December, 2018; originally announced December 2018.

MSC Class: Foundations and philosophical topics (62A01); Bayesian inference (62F15); Bayesian problems and characterization of Bayes procedures (62C10)

On the proper treatment of improper distributions

Authors: Bo H. Lindqvist, Gunnar Taraldsen

Abstract: The axiomatic foundation of probability theory presented by Kolmogorov has been the basis of modern theory for probability and statistics. In certain applications it is, however, necessary or convenient to allow improper (unbounded) distributions, which is often done without a theoretical foundation. The paper reviews a recent theory which includes improper distributions, and which is related to R… ▽ More The axiomatic foundation of probability theory presented by Kolmogorov has been the basis of modern theory for probability and statistics. In certain applications it is, however, necessary or convenient to allow improper (unbounded) distributions, which is often done without a theoretical foundation. The paper reviews a recent theory which includes improper distributions, and which is related to Renyi's theory of conditional probability spaces. It is in particular demonstrated how the theory leads to simple explanations of apparent paradoxes known from the Bayesian literature. Several examples from statistical practice with improper distributions are discussed in light of the given theoretical results, which also include a recent theory of convergence of proper distributions to improper ones. △ Less

Submitted 6 November, 2017; originally announced November 2017.

Comments: Journal of Statistical Planning and Inference, 2017

MSC Class: 62C10 (Primary) 62A01; 60A05; 60A10 (Secondary)

Conditional fiducial models

Authors: Gunnar Taraldsen, Bo H. Lindqvist

Abstract: The fiducial is not unique in general, but we prove that in a restricted class of models it is uniquely determined by the sampling distribution of the data. It depends in particular not on the choice of a data generating model. The arguments lead to a generalization of the classical formula found by Fisher (1930). The restricted class includes cases with discrete distributions, the case of the sha… ▽ More The fiducial is not unique in general, but we prove that in a restricted class of models it is uniquely determined by the sampling distribution of the data. It depends in particular not on the choice of a data generating model. The arguments lead to a generalization of the classical formula found by Fisher (1930). The restricted class includes cases with discrete distributions, the case of the shape parameter in the Gamma distribution, and also the case of the correlation coefficient in a bivariate Gaussian model. One of the examples can also be used in a pedagogical context to demonstrate possible difficulties with likelihood-, Bayesian-, and bootstrap-inference. Examples that demonstrate non-uniqueness are also presented. It is explained that they can be seen as cases with restrictions on the parameter space. Motivated by this the concept of a conditional fiducial model is introduced. This class of models includes the common case of iid samples from a one-parameter model investigated by Hannig (2013), the structural group models investigated by Fraser (1968), and also certain models discussed by Fisher (1973) in his final writing on the subject. △ Less

Submitted 2 November, 2017; originally announced November 2017.

Improper posteriors are not improper

Authors: Gunnar Taraldsen, Jarle Tufto, Bo H. Lindqvist

Abstract: In 1933 Kolmogorov constructed a general theory that defines the modern concept of conditional expectation. In 1955 Renyi fomulated a new axiomatic theory for probability motivated by the need to include unbounded measures. We introduce a general concept of conditional expectation in Renyi spaces. In this theory improper priors are allowed, and the resulting posterior can also be improper. In 19… ▽ More In 1933 Kolmogorov constructed a general theory that defines the modern concept of conditional expectation. In 1955 Renyi fomulated a new axiomatic theory for probability motivated by the need to include unbounded measures. We introduce a general concept of conditional expectation in Renyi spaces. In this theory improper priors are allowed, and the resulting posterior can also be improper. In 1965 Lindley published his classic text on Bayesian statistics using the theory of Renyi, but retracted this idea in 1973 due to the appearance of marginalization paradoxes presented by Dawid, Stone, and Zidek. The paradoxes are investigated, and the seemingly conflicting results are explained. The theory of Renyi can hence be used as an axiomatic basis for statistics that allows use of unbounded priors. Keywords: Haldane's prior; Poisson intensity; Marginalization paradox; Measure theory; conditional probability space; axioms for statistics; conditioning on a sigma field; improper prior △ Less

Submitted 4 December, 2017; v1 submitted 24 October, 2017; originally announced October 2017.

Fiducial theory and optimal inference

Authors: Gunnar Taraldsen, Bo Henry Lindqvist

Abstract: It is shown that the fiducial distribution in a group model, or more generally a quasigroup model, determines the optimal equivariant frequentist inference procedures. The proof does not rely on existence of invariant measures, and generalizes results corresponding to the choice of the right Haar measure as a Bayesian prior. Classical and more recent examples show that fiducial arguments can be us… ▽ More It is shown that the fiducial distribution in a group model, or more generally a quasigroup model, determines the optimal equivariant frequentist inference procedures. The proof does not rely on existence of invariant measures, and generalizes results corresponding to the choice of the right Haar measure as a Bayesian prior. Classical and more recent examples show that fiducial arguments can be used to give good candidates for exact or approximate confidence distributions. It is here suggested that the fiducial algorithm can be considered as an alternative to the Bayesian algorithm for the construction of good frequentist inference procedures more generally. △ Less

Submitted 8 April, 2013; v1 submitted 8 January, 2013; originally announced January 2013.

Comments: Published in at http://dx.doi.org/10.1214/13-AOS1083 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS1083

Journal ref: Annals of Statistics 2013, Vol. 41, No. 1, 323-341