-
How to Measure Evidence and Its Strength: Bayes Factors or Relative Belief Ratios?
Authors:
Luai Al-Labadi,
Ayman Alzaatreh,
Michael Evans
Abstract:
Both the Bayes factor and the relative belief ratio satisfy the principle of evidence and so can be seen to be valid measures of statistical evidence. Certainly Bayes factors are regularly employed. The question then is: which of these measures of evidence is more appropriate? It is argued here that there are questions concerning the validity of a current commonly used definition of the Bayes fact…
▽ More
Both the Bayes factor and the relative belief ratio satisfy the principle of evidence and so can be seen to be valid measures of statistical evidence. Certainly Bayes factors are regularly employed. The question then is: which of these measures of evidence is more appropriate? It is argued here that there are questions concerning the validity of a current commonly used definition of the Bayes factor based on a mixture prior and, when all is considered, the relative belief ratio has better properties as a measure of evidence. It is further shown that, when a natural restriction on the mixture prior is imposed, the Bayes factor equals the relative belief ratio obtained without using the mixture prior. Even with this restriction, this still leaves open the question of how the strength of evidence is to be measured. It is argued here that the current practice of using the size of the Bayes factor to measure strength is not correct and a solution to this issue is presented. Several general criticisms of these measures of evidence are also discussed and addressed.
△ Less
Submitted 26 February, 2024; v1 submitted 21 January, 2023;
originally announced January 2023.
-
Measuring Bayesian Robustness Using Rényi Divergence
Authors:
Luai Al-Labadi,
Ce Wang
Abstract:
This paper deals with measuring the Bayesian robustness of classes of contaminated priors. Two different classes of priors in the neighborhood of the elicited prior are considered. The first one is the well-known $ε$-contaminated class, while the second one is the geometric mixing class. The proposed measure of robustness is based on computing the curvature of Rényi divergence between posterior di…
▽ More
This paper deals with measuring the Bayesian robustness of classes of contaminated priors. Two different classes of priors in the neighborhood of the elicited prior are considered. The first one is the well-known $ε$-contaminated class, while the second one is the geometric mixing class. The proposed measure of robustness is based on computing the curvature of Rényi divergence between posterior distributions. Examples are used to illustrate the results by using simulated and real data sets.
△ Less
Submitted 17 February, 2021; v1 submitted 15 May, 2019;
originally announced May 2019.
-
A Bayesian Nonparametric Test for Assessing Multivariate Normality
Authors:
Luai Al-Labadi,
Forough Fazeli Asl,
Zahra Saberi
Abstract:
In this paper, a novel Bayesian nonparametric test for assessing multivariate normal models is presented. While there are extensive frequentist and graphical methods for testing multivariate normality, it is challenging to find Bayesian counterparts. The proposed approach is based on the use of the Dirichlet process and Mahalanobis distance. More precisely, the Mahalanobis distance is employed as…
▽ More
In this paper, a novel Bayesian nonparametric test for assessing multivariate normal models is presented. While there are extensive frequentist and graphical methods for testing multivariate normality, it is challenging to find Bayesian counterparts. The proposed approach is based on the use of the Dirichlet process and Mahalanobis distance. More precisely, the Mahalanobis distance is employed as a good technique to transform the $m$-variate problem into a univariate problem. Then the Dirichlet process is used as a prior on the distribution of the Mahalanobis distance. The concentration of the distribution of the distance between the posterior process and the chi-square distribution with $m$ degrees of freedom is compared to the concentration of the distribution of the distance between the prior process and the chi-square distribution with $m$ degrees of freedom via a relative belief ratio. The distance between the Dirichlet process and the chi-square distribution is established based on the Anderson-Darling distance. Key theoretical results of the approach are derived. The procedure is illustrated through several examples, in which the proposed approach shows excellent performance.
△ Less
Submitted 7 July, 2020; v1 submitted 4 April, 2019;
originally announced April 2019.
-
On one-sample Bayesian tests for the mean
Authors:
Ibrahim Abdelrazeq,
Luai Al-Labadi
Abstract:
This paper deals with a new Bayesian approach to the standard one-sample $z$- and $t$- tests. More specifically, let $x_1,\ldots,x_n$ be an independent random sample from a normal distribution with mean $μ$ and variance $σ^2$. The goal is to test the null hypothesis $\mathcal{H}_0: μ=μ_1$ against all possible alternatives. The approach is based on using the well-known formula of the Kullbak-Leible…
▽ More
This paper deals with a new Bayesian approach to the standard one-sample $z$- and $t$- tests. More specifically, let $x_1,\ldots,x_n$ be an independent random sample from a normal distribution with mean $μ$ and variance $σ^2$. The goal is to test the null hypothesis $\mathcal{H}_0: μ=μ_1$ against all possible alternatives. The approach is based on using the well-known formula of the Kullbak-Leibler divergence between two normal distributions (sampling and hypothesized distributions selected in an appropriate way). The change of the distance from a priori to a posteriori is compared through the relative belief ratio (a measure of evidence). Eliciting the prior, checking for prior-data conflict and bias are also considered. Many theoretical properties of the procedure have been developed. Besides it's simplicity, and unlike the classical approach, the new approach possesses attractive and distinctive features such as giving evidence in favor of the null hypothesis. It also avoids several undesirable paradoxes, such as Lindley's paradox that may be encountered by some existing Bayesian methods. The use of the approach has been illustrated through several examples.
△ Less
Submitted 30 March, 2020; v1 submitted 3 March, 2019;
originally announced March 2019.
-
Kullback-Leibler Divergence for Bayesian Nonparametric Model Checking
Authors:
Luai Al-Labadi,
Viskakh Patel,
Kasra Vakiloroayaei,
Clement Wan
Abstract:
Bayesian nonparametric statistics is an area of considerable research interest. While recently there has been an extensive concentration in developing Bayesian nonparametric procedures for model checking, the use of the Dirichlet process, in its simplest form, along with the Kullback-Leibler divergence is still an open problem. This is mainly attributed to the discreteness property of the Dirichle…
▽ More
Bayesian nonparametric statistics is an area of considerable research interest. While recently there has been an extensive concentration in developing Bayesian nonparametric procedures for model checking, the use of the Dirichlet process, in its simplest form, along with the Kullback-Leibler divergence is still an open problem. This is mainly attributed to the discreteness property of the Dirichlet process and that the Kullback-Leibler divergence between any discrete distribution and any continuous distribution is infinity. The approach proposed in this paper, which is based on incorporating the Dirichlet process, the Kullback-Leibler divergence and the relative belief ratio, is considered the first concrete solution to this issue. Applying the approach is simple and does not require obtaining a closed form of the relative belief ratio. A Monte Carlo study and real data examples show that the developed approach exhibits excellent performance.
△ Less
Submitted 14 March, 2019; v1 submitted 2 March, 2019;
originally announced March 2019.
-
A Bayesian Nonparametric Estimation to Entropy
Authors:
Luai Al-Labadi,
Viskakh Patel,
Kasra Vakiloroayaei,
Clement Wan
Abstract:
A Bayesian nonparametric estimator to entropy is proposed. The derivation of the new estimator relies on using the Dirichlet process and adapting the well-known frequentist estimators of Vasicek (1976) and Ebrahimi, Pflughoeft and Soofi (1994). Several theoretical properties, such as consistency, of the proposed estimator are obtained. The quality of the proposed estimator has been investigated th…
▽ More
A Bayesian nonparametric estimator to entropy is proposed. The derivation of the new estimator relies on using the Dirichlet process and adapting the well-known frequentist estimators of Vasicek (1976) and Ebrahimi, Pflughoeft and Soofi (1994). Several theoretical properties, such as consistency, of the proposed estimator are obtained. The quality of the proposed estimator has been investigated through several examples, in which it exhibits excellent performance.
△ Less
Submitted 1 January, 2020; v1 submitted 2 March, 2019;
originally announced March 2019.
-
The Two-Sample Problem Via Relative Belief Ratio
Authors:
Luai Al-Labadi
Abstract:
This paper deals with a new Bayesian approach to the two-sample problem. More specifically, let $x=(x_1,\ldots,x_{n_1})$ and $y=(y_1,\ldots,y_{n_2})$ be two independent samples coming from unknown distributions $F$ and $G$, respectively. The goal is to test the null hypothesis $\mathcal{H}_0:~F=G$ against all possible alternatives. First, a Dirichlet process prior for $F$ and $G$ is considered. Th…
▽ More
This paper deals with a new Bayesian approach to the two-sample problem. More specifically, let $x=(x_1,\ldots,x_{n_1})$ and $y=(y_1,\ldots,y_{n_2})$ be two independent samples coming from unknown distributions $F$ and $G$, respectively. The goal is to test the null hypothesis $\mathcal{H}_0:~F=G$ against all possible alternatives. First, a Dirichlet process prior for $F$ and $G$ is considered. Then the change of their Cramér-von Mises distance from a priori to a posteriori is compared through the relative belief ratio. Many theoretical properties of the procedure have been developed and several examples have been discussed, in which the proposed approach shows excellent performance.
△ Less
Submitted 17 May, 2018;
originally announced May 2018.
-
Statistical Reasoning: Choosing and Checking the Ingredients, Inferences Based on a Measure of Statistical Evidence with Some Applications
Authors:
Luai Al-Labadi,
Zeynep Baskurt,
Michael Evans
Abstract:
The features of a logically sound approach to a theory of statistical reasoning are discussed. A particular approach that satisfies these criteria is reviewed. This is seen to involve selection of a model, model checking, elicitation of a prior, checking the prior for bias, checking for prior-data conflict and estimation and hypothesis assessment inferences based on a measure of evidence. A long-s…
▽ More
The features of a logically sound approach to a theory of statistical reasoning are discussed. A particular approach that satisfies these criteria is reviewed. This is seen to involve selection of a model, model checking, elicitation of a prior, checking the prior for bias, checking for prior-data conflict and estimation and hypothesis assessment inferences based on a measure of evidence. A long-standing anomalous example is resolved by this approach to inference and an application is made to a practical problem of considerable importance which, among other novel aspects of the analysis, involves the development of a relevant elicitation algorithm.
△ Less
Submitted 17 February, 2018;
originally announced February 2018.
-
On Metrizing Vague Convergence of Random Measures with Applications on Bayesian Nonparametric Models
Authors:
Luai Al-Labadi
Abstract:
This paper deals with studying vague convergence of random measures of the form $μ_{n}=\sum_{i=1}^{n} p_{i,n} δ_{θ_i}$, where $(θ_i)_{1\le i \le n}$ is a sequence of independent and identically distributed random variables with common distribution $Π$, $(p_{i,n})_{1 \le i \le n}$ are random variables chosen according to certain procedures and are independent of $(θ_i)_{i \geq 1}$ and $δ_{θ_i}$ den…
▽ More
This paper deals with studying vague convergence of random measures of the form $μ_{n}=\sum_{i=1}^{n} p_{i,n} δ_{θ_i}$, where $(θ_i)_{1\le i \le n}$ is a sequence of independent and identically distributed random variables with common distribution $Π$, $(p_{i,n})_{1 \le i \le n}$ are random variables chosen according to certain procedures and are independent of $(θ_i)_{i \geq 1}$ and $δ_{θ_i}$ denotes the Dirac measure at $θ_i$. We show that $μ_{n}$ converges vaguely to $μ=\sum_{i=1}^{\infty} p_{i} δ_{θ_i}$ if and only if $μ^{(k)}_{n}=\sum_{i=1}^{k} p_{i,n} δ_{θ_i}$ converges vaguely to $μ^{(k)}=\sum_{i=1}^{k} p_{i} δ_{θ_i}$ for all $k$ fixed. The limiting process $μ$ plays a central role in many areas in statistics, including Bayesian nonparametric models. A finite approximation of the beta process is derived from the application of this result. A simulated example is incorporated, in which the proposed approach exhibits an excellent performance over several existing algorithms.
△ Less
Submitted 10 October, 2016;
originally announced October 2016.
-
Optimal Robustness Results for Some Bayesian Procedures and the Relationship to Prior-Data Conflict
Authors:
Luai Al-Labadi,
Michael Evans
Abstract:
The robustness to the prior of Bayesian inference procedures based on a measure of statistical evidence are considered. These inferences are shown to have optimal properties with respect to robustness. Furthermore, a connection between robustness and prior-data conflict is established. In particular, the inferences are shown to be effectively robust when the choice of prior does not lead to prior-…
▽ More
The robustness to the prior of Bayesian inference procedures based on a measure of statistical evidence are considered. These inferences are shown to have optimal properties with respect to robustness. Furthermore, a connection between robustness and prior-data conflict is established. In particular, the inferences are shown to be effectively robust when the choice of prior does not lead to prior-data conflict. When there is prior-data conflict, however, robustness may fail to hold.
△ Less
Submitted 26 April, 2015;
originally announced April 2015.
