Objective Bayesian Analysis for the Differential Entropy of the Gamma Distribution
Authors:
Eduardo Ramos,
Osafu A. Egbon,
Pedro L. Ramos,
Francisco A. Rodrigues,
Francisco Louzada
Abstract:
The present paper introduces a fully objective Bayesian analysis to obtain the posterior distribution of an entropy measure. Notably, we consider the gamma distribution, which describes many natural phenomena in physics, engineering, and biology. We reparametrize the model in terms of entropy, and different objective priors are derived, such as Jeffreys prior, reference prior, and matching priors.…
▽ More
The present paper introduces a fully objective Bayesian analysis to obtain the posterior distribution of an entropy measure. Notably, we consider the gamma distribution, which describes many natural phenomena in physics, engineering, and biology. We reparametrize the model in terms of entropy, and different objective priors are derived, such as Jeffreys prior, reference prior, and matching priors. Since the obtained priors are improper, we prove that the obtained posterior distributions are proper and that their respective posterior means are finite. An intensive simulation study is conducted to select the prior that returns better results regarding bias, mean square error, and coverage probabilities. The proposed approach is illustrated in two datasets: the first relates to the Achaemenid dynasty reign period, and the second describes the time to failure of an electronic component in a sugarcane harvest machine.
△ Less
Submitted 13 November, 2023; v1 submitted 27 December, 2020;
originally announced December 2020.
Power laws distributions in objective priors
Authors:
Pedro L. Ramos,
Francisco A. Rodrigues,
Eduardo Ramos,
Dipak K. Dey,
Francisco Louzada
Abstract:
The use of objective prior in Bayesian applications has become a common practice to analyze data without subjective information. Formal rules usually obtain these priors distributions, and the data provide the dominant information in the posterior distribution. However, these priors are typically improper and may lead to improper posterior. Here, we show, for a general family of distributions, tha…
▽ More
The use of objective prior in Bayesian applications has become a common practice to analyze data without subjective information. Formal rules usually obtain these priors distributions, and the data provide the dominant information in the posterior distribution. However, these priors are typically improper and may lead to improper posterior. Here, we show, for a general family of distributions, that the obtained objective priors for the parameters either follow a power-law distribution or has an asymptotic power-law behavior. As a result, we observed that the exponents of the model are between 0.5 and 1. Understand these behaviors allow us to easily verify if such priors lead to proper or improper posteriors directly from the exponent of the power-law. The general family considered in our study includes essential models such as Exponential, Gamma, Weibull, Nakagami-m, Haf-Normal, Rayleigh, Erlang, and Maxwell Boltzmann distributions, to list a few. In summary, we show that comprehending the mechanisms describing the shapes of the priors provides essential information that can be used in situations where additional complexity is presented.
△ Less
Submitted 15 May, 2020;
originally announced May 2020.