-
Likelihood Asymptotics in Nonregular Settings: A Review with Emphasis on the Likelihood Ratio
Authors:
Alessandra R. Brazzale,
Valentina Mameli
Abstract:
This paper reviews the most common situations where one or more regularity conditions which underlie classical likelihood-based parametric inference fail. We identify three main classes of problems: boundary problems, indeterminate parameter problems -- which include non-identifiable parameters and singular information matrices -- and change-point problems. The review focuses on the large-sample p…
▽ More
This paper reviews the most common situations where one or more regularity conditions which underlie classical likelihood-based parametric inference fail. We identify three main classes of problems: boundary problems, indeterminate parameter problems -- which include non-identifiable parameters and singular information matrices -- and change-point problems. The review focuses on the large-sample properties of the likelihood ratio statistic. We emphasize analytical solutions and acknowledge software implementations where available. We furthermore give summary insight about the possible tools to derivate the key results. Other approaches to hypothesis testing and connections to estimation are listed in the annotated bibliography of the Supplementary Material.
△ Less
Submitted 26 April, 2023; v1 submitted 30 June, 2022;
originally announced June 2022.
-
Objective Bayesian inference with proper scoring rules
Authors:
Federica Giummolè,
Valentina Mameli,
Erlis Ruli,
Laura Ventura
Abstract:
Standard Bayesian analyses can be difficult to perform when the full likelihood, and consequently the full posterior distribution, is too complex and difficult to specify or if robustness with respect to data or to model misspecifications is required. In these situations, we suggest to resort to a posterior distribution for the parameter of interest based on proper scoring rules. Scoring rules are…
▽ More
Standard Bayesian analyses can be difficult to perform when the full likelihood, and consequently the full posterior distribution, is too complex and difficult to specify or if robustness with respect to data or to model misspecifications is required. In these situations, we suggest to resort to a posterior distribution for the parameter of interest based on proper scoring rules. Scoring rules are loss functions designed to measure the quality of a probability distribution for a random variable, given its observed value. Important examples are the Tsallis score and the Hyvärinen score, which allow us to deal with model misspecifications or with complex models. Also the full and the composite likelihoods are both special instances of scoring rules.
The aim of this paper is twofold. Firstly, we discuss the use of scoring rules in the Bayes formula in order to compute a posterior distribution, named SR-posterior distribution, and we derive its asymptotic normality. Secondly, we propose a procedure for building default priors for the unknown parameter of interest that can be used to update the information provided by the scoring rule in the SR-posterior distribution. In particular, a reference prior is obtained by maximizing the average $α-$divergence from the SR-posterior distribution. For $0 \leq |α|<1$, the result is a Jeffreys-type prior that is proportional to the square root of the determinant of the Godambe information matrix associated to the scoring rule. Some examples are discussed.
△ Less
Submitted 6 January, 2019; v1 submitted 29 November, 2017;
originally announced November 2017.
-
A Generalization of the Skew-Normal Distribution: The Beta Skew-Normal
Authors:
Valentina Mameli,
Monica Musio
Abstract:
The aim of this article is to introduce a new family of distributions, which generalizes the skew normal distribution (SN). This new family, called Beta skew-normal (BSN), arises naturally when we consider the distributions of order statistics of the SN. The BSN can also be obtained as a special case of the Beta generated distribution (Jones (2004)). In this work we pay attention to three other ge…
▽ More
The aim of this article is to introduce a new family of distributions, which generalizes the skew normal distribution (SN). This new family, called Beta skew-normal (BSN), arises naturally when we consider the distributions of order statistics of the SN. The BSN can also be obtained as a special case of the Beta generated distribution (Jones (2004)). In this work we pay attention to three other generalizations of the SN distribution: the Balakrishnan skew-normal (SNB) (Balakrishnan (2002), as a discussant of Arnold and Beaver (2002), Gupta and Gupta (2004), Sharafi and Behboodian (2008)), the generalized Balakrishnan skew-normal (GBSN) (Yadegari et al. (2008)) and a two parameter generalization of the Balakrishnan skew-normal (TBSN) (Bahrami et al. (2009)). The above three extensions are related to the Beta skew-normal distribution for particular values of the parameters. The paper is organized as follows: after describing briefly, in Section 2, the skew-normal distribution, its generalizations and listing their most important properties, in Section 3 we present some generalizations of the Beta distribution. In the last Section we define the Beta skew-normal distribution, we present its properties and some special cases. In particular the BSN contains the Beta half-normal distribution (Pescim et al. (2010)) as limiting case. Besides, we investigate its shape properties. We derive its moment generating function and we also compute numerically the first moment, the variance, the skewness and the kurtosis. We present two different methods which allow to simulate a BSN distribution. We explore its relationships with the other generalizations of the SN. We give some results concerning the SNB distribution. In particular we derive the exact distributions of the largest order statistic from SNB with parameters m and 1 and the shortest order statistic SNB with parameters m and -1.
△ Less
Submitted 21 April, 2011;
originally announced April 2011.
