-
Likelihood Asymptotics in Nonregular Settings: A Review with Emphasis on the Likelihood Ratio
Authors:
Alessandra R. Brazzale,
Valentina Mameli
Abstract:
This paper reviews the most common situations where one or more regularity conditions which underlie classical likelihood-based parametric inference fail. We identify three main classes of problems: boundary problems, indeterminate parameter problems -- which include non-identifiable parameters and singular information matrices -- and change-point problems. The review focuses on the large-sample p…
▽ More
This paper reviews the most common situations where one or more regularity conditions which underlie classical likelihood-based parametric inference fail. We identify three main classes of problems: boundary problems, indeterminate parameter problems -- which include non-identifiable parameters and singular information matrices -- and change-point problems. The review focuses on the large-sample properties of the likelihood ratio statistic. We emphasize analytical solutions and acknowledge software implementations where available. We furthermore give summary insight about the possible tools to derivate the key results. Other approaches to hypothesis testing and connections to estimation are listed in the annotated bibliography of the Supplementary Material.
△ Less
Submitted 26 April, 2023; v1 submitted 30 June, 2022;
originally announced June 2022.
-
Robust inference for nonlinear regression models from the Tsallis score: application to Covid-19 contagion in Italy
Authors:
Paolo Girardi,
Luca Greco,
Valentina Mameli,
Monica Musio,
Walter Racugno,
Erlis Ruli,
Laura Ventura
Abstract:
We discuss an approach for fitting robust nonlinear regression models, which can be employed to model and predict the contagion dynamics of the Covid-19 in Italy. The focus is on the analysis of epidemic data using robust dose-response curves, but the functionality is applicable to arbitrary nonlinear regression models.
We discuss an approach for fitting robust nonlinear regression models, which can be employed to model and predict the contagion dynamics of the Covid-19 in Italy. The focus is on the analysis of epidemic data using robust dose-response curves, but the functionality is applicable to arbitrary nonlinear regression models.
△ Less
Submitted 9 April, 2020; v1 submitted 7 April, 2020;
originally announced April 2020.
-
The Hyvärinen scoring rule in Gaussian linear time series models
Authors:
Silvia Columbu,
Valentina Mameli,
Monica Musio,
A. Philip Dawid
Abstract:
Likelihood-based estimation methods involve the normalising constant of the model distributions, expressed as a function of the parameter. However in many problems this function is not easily available, and then less efficient but more easily computed estimators may be attractive. In this work we study stationary time-series models, and construct and analyse "score-matching'' estimators, that do n…
▽ More
Likelihood-based estimation methods involve the normalising constant of the model distributions, expressed as a function of the parameter. However in many problems this function is not easily available, and then less efficient but more easily computed estimators may be attractive. In this work we study stationary time-series models, and construct and analyse "score-matching'' estimators, that do not involve the normalising constant. We consider two scenarios: a single series of increasing length, and an increasing number of independent series of fixed length. In the latter case there are two variants, one based on the full data, and another based on a sufficient statistic. We study the empirical performance of these estimators in three special cases, autoregressive (\AR), moving average (MA) and fractionally differenced white noise (\ARFIMA) models, and make comparisons with full and pairwise likelihood estimators. The results are somewhat model-dependent, with the new estimators doing well for $\MA$ and \ARFIMA\ models, but less so for $\AR$ models.
△ Less
Submitted 29 April, 2019;
originally announced April 2019.
-
Objective Bayesian inference with proper scoring rules
Authors:
Federica Giummolè,
Valentina Mameli,
Erlis Ruli,
Laura Ventura
Abstract:
Standard Bayesian analyses can be difficult to perform when the full likelihood, and consequently the full posterior distribution, is too complex and difficult to specify or if robustness with respect to data or to model misspecifications is required. In these situations, we suggest to resort to a posterior distribution for the parameter of interest based on proper scoring rules. Scoring rules are…
▽ More
Standard Bayesian analyses can be difficult to perform when the full likelihood, and consequently the full posterior distribution, is too complex and difficult to specify or if robustness with respect to data or to model misspecifications is required. In these situations, we suggest to resort to a posterior distribution for the parameter of interest based on proper scoring rules. Scoring rules are loss functions designed to measure the quality of a probability distribution for a random variable, given its observed value. Important examples are the Tsallis score and the Hyvärinen score, which allow us to deal with model misspecifications or with complex models. Also the full and the composite likelihoods are both special instances of scoring rules.
The aim of this paper is twofold. Firstly, we discuss the use of scoring rules in the Bayes formula in order to compute a posterior distribution, named SR-posterior distribution, and we derive its asymptotic normality. Secondly, we propose a procedure for building default priors for the unknown parameter of interest that can be used to update the information provided by the scoring rule in the SR-posterior distribution. In particular, a reference prior is obtained by maximizing the average $α-$divergence from the SR-posterior distribution. For $0 \leq |α|<1$, the result is a Jeffreys-type prior that is proportional to the square root of the determinant of the Godambe information matrix associated to the scoring rule. Some examples are discussed.
△ Less
Submitted 6 January, 2019; v1 submitted 29 November, 2017;
originally announced November 2017.
-
Comparisons of Hyvärinen and pairwise estimators in two simple linear time series models
Authors:
Valentina Mameli,
Monica Musio,
A. Philip Dawid
Abstract:
The aim of this paper is to compare numerically the performance of two estimators based on Hyvärinen's local homogeneous scoring rule with that of the full and the pairwise maximum likelihood estimators. In particular, two different model settings, for which both full and pairwise maximum likelihood estimators can be obtained, have been considered: the first order autoregressive model (AR(1)) and…
▽ More
The aim of this paper is to compare numerically the performance of two estimators based on Hyvärinen's local homogeneous scoring rule with that of the full and the pairwise maximum likelihood estimators. In particular, two different model settings, for which both full and pairwise maximum likelihood estimators can be obtained, have been considered: the first order autoregressive model (AR(1)) and the moving average model (MA(1)). Simulation studies highlight very different behaviours for the Hyvärinen scoring rule estimators relative to the pairwise likelihood estimators in these two settings.
△ Less
Submitted 12 September, 2014;
originally announced September 2014.
-
A Generalization of the Skew-Normal Distribution: The Beta Skew-Normal
Authors:
Valentina Mameli,
Monica Musio
Abstract:
The aim of this article is to introduce a new family of distributions, which generalizes the skew normal distribution (SN). This new family, called Beta skew-normal (BSN), arises naturally when we consider the distributions of order statistics of the SN. The BSN can also be obtained as a special case of the Beta generated distribution (Jones (2004)). In this work we pay attention to three other ge…
▽ More
The aim of this article is to introduce a new family of distributions, which generalizes the skew normal distribution (SN). This new family, called Beta skew-normal (BSN), arises naturally when we consider the distributions of order statistics of the SN. The BSN can also be obtained as a special case of the Beta generated distribution (Jones (2004)). In this work we pay attention to three other generalizations of the SN distribution: the Balakrishnan skew-normal (SNB) (Balakrishnan (2002), as a discussant of Arnold and Beaver (2002), Gupta and Gupta (2004), Sharafi and Behboodian (2008)), the generalized Balakrishnan skew-normal (GBSN) (Yadegari et al. (2008)) and a two parameter generalization of the Balakrishnan skew-normal (TBSN) (Bahrami et al. (2009)). The above three extensions are related to the Beta skew-normal distribution for particular values of the parameters. The paper is organized as follows: after describing briefly, in Section 2, the skew-normal distribution, its generalizations and listing their most important properties, in Section 3 we present some generalizations of the Beta distribution. In the last Section we define the Beta skew-normal distribution, we present its properties and some special cases. In particular the BSN contains the Beta half-normal distribution (Pescim et al. (2010)) as limiting case. Besides, we investigate its shape properties. We derive its moment generating function and we also compute numerically the first moment, the variance, the skewness and the kurtosis. We present two different methods which allow to simulate a BSN distribution. We explore its relationships with the other generalizations of the SN. We give some results concerning the SNB distribution. In particular we derive the exact distributions of the largest order statistic from SNB with parameters m and 1 and the shortest order statistic SNB with parameters m and -1.
△ Less
Submitted 21 April, 2011;
originally announced April 2011.
-
Using Integrated Nested Laplace Approximation for Modeling Spatial Healthcare Utilization
Authors:
Erik A. Sauleau,
Valentina Mameli,
Monica Musio
Abstract:
In recent years, spatial and spatio-temporal modeling have become an important area of research in many fields (epidemiology, environmental studies, disease mapping). In this work we propose different spatial models to study hospital recruitment, including some potentially explicative variables. Interest is on the distribution per geographical unit of the ratio between the number of patients livin…
▽ More
In recent years, spatial and spatio-temporal modeling have become an important area of research in many fields (epidemiology, environmental studies, disease mapping). In this work we propose different spatial models to study hospital recruitment, including some potentially explicative variables. Interest is on the distribution per geographical unit of the ratio between the number of patients living in this geographical unit and the population in the same unit. Models considered are within the framework of Bayesian Latent Gaussian models. Our response variable is assumed to follow a binomial distribution, with logit link, whose parameters are the population in the geographical unit and the corresponding relative risk. The structured additive predictor accounts for effects of various covariates in an additive way, including smoothing functions of the covariates (for example spatial effect), linear effect of covariates. To approximate posterior marginals, which not available in closed form, we use integrated nested Laplace approximations (INLA), recently proposed for approximate Bayesian inference in latent Gaussian models. INLA has the advantage of giving very accurate approximations and being faster than McMC methods when the number of parameters does not exceed 6 (as it is in our case). Model comparisons are assessed using DIC criterion.
△ Less
Submitted 18 June, 2010;
originally announced June 2010.
