-
Inference Functions for Semiparametric Models
Authors:
Rodrigo Labouriau
Abstract:
The paper discusses inference techniques for semiparametric models based on suitable versions of inference functions. The text contains two parts. In the first part, we review the optimality theory for non-parametric models based on the notions of path differentiability and statistical functional differentiability. Those notions are adapted to the context of semiparametric models by applying the i…
▽ More
The paper discusses inference techniques for semiparametric models based on suitable versions of inference functions. The text contains two parts. In the first part, we review the optimality theory for non-parametric models based on the notions of path differentiability and statistical functional differentiability. Those notions are adapted to the context of semiparametric models by applying the inference theory of statistical functionals to the functional that associates the value of the interest parameter to the corresponding probability measure. The second part of the paper discusses the theory of inference functions for semiparametric models. We define a class of regular inference functions, and provide two equivalent characterisations of those inference functions: One adapted from the classic theory of inference functions for parametric models, and one motivated by differential geometric considerations concerning the statistical model. Those characterisations yield an optimality theory for estimation under semiparametric models. We present a necessary and sufficient condition for the coincidence of the bound for the concentration of estimators based on inference functions and the semiparametric Cramèr-Rao bound. Projecting the score function for the parameter of interest on specially designed spaces of functions, we obtain optimal inference functions. Considering estimation when a sufficient statistic is present, we provide an alternative justification for the conditioning principle in a context of semiparametric models. The article closes with a characterisation of when the semiparametric Cramèr-Rao bound is attained by estimators derived from regular inference functions.
△ Less
Submitted 14 November, 2020;
originally announced November 2020.
-
Construction and Extension of Dispersion Models
Authors:
Rodrigo Labouriau
Abstract:
There are two main classes of dispersion models studied in the literature: proper (PDM), and exponential dispersion models (EDM). Dispersion models that are neither proper nor exponential dispersion models are termed here non-standard dispersion models (NSDM). This paper exposes a technique for constructing new PDMs and NSDMs. This construction provides a solution to an open question in the theory…
▽ More
There are two main classes of dispersion models studied in the literature: proper (PDM), and exponential dispersion models (EDM). Dispersion models that are neither proper nor exponential dispersion models are termed here non-standard dispersion models (NSDM). This paper exposes a technique for constructing new PDMs and NSDMs. This construction provides a solution to an open question in the theory of dispersion models about the extension of non-standard dispersion models. Given a unit deviance function, a dispersion model is usually constructed by calculating a normalising function that makes the density function integrates one. This calculation involves the solution of non-trivial integral equations. The main idea explored here is to use characteristic functions of real non-lattice symmetric probability measures to construct a family of unit deviances that are sufficiently regular to make the associated integral equations tractable. The integral equations associated to those unit deviances admit a trivial solution, in the sense that the normalising function is a constant function independent of the observed values. However, we show, using the machinery of distributions (i.e., generalised functions) and expansions of the normalising function with respect to specially constructed Riez systems, that those integral equations also admit infinitely many non-trivial solutions, generating many NSDMs. We conclude that, the cardinality of the class of non-standard dispersion models is larger than the cardinality of the class of real non-lattice symmetric probability measures.
△ Less
Submitted 18 August, 2020; v1 submitted 12 August, 2020;
originally announced August 2020.
-
On the Bias of the Score Function of Finite Mixture Models
Authors:
Rodrigo Labouriau
Abstract:
We characterise the unbiasedness of the score function, viewed as an inference function for a class of finite mixture models. The models studied represent the situation where there is a stratification of the observations in a finite number of groups. We show that, under mild regularity conditions, the score function for estimating the parameters identifying each group's distribution is unbiased. W…
▽ More
We characterise the unbiasedness of the score function, viewed as an inference function for a class of finite mixture models. The models studied represent the situation where there is a stratification of the observations in a finite number of groups. We show that, under mild regularity conditions, the score function for estimating the parameters identifying each group's distribution is unbiased. We also show that if one introduces a mixture in the scenario described above so that for some observations, it is only known that they belong to some of the groups with a probability not in $\{ 0, 1 \}$, then the score function becomes biased. We argue then that under further mild regularity, the maximum likelihood estimate is not consistent. The results above are extended to regular models containing arbitrary nuisance parameters, including semiparametric models.
△ Less
Submitted 15 May, 2023; v1 submitted 9 February, 2020;
originally announced February 2020.
-
The Laplace transform and polynomial approximation in L2
Authors:
Rodrigo Labouriau
Abstract:
This short note gives a sufficient condition for having the class of polynomials dense in the space of square integrable functions with respect to a finite measure dominated by the Lebesgue measure in the real line, here denoted by $L^2$. It is shown that if the Laplace transform of the measure in play is bounded in a neighbourhood of the origin, then the moments of all order are finite and the cl…
▽ More
This short note gives a sufficient condition for having the class of polynomials dense in the space of square integrable functions with respect to a finite measure dominated by the Lebesgue measure in the real line, here denoted by $L^2$. It is shown that if the Laplace transform of the measure in play is bounded in a neighbourhood of the origin, then the moments of all order are finite and the class of polynomials is dense in $L^2$. The existence of the moments of all orders is well known for the case where the measure is concentrated in the positive real line (see Feller, 1966), but the result concerning the polynomial approximation is original, even thought the proof is relatively simple. Additionally, an alternative stronger condition easier to be verified not involving the calculation of the Laplace transform is given. The condition essentially says that the density of the measure should have exponential decaying tails. The tools presented are of interest for constructing semiparametric extensions of classic parametric models.
△ Less
Submitted 9 March, 2016;
originally announced March 2016.
