-
Bias Corrected Variance Stabilizing Transformation for Small Area Estimation
Authors:
Masayo Y. Hirose,
Malay Ghosh,
Mayumi Oka
Abstract:
Small area estimation models are typically based on the normality assumption of response variables. More recently, attention has been drawn to the transformation of the original variables to justify the assumption of normality. Variance stabilizing transformation of observation serves the dual purpose of reaching closer to normality, as well as known variance of the transformed variables in contra…
▽ More
Small area estimation models are typically based on the normality assumption of response variables. More recently, attention has been drawn to the transformation of the original variables to justify the assumption of normality. Variance stabilizing transformation of observation serves the dual purpose of reaching closer to normality, as well as known variance of the transformed variables in contrast to the assumption of known variances of the original variables, the latter needed to avoid non-identifiability. However, the existing literature on the topic ignores a certain bias introduced in the seemingly correct back transformation. The present paper rectifies this deficiency by introducing asymptotically unbiased empirical Bayes (EB) estimators of small area means. Mean squared errors (MSEs) and estimated MSEs of such estimators are provided. The theoretical results were accompanied with simulations and data analysis. A somewhat surprising phenomenon is a finding which connects one of our results to the natural exponential family quadratic variance function (NEF-QVF) family of distributions introduced by Morris (1982,1983).
△ Less
Submitted 6 July, 2025;
originally announced July 2025.
-
Impact of existence and nonexistence of pivot on the coverage of empirical best linear prediction intervals for small areas
Authors:
Yuting Chen,
Masayo Y. Hirose,
Partha Lahiri
Abstract:
We advance the theory of parametric bootstrap in constructing highly efficient empirical best (EB) prediction intervals of small area means. The coverage error of such a prediction interval is of the order $O(m^{-3/2})$, where $m$ is the number of small areas to be pooled using a linear mixed normal model. In the context of an area level model where the random effects follow a non-normal known dis…
▽ More
We advance the theory of parametric bootstrap in constructing highly efficient empirical best (EB) prediction intervals of small area means. The coverage error of such a prediction interval is of the order $O(m^{-3/2})$, where $m$ is the number of small areas to be pooled using a linear mixed normal model. In the context of an area level model where the random effects follow a non-normal known distribution except possibly for unknown hyperparameters, we analytically show that the order of coverage error of empirical best linear (EBL) prediction interval remains the same even if we relax the normality of the random effects by the existence of pivot for a suitably standardized random effects when hyperpameters are known. Recognizing the challenge of showing existence of a pivot, we develop a simple moment-based method to claim non-existence of pivot. We show that existing parametric bootstrap EBL prediction interval fails to achieve the desired order of the coverage error, i.e. $O(m^{-3/2})$, in absence of a pivot. We obtain a surprising result that the order $O(m^{-1})$ term is always positive under certain conditions indicating possible overcoverage of the existing parametric bootstrap EBL prediction interval. In general, we analytically show for the first time that the coverage problem can be corrected by adopting a suitably devised double parametric bootstrap. Our Monte Carlo simulations show that our proposed single bootstrap method performs reasonably well when compared to rival methods.
△ Less
Submitted 17 October, 2024; v1 submitted 14 October, 2024;
originally announced October 2024.
-
Small Area Estimation under Square Root Transformed Fay-Herriot model with Functional Measurement Error in Covariates
Authors:
Ka Long Keith Ho,
Masayo Y. Hirose,
Malay Ghosh
Abstract:
We consider a small area estimation model under square-root transformation in the presence of functional measurement error. When measurement error is present, the Bayes predictor can no longer be used as it depends on the covariates even if parameters are known. Therefore suitable replacements are called for, and we propose a predictor that only depends on observed responses and data obtained from…
▽ More
We consider a small area estimation model under square-root transformation in the presence of functional measurement error. When measurement error is present, the Bayes predictor can no longer be used as it depends on the covariates even if parameters are known. Therefore suitable replacements are called for, and we propose a predictor that only depends on observed responses and data obtained from a large secondary survey. Moreover, some estimating methods of unknown parameters are considered. In the simulations section, We evaluate the performance using the mean squared prediction error (MSPE) and discuss several scenarios in terms of the number of areas and the sample size in a large secondary survey.
△ Less
Submitted 26 September, 2023;
originally announced September 2023.
-
Multi-Goal Prior Selection: A Way to Reconcile Bayesian and Classical Approaches for Random Effects Models
Authors:
Masayo Y. Hirose,
Partha Lahiri
Abstract:
The two-level normal hierarchical model has played an important role in statistical theory and applications. In this paper, we first introduce a general adjusted maximum likelihood method for estimating the unknown variance component of the model and the associated empirical best linear unbiased predictor of the random effects. We then discuss a new idea for selecting prior for the hyperparameters…
▽ More
The two-level normal hierarchical model has played an important role in statistical theory and applications. In this paper, we first introduce a general adjusted maximum likelihood method for estimating the unknown variance component of the model and the associated empirical best linear unbiased predictor of the random effects. We then discuss a new idea for selecting prior for the hyperparameters. The prior, called a multi-goal prior, produces Bayesian solutions for hyperparmeters and random effects that match (in the higher order asymptotic sense) the corresponding classical solution in linear mixed model with respect to several properties. Moreover, we establish for the first time an analytical equivalence of the posterior variances under the proposed multi-goal prior and the corresponding parametric bootstrap second-order mean squared error estimates in the context of a random effects model.
△ Less
Submitted 24 January, 2019;
originally announced January 2019.
-
A New Model Variance Estimator for an Area Level Small Area Model to Solve Multiple Problems Simultaneously
Authors:
Masayo Yoshimori Hirose,
Partha Lahiri
Abstract:
The two-level normal hierarchical model (NHM) has played a critical role in the theory of small area estimation (SAE), one of the growing areas in statistics with numerous applications in different disciplines. In this paper, we address major well-known shortcomings associated with the empirical best linear unbiased prediction (EBLUP) of a small area mean and its mean squared error (MSE) estimatio…
▽ More
The two-level normal hierarchical model (NHM) has played a critical role in the theory of small area estimation (SAE), one of the growing areas in statistics with numerous applications in different disciplines. In this paper, we address major well-known shortcomings associated with the empirical best linear unbiased prediction (EBLUP) of a small area mean and its mean squared error (MSE) estimation by considering an appropriate model variance estimator that satisfies multiple properties. The proposed model variance estimator simultaneously (i) improves on the estimation of the related shrinkage factors, (ii) protects EBLUP from the common overshrinkage problem, (iii) avoids complex bias correction in generating strictly positive second-order unbiased mean square error (MSE) estimator either by the Taylor series or single parametric bootstrap method. The idea of achieving multiple desirable properties in an EBLUP method through a suitably devised model variance estimator is the first of its kind and holds promise in providing good inferences for small area means under the classical linear mixed model prediction framework. The proposed methodology is also evaluated using a Monte Carlo simulation study and real data analysis.
△ Less
Submitted 16 January, 2017;
originally announced January 2017.
-
Second-order unbiased naive estimator of mean squared error for EBLUP in small-area estimation
Authors:
Masayo Yoshimori Hirose
Abstract:
An empirical best linear unbiased prediction (EBLUP) estimator is utilized for efficient inference in small-area estimation. To measure its uncertainty, we need to estimate its mean squared error (MSE) since the true MSE cannot generally be derived in a closed form. The "naive MSE estimator", one of the estimators available for small-area inference, is unlikely to be chosen, since it does not achi…
▽ More
An empirical best linear unbiased prediction (EBLUP) estimator is utilized for efficient inference in small-area estimation. To measure its uncertainty, we need to estimate its mean squared error (MSE) since the true MSE cannot generally be derived in a closed form. The "naive MSE estimator", one of the estimators available for small-area inference, is unlikely to be chosen, since it does not achieve the desired asymptotic property, namely second-order unbiasedness, although it maintains strict positivity and tractability. Therefore, users tend to choose the second-order unbiased MSE estimator. In this paper, we seek a new adjusted maximum-likelihood method to obtain a naive MSE estimator that achieves the required asymptotic property. To obtain the result, we also reveal the relationship between the general adjusted maximum-likelihood method for the model variance parameter and the general functional form of the second-order unbiased, and strictly positive, MSE estimator. We also compare the performance of the new method with that of the existing naive estimator through a Monte Carlo simulation study. The results show that the new method remedies the underestimation associated with the existing naive estimator.
△ Less
Submitted 12 December, 2016;
originally announced December 2016.
