-
Robust Estimation in Step-Stress Experiments under Exponential Lifetime Distributions
Authors:
María Jaenada,
Juan Manuel Millán,
Leandro Pardo
Abstract:
Many modern products exhibit high reliability, often resulting in long times to failure. Consequently, conducting experiments under normal operating conditions may require an impractically long duration to obtain sufficient failure data for reliable statistical inference. As an alternative, accelerated life tests (ALTs) are employed to induce earlier failures and thereby reduce testing time. In st…
▽ More
Many modern products exhibit high reliability, often resulting in long times to failure. Consequently, conducting experiments under normal operating conditions may require an impractically long duration to obtain sufficient failure data for reliable statistical inference. As an alternative, accelerated life tests (ALTs) are employed to induce earlier failures and thereby reduce testing time. In step-stress experiments a stress factor that accelerates product degradation is identified and systematically increased to provoke early failures. The stress level is increased at predetermined time points and maintained constant between these intervals. Failure data observed under increased levels of stress is statistically analyzed, and results are then extrapolate to normal operating conditions.
Classical estimation methods such analysis rely on the maximum likelihood estimator (MLE) which is know to be very efficient, but lack robustness in the presence of outlying data. In this work, Minimum Density Power Divergence Estimators (MDPDEs) are proposed as a robust alternative, demonstrating an appealing compromise between efficiency and robustness. The MDPDE based on mixed distributions is developed, and its theoretical properties, including the expression for the asymptotic distribution of the model parameters, are derived under exponential lifetime assumptions. The good performance of the proposed method is evaluated through simulation studies, and its applicability is demonstrated using real data.
△ Less
Submitted 4 June, 2025;
originally announced June 2025.
-
Robust Rao-type tests for step-stress accelerated life-tests under interval-monitoring and Weibull lifetime distributions
Authors:
Narayanaswamy Balakrishnan,
María Jaenada,
Leandro Pardo
Abstract:
Many products in engineering are highly reliable with large mean lifetimes to failure. Performing lifetests under normal operations conditions would thus require long experimentation times and high experimentation costs. Alternatively, accelerated lifetests shorten the experimentation time by running the tests at higher than normal stress conditions, thus inducing more failures. Additionally, a lo…
▽ More
Many products in engineering are highly reliable with large mean lifetimes to failure. Performing lifetests under normal operations conditions would thus require long experimentation times and high experimentation costs. Alternatively, accelerated lifetests shorten the experimentation time by running the tests at higher than normal stress conditions, thus inducing more failures. Additionally, a log-linear regression model can be used to relate the lifetime distribution of the product to the level of stress it experiences. After estimating the parameters of this relationship, results can be extrapolated to normal operating conditions. On the other hand, censored data is common in reliability analysis. Interval-censored data arise when continuous inspection is difficult or infeasible due to technical or budgetary constraints. In this paper, we develop robust restricted estimators based on the density power divergence for step-stress accelerated life-tests under Weibull distributions with interval-censored data. We present theoretical asymptotic properties of the estimators and develop robust Rao-type test statistics based on the proposed robust estimators for testing composite null hypothesis on the model parameters.
△ Less
Submitted 9 February, 2024;
originally announced February 2024.
-
Robust inference for intermittently-monitored step-stress tests under Weibull lifetime distributions
Authors:
Narayanaswamy Balakrishnan,
María Jaenada,
Leandro Pardo
Abstract:
Many modern products exhibit high reliability under normal operating conditions. Conducting life tests under these conditions may result in very few observed failures, insufficient for accurate inferences. Instead, accelerated life tests (ALTs) must be performed. One of the most popular ALT designs is the step-stress test, which shortens the product's lifetime by progressively increasing the stres…
▽ More
Many modern products exhibit high reliability under normal operating conditions. Conducting life tests under these conditions may result in very few observed failures, insufficient for accurate inferences. Instead, accelerated life tests (ALTs) must be performed. One of the most popular ALT designs is the step-stress test, which shortens the product's lifetime by progressively increasing the stress level at which units are subjected to at some pre-specified times. Classical estimation methods based on the maximum likelihood estimator (MLE) enjoy suitable asymptotic properties but they lack robustness. That is, data contaminationcan significantly impact the statistical analysis. In this paper, we develop robust inferential methods for highly reliable devices based on the density power divergence (DPD) for estimating and testing under the step-stress model with intermittent monitoring and Weibull lifetime distributions. We theoretically and empirically examine asymptotic and robustness properties of the minimum DPD estimators and associated Wald-type test statistics. Moreover, we develop robust estimators and confidence intervals for some important lifetime characteristics. The effect of temperature in solar lights, medium power silicon bipolar transistors and LED lights using real data arising from an step-stress ALT is analyzed applying the robust methods proposed.
△ Less
Submitted 23 September, 2024; v1 submitted 5 July, 2022;
originally announced August 2022.
-
Robust inference for non-destructive one-shot device testing under step-stress model with exponential lifetimes
Authors:
Narayanaswamy Balakrishnan,
Elena Castilla,
María Jaenada,
Leandro Pardo
Abstract:
One-shot devices analysis involves an extreme case of interval censoring, wherein one can only know whether the failure time is either before or after the test time. Some kind of one-shot devices do not get destroyed when tested, and so can continue within the experiment, providing extra information for inference, if they did not fail before an inspection time. In addition, their reliability can b…
▽ More
One-shot devices analysis involves an extreme case of interval censoring, wherein one can only know whether the failure time is either before or after the test time. Some kind of one-shot devices do not get destroyed when tested, and so can continue within the experiment, providing extra information for inference, if they did not fail before an inspection time. In addition, their reliability can be rapidly estimated via accelerated life tests (ALTs) by running the tests at varying and higher stress levels than working conditions. In particular, step-stress tests allow the experimenter to increase the stress levels at pre-fixed times gradually during the life-testing experiment. The cumulative exposure model is commonly assumed for step-stress models, relating the lifetime distribution of units at one stress level to the lifetime distributions at preceding stress levels. In this paper,vwe develop robust estimators and Z-type test statistics based on the density power divergence (DPD) for testing linear null hypothesis for non-destructive one-shot devices under the step-stress ALTs with exponential lifetime distribution. We study asymptotic and robustness properties of the estimators and test statistics, yielding point estimation and confidence intervals for different lifetime characteristic such as reliability, distribution quantiles and mean lifetime of the devices. A simulation study is carried out to assess the performance of the methods of inference developed here and some real-life data sets are analyzed finally for illustrative purpose.
△ Less
Submitted 25 April, 2022;
originally announced April 2022.
-
Robust adaptive Lasso in high-dimensional logistic regression
Authors:
Ayanendranath Basu,
Abhik Ghosh,
María Jaenada,
Leandro Pardo
Abstract:
Penalized logistic regression is extremely useful for binary classification with large number of covariates (higher than the sample size), having several real life applications, including genomic disease classification. However, the existing methods based on the likelihood loss function are sensitive to data contamination and other noise and, hence, robust methods are needed for stable and more ac…
▽ More
Penalized logistic regression is extremely useful for binary classification with large number of covariates (higher than the sample size), having several real life applications, including genomic disease classification. However, the existing methods based on the likelihood loss function are sensitive to data contamination and other noise and, hence, robust methods are needed for stable and more accurate inference. In this paper, we propose a family of robust estimators for sparse logistic models utilizing the popular density power divergence based loss function and the general adaptively weighted LASSO penalties. We study the local robustness of the proposed estimators through its influence function and also derive its oracle properties and asymptotic distribution. With extensive empirical illustrations, we demonstrate the significantly improved performance of our proposed estimators over the existing ones with particular gain in robustness. Our proposal is finally applied to analyse four different real datasets for cancer classification, obtaining robust and accurate models, that simultaneously performs gene selection and patient classification.
△ Less
Submitted 7 April, 2023; v1 submitted 20 August, 2021;
originally announced September 2021.
-
Robust Hypothesis Testing and Model Selection for Parametric Proportional Hazard Regression Models
Authors:
Amarnath Nandy,
Abhik Ghosh,
Ayanendranath Basu,
Leandro Pardo
Abstract:
The semi-parametric Cox proportional hazards regression model has been widely used for many years in several applied sciences. However, a fully parametric proportional hazards model, if appropriately assumed, can often lead to more efficient inference. To tackle the extreme non-robustness of the traditional maximum likelihood estimator in the presence of outliers in the data under such fully param…
▽ More
The semi-parametric Cox proportional hazards regression model has been widely used for many years in several applied sciences. However, a fully parametric proportional hazards model, if appropriately assumed, can often lead to more efficient inference. To tackle the extreme non-robustness of the traditional maximum likelihood estimator in the presence of outliers in the data under such fully parametric proportional hazard models, a robust estimation procedure has recently been proposed extending the concept of the minimum density power divergence estimator (MDPDE) under this set-up. In this paper, we consider the problem of statistical inference under the parametric proportional hazards model and develop robust Wald-type hypothesis testing and model selection procedures using the MDPDEs. We have also derived the necessary asymptotic results which are used to construct the testing procedure for general composite hypothesis and study its asymptotic powers. The claimed robustness properties are studied theoretically via appropriate influence function analyses. We have studied the finite sample level and power of the proposed MDPDE based Wald type test through extensive simulations where comparisons are also made with the existing semi-parametric methods. The important issue of the selection of appropriate robustness tuning parameter is also discussed. The practical usefulness of the proposed robust testing and model selection procedures is finally illustrated through three interesting real data examples.
△ Less
Submitted 26 September, 2020;
originally announced September 2020.
-
Divergence-based robust inference under proportional hazards model for one-shot device life-test
Authors:
N. Balakrishnan,
E. Castilla,
N. Martin,
L. Pardo
Abstract:
In this paper, we develop robust estimators and tests for one-shot device testing under proportional hazards assumption based on divergence measures. Through a detailed Monte Carlo simulation study and a numerical example, the developed inferential procedures are shown to be more robust than the classical procedures, based on maximum likelihood estimators.
In this paper, we develop robust estimators and tests for one-shot device testing under proportional hazards assumption based on divergence measures. Through a detailed Monte Carlo simulation study and a numerical example, the developed inferential procedures are shown to be more robust than the classical procedures, based on maximum likelihood estimators.
△ Less
Submitted 28 April, 2020;
originally announced April 2020.
-
Power divergence approach for one-shot device testing under competing risks
Authors:
N. Balakrishnan,
E. Castilla,
N. Martin,
L. Pardo
Abstract:
Most work on one-shot devices assume that there is only one possible cause of device failure. However, in practice, it is often the case that the products under study can experience any one of various possible causes of failure. Robust estimators and Wald-type tests are developed here for the case of one-shot devices under competing risks. An extensive simulation study illustrates the robustness o…
▽ More
Most work on one-shot devices assume that there is only one possible cause of device failure. However, in practice, it is often the case that the products under study can experience any one of various possible causes of failure. Robust estimators and Wald-type tests are developed here for the case of one-shot devices under competing risks. An extensive simulation study illustrates the robustness of these divergence-based estimators and test procedures based on them. A data-driven procedure is proposed for choosing the optimal estimator for any given data set which is then applied to an example in the context of survival analysis.
△ Less
Submitted 28 April, 2020;
originally announced April 2020.
-
Robust adaptive variable selection in ultra-high dimensional linear regression models
Authors:
Abhik Ghosh,
Maria Jaenada,
Leandro Pardo
Abstract:
We consider the problem of simultaneous variable selection and estimation of the corresponding regression coefficients in an ultra-high dimensional linear regression models, an extremely important problem in the recent era. The adaptive penalty functions are used in this regard to achieve the oracle variable selection property along with easier computational burden. However, the usual adaptive pro…
▽ More
We consider the problem of simultaneous variable selection and estimation of the corresponding regression coefficients in an ultra-high dimensional linear regression models, an extremely important problem in the recent era. The adaptive penalty functions are used in this regard to achieve the oracle variable selection property along with easier computational burden. However, the usual adaptive procedures (e.g., adaptive LASSO) based on the squared error loss function is extremely non-robust in the presence of data contamination which are quite common with large-scale data (e.g., noisy gene expression data, spectra and spectral data). In this paper, we present a regularization procedure for the ultra-high dimensional data using a robust loss function based on the popular density power divergence (DPD) measure along with the adaptive LASSO penalty. We theoretically study the robustness and the large-sample properties of the proposed adaptive robust estimators for a general class of error distributions; in particular, we show that the proposed adaptive DPD-LASSO estimator is highly robust, satisfies the oracle variable selection property, and the corresponding estimators of the regression coefficients are consistent and asymptotically normal under easily verifiable set of assumptions. Numerical illustrations are provided for the mostly used normal error density. Finally, the proposal is applied to analyze an interesting spectral dataset, in the field of chemometrics, regarding the electron-probe X-ray microanalysis (EPXMA) of archaeological glass vessels from the 16th and 17th centuries.
△ Less
Submitted 20 September, 2023; v1 submitted 11 April, 2020;
originally announced April 2020.
-
A Robust Generalization of the Rao Test
Authors:
Ayanendranath Basu,
Abhik Ghosh,
Nirian Martin,
Leandro Pardo
Abstract:
This paper presents new families of Rao-type test statistics based on the minimum density power divergence estimators which provide robust generalizations for testing simple and composite null hypotheses. The asymptotic null distributions of the proposed tests are obtained and their robustness properties are also theoretically studied. Numerical illustrations are provided to substantiate the theor…
▽ More
This paper presents new families of Rao-type test statistics based on the minimum density power divergence estimators which provide robust generalizations for testing simple and composite null hypotheses. The asymptotic null distributions of the proposed tests are obtained and their robustness properties are also theoretically studied. Numerical illustrations are provided to substantiate the theory developed. On the whole, the proposed tests are seen to be excellent alternatives to the classical Rao test.
△ Less
Submitted 26 August, 2019;
originally announced August 2019.
-
Robust semiparametric inference for polytomous logistic regression with complex survey design
Authors:
Elena Castilla,
Abhik Ghosh,
Nirian Martin,
Leandro Pardo
Abstract:
Analyzing polytomous response from a complex survey scheme, like stratified or cluster sampling is very crucial in several socio-economics applications. We present a class of minimum quasi weighted density power divergence estimators for the polytomous logistic regression model with such a complex survey. This family of semiparametric estimators is a robust generalization of the maximum quasi weig…
▽ More
Analyzing polytomous response from a complex survey scheme, like stratified or cluster sampling is very crucial in several socio-economics applications. We present a class of minimum quasi weighted density power divergence estimators for the polytomous logistic regression model with such a complex survey. This family of semiparametric estimators is a robust generalization of the maximum quasi weighted likelihood estimator exploiting the advantages of the popular density power divergence measure. Accordingly robust estimators for the design effects are also derived. Robust testing of general linear hypotheses on the regression coefficients are proposed using the new estimators. Their asymptotic distributions and robustness properties are theoretically studied and also empirically validated through a numerical example and an extensive Monte Carlo study.
△ Less
Submitted 3 April, 2019;
originally announced April 2019.
-
A Robust Wald-type Test for Testing the Equality of Two Means from Log-Normal Samples
Authors:
Ayanendranath Basu,
Abhijit Mandal,
Nirian Martin,
Leandro Pardo
Abstract:
The log-normal distribution is one of the most common distributions used for modeling skewed and positive data. It frequently arises in many disciplines of science, specially in the biological and medical sciences. The statistical analysis for comparing the means of two independent log-normal distributions is an issue of significant interest. In this paper we present a robust test for this problem…
▽ More
The log-normal distribution is one of the most common distributions used for modeling skewed and positive data. It frequently arises in many disciplines of science, specially in the biological and medical sciences. The statistical analysis for comparing the means of two independent log-normal distributions is an issue of significant interest. In this paper we present a robust test for this problem. The unknown parameters of the model are estimated by minimum density power divergence estimators (Basu et al 1998, Biometrika, 85(3), 549-559). The robustness as well as the asymptotic properties of the proposed test statistics are rigorously established. The performance of the test is explored through simulations and real data analysis. The test is compared with some existing methods, and it is demonstrated that the proposed test outperforms the others in the presence of outliers.
△ Less
Submitted 29 April, 2018;
originally announced April 2018.
-
Robust Wald-type test in GLM with random design based on minimum density power divergence estimators
Authors:
Ayanendranath Basu,
Abhik Ghosh,
Abhijit Mandal,
Nirian Martin,
Leandro Pardo
Abstract:
We consider the problem of robust inference under the generalized linear model (GLM) with stochastic covariates. We derive the properties of the minimum density power divergence estimator of the parameters in GLM with random design and use this estimator to propose robust Wald-type tests for testing any general composite null hypothesis about the GLM. The asymptotic and robustness properties of th…
▽ More
We consider the problem of robust inference under the generalized linear model (GLM) with stochastic covariates. We derive the properties of the minimum density power divergence estimator of the parameters in GLM with random design and use this estimator to propose robust Wald-type tests for testing any general composite null hypothesis about the GLM. The asymptotic and robustness properties of the proposed tests are also examined for the GLM with random design. Application of the proposed robust inference procedures to the popular Poisson regression model for analyzing count data is discussed in detail both theoretically and numerically through simulation studies and real data examples.
△ Less
Submitted 3 April, 2020; v1 submitted 31 March, 2018;
originally announced April 2018.
-
Robust Wald-Type Tests under Random Censoring with Applications to Clinical Trial Analyses
Authors:
Abhik Ghosh,
Ayanendranath Basu,
Leandro Pardo
Abstract:
Randomly censored survival data are frequently encountered in applied sciences including biomedical or reliability applications and clinical trial analyses. Testing the significance of statistical hypotheses is crucial in such analyses to get conclusive inference but the existing likelihood based tests, under a fully parametric model, are extremely non-robust against outliers in the data. Although…
▽ More
Randomly censored survival data are frequently encountered in applied sciences including biomedical or reliability applications and clinical trial analyses. Testing the significance of statistical hypotheses is crucial in such analyses to get conclusive inference but the existing likelihood based tests, under a fully parametric model, are extremely non-robust against outliers in the data. Although, there exists a few robust parameter estimators (e.g., M-estimators and minimum density power divergence estimators) given randomly censored data, there is hardly any robust testing procedure available in the literature in this context. One of the major difficulties in this context is the construction of a suitable consistent estimator of the asymptotic variance of M estimators; the latter is a function of the unknown censoring distribution. In this paper, we take the first step in this direction by proposing a consistent estimator of asymptotic variance of the M-estimators based on randomly censored data without any assumption on the form of the censoring scheme. We then describe and study a class of robust Wald-type tests for parametric statistical hypothesis, both simple as well as composite, under such set-up, along with their general asymptotic and robustness properties. Robust tests for comparing two independent randomly censored samples and robust tests against one sided alternatives are also discussed. Their advantages and usefulness are demonstrated for the tests based on the minimum density power divergence estimators with specific attention to clinical trial analyses.
△ Less
Submitted 5 January, 2019; v1 submitted 31 August, 2017;
originally announced August 2017.
-
Robust Wald-type tests for non-homogeneous observations based on minimum density power divergence estimator
Authors:
Ayanendranath Basu,
Abhik Ghosh,
Nirian Martin,
Leandro Pardo
Abstract:
This paper considers the problem of robust hypothesis testing under non-identically distributed data. We propose Wald-type tests for both simple and composite hypothesis for independent but non-homogeneous observations based on the robust minimum density power divergence estimator of the common underlying parameter. Asymptotic and theoretical robustness properties of the proposed tests have been d…
▽ More
This paper considers the problem of robust hypothesis testing under non-identically distributed data. We propose Wald-type tests for both simple and composite hypothesis for independent but non-homogeneous observations based on the robust minimum density power divergence estimator of the common underlying parameter. Asymptotic and theoretical robustness properties of the proposed tests have been discussed. Application to the problem of testing the general linear hypothesis in a generalized linear model with fixed-design has been considered in detail with specific illustrations for its special cases under normal and Poisson distributions.
△ Less
Submitted 7 July, 2017;
originally announced July 2017.
-
New robust statistical procedures for polytomous logistic regression models
Authors:
E. Castilla,
A. Ghosh,
N. Martín,
L. Pardo
Abstract:
This paper derives a new family of estimators, namely the minimum density power divergence estimators, as a robust generalization of the maximum likelihood estimator for the polytomous logistic regression model. Based on these estimators, a family of Wald-type test statistics for linear hypotheses is introduced. Robustness properties of both the proposed estimators and the test statistics are theo…
▽ More
This paper derives a new family of estimators, namely the minimum density power divergence estimators, as a robust generalization of the maximum likelihood estimator for the polytomous logistic regression model. Based on these estimators, a family of Wald-type test statistics for linear hypotheses is introduced. Robustness properties of both the proposed estimators and the test statistics are theoretically studied through the classical influence function analysis. Appropriate real life examples are presented to justify the requirement of suitable robust statistical procedures in place of the likelihood based inference for the polytomous logistic regression model. The validity of the theoretical results established in the paper are further confirmed empirically through suitable simulation studies. Finally, an approach for the data-driven selection of the robustness tuning parameter is proposed with empirical justifications.
△ Less
Submitted 26 June, 2018; v1 submitted 25 April, 2017;
originally announced April 2017.
-
Robust Estimators and Test-Statistics for One-Shot Device Testing Under the Exponential Distribution
Authors:
N. Balakrishnan,
E. Castilla,
N. Martin,
L. Pardo
Abstract:
This paper develops a new family of estimators, the minimum density power divergence estimators (MDPDEs), for the parameters of the one-shot device model as well as a new family of test statistics, Z-type test statistics based on MDPDEs, for testing the corresponding model parameters. The family of MDPDEs contains as a particular case the maximum likelihood estimator (MLE) considered in Balakrishn…
▽ More
This paper develops a new family of estimators, the minimum density power divergence estimators (MDPDEs), for the parameters of the one-shot device model as well as a new family of test statistics, Z-type test statistics based on MDPDEs, for testing the corresponding model parameters. The family of MDPDEs contains as a particular case the maximum likelihood estimator (MLE) considered in Balakrishnan and Ling (2012). Through a simulation study, it is shown that some MDPDEs have a better behavior than the MLE in relation to robustness. At the same time, it can be seen that some Z-type tests based on MDPDEs have a better behavior than the classical Z-test statistic also in terms of robustness.
△ Less
Submitted 25 April, 2017;
originally announced April 2017.
-
A new class of robust two-sample Wald-type tests
Authors:
Abhik Ghosh,
Nirian Martin,
Ayanendranath Basu,
Leandro Pardo
Abstract:
Parametric hypothesis testing associated with two independent samples arises frequently in several applications in biology, medical sciences, epidemiology, reliability and many more. In this paper, we propose robust Wald-type tests for testing such two sample problems using the minimum density power divergence estimators of the underlying parameters. In particular, we consider the simple two-sampl…
▽ More
Parametric hypothesis testing associated with two independent samples arises frequently in several applications in biology, medical sciences, epidemiology, reliability and many more. In this paper, we propose robust Wald-type tests for testing such two sample problems using the minimum density power divergence estimators of the underlying parameters. In particular, we consider the simple two-sample hypothesis concerning the full parametric homogeneity of the samples as well as the general two-sample (composite) hypotheses involving nuisance parameters also. The asymptotic and theoretical robustness properties of the proposed Wald-type tests have been developed for both the simple and general composite hypotheses. Some particular cases of testing against one-sided alternatives are discussed with specific attention to testing the effectiveness of a treatment in clinical trials. Performances of the proposed tests have also been illustrated numerically through appropriate real data examples.
△ Less
Submitted 15 February, 2017;
originally announced February 2017.
-
A logistic regression analysis approach for sample survey data based on phi-divergence measures
Authors:
Elena Castilla,
Nirian Martin,
Leandro Pardo
Abstract:
A new family of minimum distance estimators for binary logistic regression models based on $φ$-divergence measures is introduced. The so called "pseudo minimum phi-divergence estimator"(PM$φ$E) family is presented as an extension of "minimum phi-divergence estimator" (M$φ$E) for general sample survey designs and contains, as a particular case, the pseudo maximum likelihood estimator (PMLE) conside…
▽ More
A new family of minimum distance estimators for binary logistic regression models based on $φ$-divergence measures is introduced. The so called "pseudo minimum phi-divergence estimator"(PM$φ$E) family is presented as an extension of "minimum phi-divergence estimator" (M$φ$E) for general sample survey designs and contains, as a particular case, the pseudo maximum likelihood estimator (PMLE) considered in Roberts et al. \cite{r}. Through a simulation study it is shown that some PM$φ$Es have a better behaviour, in terms of efficiency, than the PMLE.
△ Less
Submitted 8 November, 2016;
originally announced November 2016.
-
Semiparametric clustered overdispersed multinomial goodness-of-fit of log-linear models
Authors:
Juana M. Alonso-Revenga,
Nirian Martin,
Leandro Pardo
Abstract:
Traditionally, the Dirichlet-multinomial distribution has been recognized as a key model for contingency tables generated by cluster sampling schemes. There are, however, other possible distributions appropriate for these contingency tables. This paper introduces new test-statistics capable to test log-linear modeling hypotheses with no distributional specification, when the individuals of the clu…
▽ More
Traditionally, the Dirichlet-multinomial distribution has been recognized as a key model for contingency tables generated by cluster sampling schemes. There are, however, other possible distributions appropriate for these contingency tables. This paper introduces new test-statistics capable to test log-linear modeling hypotheses with no distributional specification, when the individuals of the clusters are possibly homogeneously correlated. The estimator for the intracluster correlation coefficient proposed in Alonso-Revenga et al. (2016), valid for different cluster sizes, plays a crucial role in the construction of the goodness-of-fit test-statistic.
△ Less
Submitted 23 September, 2016;
originally announced September 2016.
-
Pseudo minimum phi-divergence estimator for multinomial logistic regression with complex sample design
Authors:
Elena Castilla,
Nirian Martin,
Leandro Pardo
Abstract:
This article develops the theoretical framework needed to study the multinomial logistic regression model for complex sample design with pseudo minimum phi-divergence estimators. Through a numerical example and simulation study new estimators are proposed for the parameter of the logistic regression model with overdispersed multinomial distributions for the response variables, the pseudo minimum C…
▽ More
This article develops the theoretical framework needed to study the multinomial logistic regression model for complex sample design with pseudo minimum phi-divergence estimators. Through a numerical example and simulation study new estimators are proposed for the parameter of the logistic regression model with overdispersed multinomial distributions for the response variables, the pseudo minimum Cressie-Read divergence estimators, as well as new estimators for the intra-cluster correlation coefficient. The results show that the Binder's method for the intra-cluster correlation coefficient exhibits an excellent performance when the pseudo minimum Cressie-Read divergence estimator, with lambda = 2/3 , is plugged.
△ Less
Submitted 3 June, 2016;
originally announced June 2016.
-
On divergences tests for composite hypotheses under composite likelihood
Authors:
Nirian Martin,
Leandro Pardo,
Konstantinos Zografos
Abstract:
It is well-known that in some situations it is not easy to compute the likelihood function as the datasets might be large or the model is too complex. In that contexts composite likelihood, derived by multiplying the likelihoods of subjects of the variables, may be useful. The extension of the classical likelihood ratio test statistics to the framework of composite likelihoods is used as a procedu…
▽ More
It is well-known that in some situations it is not easy to compute the likelihood function as the datasets might be large or the model is too complex. In that contexts composite likelihood, derived by multiplying the likelihoods of subjects of the variables, may be useful. The extension of the classical likelihood ratio test statistics to the framework of composite likelihoods is used as a procedure to solve the problem of testing in the context of composite likelihood. In this paper we introduce and study a new family of test statistics for composite likelihood: Composite φ-divergence test statistics for solving the problem of testing a simple null hypothesis or a composite null hypothesis. To do that we introduce and study the asymptotic distribution of the restricted maximum composite likelihood estimate.
△ Less
Submitted 1 March, 2016;
originally announced March 2016.
-
Empirical phi-divergence test-statistics for the equalityof means of two populations
Authors:
Narayanaswamy Balakrishnan,
Nirian Martin,
Leandro Pardo
Abstract:
Empirical phi-divergence test-statistics have demostrated to be a useful technique for the simple null hypothesis to improve the finite sample behaviour of the classical likelihood ratio test-statistic, as well asfor model misspecification problems, in both cases for the one population problem. This paper introduces this methodology for two sample problems. A simulation study illustrates situation…
▽ More
Empirical phi-divergence test-statistics have demostrated to be a useful technique for the simple null hypothesis to improve the finite sample behaviour of the classical likelihood ratio test-statistic, as well asfor model misspecification problems, in both cases for the one population problem. This paper introduces this methodology for two sample problems. A simulation study illustrates situations in which the new test-statistics become a competitive tool with respect to the classical z-test and the likelihood ratio test-statistic.
△ Less
Submitted 14 January, 2016;
originally announced January 2016.
-
New improved estimators for overdispersion in models with clustered multinomial data and unequal cluster sizes
Authors:
Juana María Alonso,
Nirian Martín,
Leandro Pardo
Abstract:
It is usual to rely on the quasi-likelihood methods for deriving statistical methods applied to clustered multinomial data with no underlying distribution. Even though extensive literature can be encountered for these kind of data sets, there are few investigations to deal with unequal cluster sizes. This paper aims to contribute to fill this gap by proposing new estimators for the intracluster co…
▽ More
It is usual to rely on the quasi-likelihood methods for deriving statistical methods applied to clustered multinomial data with no underlying distribution. Even though extensive literature can be encountered for these kind of data sets, there are few investigations to deal with unequal cluster sizes. This paper aims to contribute to fill this gap by proposing new estimators for the intracluster correlation coefficient.
△ Less
Submitted 19 October, 2015; v1 submitted 1 April, 2015;
originally announced April 2015.
-
Empirical phi-divergence test statistics for testing simple null hypotheses based on exponentially tilted empirical likelihood estimators
Authors:
Angel Felipe,
Nirian Martín,
Pedro Miranda,
Leandro Pardo
Abstract:
In Econometrics, imposing restrictions without assuming underlying distributions to modelize complex realities is a valuable methodological tool. However, if a subset of restrictions were not correctly specified, the usual test-statistics for correctly specified models tend to reject erronously a simple null hypothesis. In this setting, we may say that the model suffers from misspecification. We s…
▽ More
In Econometrics, imposing restrictions without assuming underlying distributions to modelize complex realities is a valuable methodological tool. However, if a subset of restrictions were not correctly specified, the usual test-statistics for correctly specified models tend to reject erronously a simple null hypothesis. In this setting, we may say that the model suffers from misspecification. We study the behavior of empirical phi-divergence test-statistics, introduced in Balakrishnan et al. (2015), by using the exponential tilted empirical likelihood estimators of Schennach (2007), as a good compromise between efficiency of the significance level for small sample sizes and robustness under misspecification.
△ Less
Submitted 27 October, 2015; v1 submitted 3 March, 2015;
originally announced March 2015.
-
Phi-Divergence test statistics for testing the validity of latent class models for binary data
Authors:
Ángel Felipe,
Nirian Martín,
Pedro Miranda,
Leandro Pardo
Abstract:
The main purpose of this paper is to present new families of test statistics for studying the problem of goodness-of-fit of some data to a latent class model for binary data. The families of test statistics introduced are based on phi-divergence measures, a natural extension of maximum likelihood. We also treat the problem of testing a nested sequence of latent class models for binary data. For th…
▽ More
The main purpose of this paper is to present new families of test statistics for studying the problem of goodness-of-fit of some data to a latent class model for binary data. The families of test statistics introduced are based on phi-divergence measures, a natural extension of maximum likelihood. We also treat the problem of testing a nested sequence of latent class models for binary data. For these statistics, we obtain their asymptotic distribution. We shall consider consistent estimators introduced in Felipe et al (2014) for solving the problem of estimation. Finally, a simulation study is carried out in order to compare the efficiency, in the sense of the level and the power, of the new statistics considered in this paper for sample sizes that are not big enough to apply the asymptotical results.
△ Less
Submitted 8 July, 2014;
originally announced July 2014.
-
Influence Analysis of Robust Wald-type Tests
Authors:
Abhik Ghosh,
Abhijit Mandal,
Nirian Martin,
Leandro Pardo
Abstract:
We consider a robust version of the classical Wald test statistics for testing simple and composite null hypotheses for general parametric models. These test statistics are based on the minimum density power divergence estimators instead of the maximum likelihood estimators. An extensive study of their robustness properties is given though the influence functions as well as the chi-square inflatio…
▽ More
We consider a robust version of the classical Wald test statistics for testing simple and composite null hypotheses for general parametric models. These test statistics are based on the minimum density power divergence estimators instead of the maximum likelihood estimators. An extensive study of their robustness properties is given though the influence functions as well as the chi-square inflation factors. It is theoretically established that the level and power of these robust tests are stable against outliers, whereas the classical Wald test breaks down. Some numerical examples confirm the validity of the theoretical results.
△ Less
Submitted 16 November, 2015; v1 submitted 25 June, 2014;
originally announced June 2014.
-
Minimum φ-divergence estimation in constrained latent class models for binary data
Authors:
Ángel Felipe,
Pedro Miranda,
Leandro Pardo
Abstract:
The main purpose of this paper is to introduce and study the behavior of minimum φ-divergence estimators as an alternative to the maximum likelihood estimator in latent class models for binary items. As it will become clear below, minimum φ-divergence estimators are a natural extension of the maximum likelihood estimator. The asymptotic properties of minimum φ-divergence estimators for latent clas…
▽ More
The main purpose of this paper is to introduce and study the behavior of minimum φ-divergence estimators as an alternative to the maximum likelihood estimator in latent class models for binary items. As it will become clear below, minimum φ-divergence estimators are a natural extension of the maximum likelihood estimator. The asymptotic properties of minimum φ-divergence estimators for latent class models for binary data are developed. Finally, to compare the efficiency and robustness of these new estimators with those obtained through maximum likelihood when the sample size is not big enough to apply the asymptotic results, we have carried out a simulation study.
△ Less
Submitted 31 May, 2014;
originally announced June 2014.
-
Empirical phi-divergence test statistics for testing simple and composite null hypotheses
Authors:
Narayanaswamy Balakrishnan,
Nirian Martín,
Leandro Pardo
Abstract:
The main purpose of this paper is to introduce first a new family of empirical test statistics for testing a simple null hypothesis when the vector of parameters of interest are defined through a specific set of unbiased estimating functions. This family of test statistics is based on a distance between two probability vectors, with the first probability vector obtained by maximizing the empirical…
▽ More
The main purpose of this paper is to introduce first a new family of empirical test statistics for testing a simple null hypothesis when the vector of parameters of interest are defined through a specific set of unbiased estimating functions. This family of test statistics is based on a distance between two probability vectors, with the first probability vector obtained by maximizing the empirical likelihood on the vector of parameters, and the second vector defined from the fixed vector of parameters under the simple null hypothesis. The distance considered for this purpose is the phi-divergence measure. The asymptotic distribution is then derived for this family of test statistics. The proposed methodology is illustrated through the well-known data of Newcomb's measurements on the passage time for light. A simulation study is carried out to compare its performance with that of the empirical likelihood ratio test when confidence intervals are constructed based on the respective statistics for small sample sizes. The results suggest that the "empirical modified likelihood ratio test statistic" provides a competitive alternative to the empirical likelihood ratio test statistic, and is also more robust than the empirical likelihood ratio test statistic in the presence of contamination in the data. Finally, we propose empirical phi-divergence test statistics for testing a composite null hypothesis and present some asymptotic as well as simulation results for evaluating the performance of these test procedures.
△ Less
Submitted 17 August, 2014; v1 submitted 22 May, 2014;
originally announced May 2014.
-
On the Robustness of a Divergence based Test of Simple Statistical Hypotheses
Authors:
Abhik Ghosh,
Ayanendranath Basu,
Leandro Pardo
Abstract:
The most popular hypothesis testing procedure, the likelihood ratio test, is known to be highly non-robust in many real situations. Basu et al. (2013a) provided an alternative robust procedure of hypothesis testing based on the density power divergence; however, although the robustness properties of the latter test were intuitively argued for by the authors together with extensive empirical substa…
▽ More
The most popular hypothesis testing procedure, the likelihood ratio test, is known to be highly non-robust in many real situations. Basu et al. (2013a) provided an alternative robust procedure of hypothesis testing based on the density power divergence; however, although the robustness properties of the latter test were intuitively argued for by the authors together with extensive empirical substantiation of the same, no theoretical robustness properties were presented in this work. In the present paper we will consider a more general class of tests which form a superfamily of the procedures described by Basu et al. (2013a). This superfamily derives from the class of $S$-divergences recently proposed by Basu et al. (2013a). In this context we theoretically prove several robustness results of the new class of tests and illustrate them in the normal model. All the theoretical robustness properties of the Basu et al. (2013a) proposal follows as special cases of our results.
△ Less
Submitted 28 November, 2014; v1 submitted 21 April, 2014;
originally announced April 2014.
-
Generalized Wald-type Tests based on Minimum Density Power Divergence Estimators
Authors:
Ayanendranath Basu,
Abhijit Mandal,
Nirian Martin,
Leandro Pardo
Abstract:
In testing of hypothesis the robustness of the tests is an important concern. Generally, the maximum likelihood based tests are most efficient under standard regularity conditions, but they are highly non-robust even under small deviations from the assumed conditions. In this paper we have proposed generalized Wald-type tests based on minimum density power divergence estimators for parametric hypo…
▽ More
In testing of hypothesis the robustness of the tests is an important concern. Generally, the maximum likelihood based tests are most efficient under standard regularity conditions, but they are highly non-robust even under small deviations from the assumed conditions. In this paper we have proposed generalized Wald-type tests based on minimum density power divergence estimators for parametric hypotheses. This method avoids the use of nonparametric density estimation and the bandwidth selection. The trade-off between efficiency and robustness is controlled by a tuning parameter $β$. The asymptotic distributions of the test statistics are chi-square with appropriate degrees of freedom. The performance of the proposed tests are explored through simulations and real data analysis.
△ Less
Submitted 7 March, 2015; v1 submitted 29 March, 2014;
originally announced March 2014.
-
Robust Tests for the Equality of Two Normal Means based on the Density Power Divergence
Authors:
Ayanendranath Basu,
Abhijit Mandal,
Nirian Martin,
Leandro Pardo
Abstract:
Statistical techniques are used in all branches of science to determine the feasibility of quantitative hypotheses. One of the most basic applications of statistical techniques in comparative analysis is the test of equality of two population means, generally performed under the assumption of normality. In medical studies, for example, we often need to compare the effects of two different drugs, t…
▽ More
Statistical techniques are used in all branches of science to determine the feasibility of quantitative hypotheses. One of the most basic applications of statistical techniques in comparative analysis is the test of equality of two population means, generally performed under the assumption of normality. In medical studies, for example, we often need to compare the effects of two different drugs, treatments or preconditions on the resulting outcome. The most commonly used test in this connection is the two sample $t$-test for the equality of means, performed under the assumption of equality of variances. It is a very useful tool, which is widely used by practitioners of all disciplines and has many optimality properties under the model. However, the test has one major drawback; it is highly sensitive to deviations from the ideal conditions, and may perform miserably under model misspecification and the presence of outliers. In this paper we present a robust test for the two sample hypothesis based on the density power divergence measure (Basu et al., 1998), and show that it can be a great alternative to the ordinary two sample $t$-test. The asymptotic properties of the proposed tests are rigorously established in the paper, and their performances are explored through simulations and real data analysis.
△ Less
Submitted 25 November, 2014; v1 submitted 6 March, 2014;
originally announced March 2014.
-
Testing Composite Hypothesis based on the Density Power Divergence
Authors:
Ayanendranath Basu,
Abhijit Mandal,
Nirian Martin,
Leandro Pardo
Abstract:
In any parametric inference problem, the robustness of the procedure is a real concern. A procedure which retains a high degree of efficiency under the model and simultaneously provides stable inference under data contamination is preferable in any practical situation over another procedure which achieves its efficiency at the cost of robustness or vice versa. The density power divergence family o…
▽ More
In any parametric inference problem, the robustness of the procedure is a real concern. A procedure which retains a high degree of efficiency under the model and simultaneously provides stable inference under data contamination is preferable in any practical situation over another procedure which achieves its efficiency at the cost of robustness or vice versa. The density power divergence family of Basu et al. (1998) provides a flexible class of divergences where the adjustment between efficiency and robustness is controlled by a single parameter $β$. In this paper we consider general tests of parametric hypotheses based on the density power divergence. We establish the asymptotic null distribution of the test statistic and explore its asymptotic power function. Numerical results illustrate the performance of the theory developed.
△ Less
Submitted 26 December, 2015; v1 submitted 3 March, 2014;
originally announced March 2014.
-
Wald type and Phi-divergence based test-statistics for isotonic binomial proportions
Authors:
Nirian Martín,
Raquel Mata,
Leando Pardo
Abstract:
In this paper new test statistics are introduced and studied for the important problem of testing hypothesis that involves inequality constraint on proportions when the sample comes from independent binomial random variables: Wald type and phi-divergence based test-statistics. As a particular case of phi-divergence based test-statistics, the classical likelihood ratio test is considered. An illust…
▽ More
In this paper new test statistics are introduced and studied for the important problem of testing hypothesis that involves inequality constraint on proportions when the sample comes from independent binomial random variables: Wald type and phi-divergence based test-statistics. As a particular case of phi-divergence based test-statistics, the classical likelihood ratio test is considered. An illustrative example is given and the performance of all of them for small and moderate sample sizes is analyzed in an extensive simulation study.
△ Less
Submitted 26 February, 2014;
originally announced February 2014.
-
Comparing two treatments in terms of the likelihood ratio order
Authors:
Nirian Martín,
Raquel Mata,
Leandro Pardo
Abstract:
In this paper new families of test statistics are introduced and studied for the problem of comparing two treatments in terms of the likelihood ratio order. The considered families are based on phi-divergence measures and arise as natural extensions of the classical likelihood ratio test and Pearson test statistics. It is proven that their asymptotic distribution is a common chi-bar random variabl…
▽ More
In this paper new families of test statistics are introduced and studied for the problem of comparing two treatments in terms of the likelihood ratio order. The considered families are based on phi-divergence measures and arise as natural extensions of the classical likelihood ratio test and Pearson test statistics. It is proven that their asymptotic distribution is a common chi-bar random variable. An illustrative example is presented and the performance of these statistics is analysed through a simulation study. Through a simulation study it is shown that, for most of the proposed scenarios adjusted to be small or moderate, some members of this new family of test-statistic display clearly better performance with respect to the power in comparison to the classical likelihood ratio and the Pearson's chi-square test while the exact size remains closed to the nominal size. In view of the exact powers and significance levels, the study also shows that the Wilcoxon test-statistic is not as good as the two classical test-statistics.
△ Less
Submitted 29 October, 2014; v1 submitted 26 February, 2014;
originally announced February 2014.
-
Phi-divergence statistics for the likelihood ratio order: an approach based on log-linear models
Authors:
Nirian Martín,
Raquel Mata,
Leandro Pardo
Abstract:
When some treatments are ordered according to the categories of an ordinal categorical variable (e.g., extent of side effects) in a monotone order, one might be interested in knowing wether the treatments are equally effective or not. One way to do that is to test if the likelihood ratio order is strictly verified. A method based on log-linear models is derived to make statistical inference and ph…
▽ More
When some treatments are ordered according to the categories of an ordinal categorical variable (e.g., extent of side effects) in a monotone order, one might be interested in knowing wether the treatments are equally effective or not. One way to do that is to test if the likelihood ratio order is strictly verified. A method based on log-linear models is derived to make statistical inference and phi-divergence test-statistics are proposed for the test of interest. Focussed on loglinear modeling, the theory associated with the asymptotic distribution of the phi-divergence test-statistics is developed. An illustrative example motivates the procedure and a simulation study for small and moderate sample sizes shows that it is possible to find phi-divergence test-statistic with an exact size closer to nominal size and higher power in comparison with the classical likelihood ratio.
△ Less
Submitted 21 February, 2014;
originally announced February 2014.
