Showing 1–8 of 8 results for author: Khmaladze, E V

On the statistical analysis of grouped data: when Pearson $χ^2$ and other divisible statistics are not goodness-of-fit tests

Authors: Sara Algeri, Estate V. Khmaladze

Abstract: Thousands of experiments are analyzed and papers are published each year involving the statistical analysis of grouped data. While this area of statistics is often perceived -- somewhat naively -- as saturated, several misconceptions still affect everyday practice, and new frontiers have so far remained unexplored. Researchers must be aware of the limitations affecting their analyses and what are… ▽ More Thousands of experiments are analyzed and papers are published each year involving the statistical analysis of grouped data. While this area of statistics is often perceived -- somewhat naively -- as saturated, several misconceptions still affect everyday practice, and new frontiers have so far remained unexplored. Researchers must be aware of the limitations affecting their analyses and what are the new possibilities in their hands. Motivated by this need, the article introduces a unifying approach to the analysis of grouped data, which allows us to study the class of divisible statistics -- that includes Pearson's $χ^2$, the likelihood ratio as special cases -- with a fresh perspective. The contributions collected in this manuscript span from modeling and estimation to distribution-free goodness-of-fit tests. Perhaps the most surprising result presented here is that, in a sparse regime, all tests proposed in the literature are dominated by members of the class of weighted linear statistics. △ Less

Submitted 15 May, 2025; v1 submitted 13 June, 2024; originally announced June 2024.

Distribution free testing for linear regression. Extension to general parametric regression

Authors: Estate V. Khmaladze

Abstract: Recently a distribution free approach for testing parametric hypotheses based on unitary transformations has been suggested in \cite{Khm13, Khm16, Khm17} and further studied in \cite{Ngu17} and \cite{Rob19}. In this note we show that the transformation takes extremely simple form in distribution free testing of linear regression. Then we extend it to general parametric regression with vector-value… ▽ More Recently a distribution free approach for testing parametric hypotheses based on unitary transformations has been suggested in \cite{Khm13, Khm16, Khm17} and further studied in \cite{Ngu17} and \cite{Rob19}. In this note we show that the transformation takes extremely simple form in distribution free testing of linear regression. Then we extend it to general parametric regression with vector-valued covariates. △ Less

Submitted 6 February, 2020; originally announced February 2020.

Comments: 23 pages, 5 figures

Asymptotic hypothesis testing for the colour blind problem

Authors: Laura Dumitrescu, Estate V. Khmaladze

Abstract: In the classical two-sample problem, the conventional approach for testing distributions equality is based on the difference between the two marginal empirical distribution functions, whereas a test for independence is based on the contrast between the bivariate and the product of the marginal empirical distribution functions. In this article we consider the problem of testing independence and dis… ▽ More In the classical two-sample problem, the conventional approach for testing distributions equality is based on the difference between the two marginal empirical distribution functions, whereas a test for independence is based on the contrast between the bivariate and the product of the marginal empirical distribution functions. In this article we consider the problem of testing independence and distributions equality when the observer is "colour blind" so he cannot distinguish the distribution which has generated each of the two measurements. Within a nonparametric framework, we propose an empirical process for this problem and find the linear statistic which is asymptotically optimal for testing the equality of the marginal distributions against a specific form of contiguous alternatives. △ Less

Submitted 13 June, 2018; originally announced June 2018.

Asymptotically distribution-free goodness-of-fit testing for tail copulas

Authors: Sami Umut Can, John H. J. Einmahl, Estate V. Khmaladze, Roger J. A. Laeven

Abstract: Let $(X_1,Y_1),\ldots,(X_n,Y_n)$ be an i.i.d. sample from a bivariate distribution function that lies in the max-domain of attraction of an extreme value distribution. The asymptotic joint distribution of the standardized component-wise maxima $\bigvee_{i=1}^nX_i$ and $\bigvee_{i=1}^nY_i$ is then characterized by the marginal extreme value indices and the tail copula $R$. We propose a procedure fo… ▽ More Let $(X_1,Y_1),\ldots,(X_n,Y_n)$ be an i.i.d. sample from a bivariate distribution function that lies in the max-domain of attraction of an extreme value distribution. The asymptotic joint distribution of the standardized component-wise maxima $\bigvee_{i=1}^nX_i$ and $\bigvee_{i=1}^nY_i$ is then characterized by the marginal extreme value indices and the tail copula $R$. We propose a procedure for constructing asymptotically distribution-free goodness-of-fit tests for the tail copula $R$. The procedure is based on a transformation of a suitable empirical process derived from a semi-parametric estimator of $R$. The transformed empirical process converges weakly to a standard Wiener process, paving the way for a multitude of asymptotically distribution-free goodness-of-fit tests. We also extend our results to the $m$-variate ($m>2$) case. In a simulation study we show that the limit theorems provide good approximations for finite samples and that tests based on the transformed empirical process have high power. △ Less

Submitted 2 April, 2015; originally announced April 2015.

Comments: Published at http://dx.doi.org/10.1214/14-AOS1304 in the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS1304

Journal ref: Annals of Statistics 2015, Vol. 43, No. 2, 878-902

Differentiation of sets - The general case

Authors: Estate V. Khmaladze, Wolfgang Weil

Abstract: In recent work by Khmaladze and Weil (2008) and by Einmahl and Khmaladze (2011), limit theorems were established for local empirical processes near the boundary of compact convex sets $K$ in $\R$. The limit processes were shown to live on the normal cylinder $Σ$ of $K$, respectively on a class of set-valued derivatives in $Σ$. The latter result was based on the concept of differentiation of sets a… ▽ More In recent work by Khmaladze and Weil (2008) and by Einmahl and Khmaladze (2011), limit theorems were established for local empirical processes near the boundary of compact convex sets $K$ in $\R$. The limit processes were shown to live on the normal cylinder $Σ$ of $K$, respectively on a class of set-valued derivatives in $Σ$. The latter result was based on the concept of differentiation of sets at the boundary $\partial K$ of $K$, which was developed in Khmaladze (2007). Here, we extend the theory of set-valued derivatives to boundaries $\partial F$ of rather general closed sets $F\subset \R$, making use of a local Steiner formula for closed sets, established in Hug, Last and Weil (2004). △ Less

Submitted 19 September, 2013; originally announced September 2013.

Comments: 3 figures

Central limit theorems for local empirical processes near boundaries of sets

Authors: John H. J. Einmahl, Estáte V. Khmaladze

Abstract: We define the local empirical process, based on $n$ i.i.d. random vectors in dimension $d$, in the neighborhood of the boundary of a fixed set. Under natural conditions on the shrinking neighborhood, we show that, for these local empirical processes, indexed by classes of sets that vary with $n$ and satisfy certain conditions, an appropriately defined uniform central limit theorem holds. The conce… ▽ More We define the local empirical process, based on $n$ i.i.d. random vectors in dimension $d$, in the neighborhood of the boundary of a fixed set. Under natural conditions on the shrinking neighborhood, we show that, for these local empirical processes, indexed by classes of sets that vary with $n$ and satisfy certain conditions, an appropriately defined uniform central limit theorem holds. The concept of differentiation of sets in measure is very convenient for developing the results. Some examples and statistical applications are also presented. △ Less

Submitted 21 April, 2011; originally announced April 2011.

Comments: Published in at http://dx.doi.org/10.3150/10-BEJ283 the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)

Report number: IMS-BEJ-BEJ283

Journal ref: Bernoulli 2011, Vol. 17, No. 2, 545-561

Goodness-of-fit problem for errors in nonparametric regression: Distribution free approach

Authors: Estate V. Khmaladze, Hira L. Koul

Abstract: This paper discusses asymptotically distribution free tests for the classical goodness-of-fit hypothesis of an error distribution in nonparametric regression models. These tests are based on the same martingale transform of the residual empirical process as used in the one sample location model. This transformation eliminates extra randomization due to covariates but not due the errors, which is… ▽ More This paper discusses asymptotically distribution free tests for the classical goodness-of-fit hypothesis of an error distribution in nonparametric regression models. These tests are based on the same martingale transform of the residual empirical process as used in the one sample location model. This transformation eliminates extra randomization due to covariates but not due the errors, which is intrinsically present in the estimators of the regression function. Thus, tests based on the transformed process have, generally, better power. The results of this paper are applicable as soon as asymptotic uniform linearity of nonparametric residual empirical process is available. In particular they are applicable under the conditions stipulated in recent papers of Akritas and Van Keilegom and Müller, Schick and Wefelmeyer. △ Less

Submitted 1 September, 2009; originally announced September 2009.

Comments: Published in at http://dx.doi.org/10.1214/08-AOS680 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS680 MSC Class: 62G08 (Primary); 62G10 (Secondary)

Journal ref: Annals of Statistics 2009, Vol. 37, No. 6A, 3165-3185

Martingale transforms goodness-of-fit tests in regression models

Authors: Estate V. Khmaladze, Hira L. Koul

Abstract: This paper discusses two goodness-of-fit testing problems. The first problem pertains to fitting an error distribution to an assumed nonlinear parametric regression model, while the second pertains to fitting a parametric regression model when the error distribution is unknown. For the first problem the paper contains tests based on a certain martingale type transform of residual empirical proce… ▽ More This paper discusses two goodness-of-fit testing problems. The first problem pertains to fitting an error distribution to an assumed nonlinear parametric regression model, while the second pertains to fitting a parametric regression model when the error distribution is unknown. For the first problem the paper contains tests based on a certain martingale type transform of residual empirical processes. The advantage of this transform is that the corresponding tests are asymptotically distribution free. For the second problem the proposed asymptotically distribution free tests are based on innovation martingale transforms. A Monte Carlo study shows that the simulated level of the proposed tests is close to the asymptotic level for moderate sample sizes. △ Less

Submitted 25 June, 2004; originally announced June 2004.

Report number: IMS-AOS-AOS172 MSC Class: 62G10 (Primary) 62J02. (Secondary)

Journal ref: Annals of Statistics 2004, Vol. 32, No. 3, 995-1034