Showing 1–36 of 36 results for author: Groeneboom, P

Nonparametric Estimation in Uniform Deconvolution and Interval Censoring

Authors: Piet Groeneboom, Geurt Jongbloed

Abstract: In the uniform deconvolution problem one is interested in estimating the distribution function $F_0$ of a nonnegative random variable, based on a sample with additive uniform noise. A peculiar and not well understood phenomenon of the nonparametric maximum likelihood estimator in this setting is the dichotomy between the situations where $F_0(1)=1$ and $F_0(1)<1$. If $F_0(1)=1$, the MLE can be com… ▽ More In the uniform deconvolution problem one is interested in estimating the distribution function $F_0$ of a nonnegative random variable, based on a sample with additive uniform noise. A peculiar and not well understood phenomenon of the nonparametric maximum likelihood estimator in this setting is the dichotomy between the situations where $F_0(1)=1$ and $F_0(1)<1$. If $F_0(1)=1$, the MLE can be computed in a straightforward way and its asymptotic pointwise behavior can be derived using the connection to the so-called current status problem. However, if $F_0(1)<1$, one needs an iterative procedure to compute it and the asymptotic pointwise behavior of the nonparametric maximum likelihood estimator is not known. In this paper we describe the problem, connect it to interval censoring problems and a more general model studied in Groeneboom (2024) to state two competing naturally occurring conjectures for the case $F_0(1)<1$. Asymptotic arguments related to smooth functional theory and extensive simulations lead us to to bet on one of these two conjectures. △ Less

Submitted 23 April, 2025; v1 submitted 20 April, 2025; originally announced April 2025.

Comments: 16 pages, 4 figures

MSC Class: 62G05; 62N01

Estimation of the incubation time distribution in the singly and doubly interval censored model

Authors: Piet Groeneboom

Abstract: We analyze nonparametric estimators for the distribution function of the incubation time in the singly and doubly interval censoring model. The classical approach is to use parametric families like Weibull, log-normal or gamma distributions in the estimation procedure. We propose nonparametric estimates which stay closer to the data than the classical parametric methods. We also give explicit limi… ▽ More We analyze nonparametric estimators for the distribution function of the incubation time in the singly and doubly interval censoring model. The classical approach is to use parametric families like Weibull, log-normal or gamma distributions in the estimation procedure. We propose nonparametric estimates which stay closer to the data than the classical parametric methods. We also give explicit limit distributions for discrete versions of the models and apply this to compute confidence intervals. The methods complement the analysis of the continuous model. R scripts for computation of the estimates are provided on https://github.com/pietg/incubationtime. △ Less

Submitted 31 December, 2023; v1 submitted 6 October, 2023; originally announced October 2023.

Comments: 17 pages, 7 figures

MSC Class: Primary 62G05; 62N01; Secondary 62-04

Credible intervals and bootstrap confidence intervals in monotone regression

Authors: Piet Groeneboom, Geurt Jongbloed

Abstract: In the recent paper [5], a Bayesian approach for constructing confidence intervals in monotone regression problems is proposed, based on credible intervals. We view this method from a frequentist point of view, and show that it corresponds to a percentile bootstrap method of which we give two versions. It is shown that a (non-percentile) smoothed bootstrap method has better behavior and does not n… ▽ More In the recent paper [5], a Bayesian approach for constructing confidence intervals in monotone regression problems is proposed, based on credible intervals. We view this method from a frequentist point of view, and show that it corresponds to a percentile bootstrap method of which we give two versions. It is shown that a (non-percentile) smoothed bootstrap method has better behavior and does not need correction for over- or undercoverage. The proofs use martingale methods. △ Less

Submitted 30 July, 2023; originally announced July 2023.

Comments: 23 pagesm 9 figures

MSC Class: 62G05; 62N01

Confidence intervals in monotone regression

Authors: Piet Groeneboom, Geurt Jongbloed

Abstract: We construct bootstrap confidence intervals for a monotone regression function. It has been shown that the ordinary nonparametric bootstrap, based on the nonparametric least squares estimator (LSE) $\hat f_n$ is inconsistent in this situation. We show, however, that a consistent bootstrap can be based on the smoothed $\hat f_n$, to be called the SLSE (Smoothed Least Squares Estimator). The asymp… ▽ More We construct bootstrap confidence intervals for a monotone regression function. It has been shown that the ordinary nonparametric bootstrap, based on the nonparametric least squares estimator (LSE) $\hat f_n$ is inconsistent in this situation. We show, however, that a consistent bootstrap can be based on the smoothed $\hat f_n$, to be called the SLSE (Smoothed Least Squares Estimator). The asymptotic pointwise distribution of the SLSE is derived. The confidence intervals, based on the smoothed bootstrap, are compared to intervals based on the (not necessarily monotone) Nadaraya Watson estimator and the effect of Studentization is investigated. We also give a method for automatic bandwidth choice, correcting work in Sen and Xu (2015). The procedure is illustrated using a well known dataset related to climate change. △ Less

Submitted 22 May, 2023; v1 submitted 31 March, 2023; originally announced March 2023.

Comments: 22 pages, 8 figures

Nonparametric estimation of the incubation time distribution

Authors: Piet Groeneboom

Abstract: Nonparametric maximum likelihood estimators (MLEs) in inverse problems often have non-normal limit distributions, like Chernoff's distribution. However, if one considers smooth functionals of the model, with corresponding functionals of the MLE, one gets normal limit distributions and faster rates of convergence. We demonstrate this for a model for the incubation time of a disease. The usual appro… ▽ More Nonparametric maximum likelihood estimators (MLEs) in inverse problems often have non-normal limit distributions, like Chernoff's distribution. However, if one considers smooth functionals of the model, with corresponding functionals of the MLE, one gets normal limit distributions and faster rates of convergence. We demonstrate this for a model for the incubation time of a disease. The usual approach in the latter models is to use parametric distributions, like Weibull and gamma distributions, which leads to inconsistent estimators. Smoothed bootstrap methods are discussed for constructing confidence intervals. The classical bootstrap, based on the nonparametric MLE itself, has been proved to be inconsistent in this situation. △ Less

Submitted 21 October, 2023; v1 submitted 9 May, 2022; originally announced May 2022.

Comments: 42 pages, 12 figures. arXiv admin note: text overlap with arXiv:2108.12606

MSC Class: 62G05; 62-04

Nonparametric estimation of the incubation time distribution

Authors: Piet Groeneboom

Abstract: We discuss nonparametric estimators of the distribution of the incubation time of a disease. The classical approach in these models is to use parametric families like Weibull, log-normal or gamma in the estimation procedure. We analyze instead the nonparametric maximum likelihood estimator (MLE) and show that, under some conditions, its rate of convergence is cube root $n$ and that its limit behav… ▽ More We discuss nonparametric estimators of the distribution of the incubation time of a disease. The classical approach in these models is to use parametric families like Weibull, log-normal or gamma in the estimation procedure. We analyze instead the nonparametric maximum likelihood estimator (MLE) and show that, under some conditions, its rate of convergence is cube root $n$ and that its limit behavior is given by Chernoff's distribution. We also study smooth estimates, based on the MLE. The density estimates, based on the MLE, are capable of catching finer or unexpected aspects of the density, in contrast with the classical parametric methods. {\tt R} scripts are provided for the nonparametric methods. △ Less

Submitted 31 January, 2023; v1 submitted 28 August, 2021; originally announced August 2021.

Comments: replaced by arXiv:2205.04399

Profile least squares estimators in the monotone single index model

Authors: Fadoua Balabdaoui, Piet Groeneboom

Abstract: We consider least squares estimators of the finite regression parameter $α$ in the single index regression model $Y=ψ(α^T X)+ε$, where $X$ is a $d$-dimensional random vector, $\E(Y|X)=ψ(α^T X)$, and where $ψ$ is monotone. It has been suggested to estimate $α$ by a profile least squares estimator, minimizing $\sum_{i=1}^n(Y_i-ψ(α^T X_i))^2$ over monotone $ψ$ and $α$ on the boundary $S_{d-1}$of the… ▽ More We consider least squares estimators of the finite regression parameter $α$ in the single index regression model $Y=ψ(α^T X)+ε$, where $X$ is a $d$-dimensional random vector, $\E(Y|X)=ψ(α^T X)$, and where $ψ$ is monotone. It has been suggested to estimate $α$ by a profile least squares estimator, minimizing $\sum_{i=1}^n(Y_i-ψ(α^T X_i))^2$ over monotone $ψ$ and $α$ on the boundary $S_{d-1}$of the unit ball. Although this suggestion has been around for a long time, it is still unknown whether the estimate is $\sqrt{n}$ convergent. We show that a profile least squares estimator, using the same pointwise least squares estimator for fixed $α$, but using a different global sum of squares, is $\sqrt{n}$-convergent and asymptotically normal. The difference between the corresponding loss functions is studied and also a comparison with other methods is given. △ Less

Submitted 30 January, 2023; v1 submitted 15 January, 2020; originally announced January 2020.

Comments: 21 pages, 6 figures

MSC Class: 62E20; 62J99

Journal ref: Advances in Contemporary Statistics and Econometrics, 2021

Grenander functionals and Cauchy's formula

Authors: Piet Groeneboom

Abstract: Let $\hat f_n$ be the nonparametric maximum likelihood estimator of a decreasing density. Grenander characterized this as the left-continuous slope of the least concave majorant of the empirical distribution function. For a sample from the uniform distribution, the asymptotic distribution of the $L_2$-distance of the Grenander estimator to the uniform density was derived in Groeneboom and Pyke (19… ▽ More Let $\hat f_n$ be the nonparametric maximum likelihood estimator of a decreasing density. Grenander characterized this as the left-continuous slope of the least concave majorant of the empirical distribution function. For a sample from the uniform distribution, the asymptotic distribution of the $L_2$-distance of the Grenander estimator to the uniform density was derived in Groeneboom and Pyke (1983) by using a representation of the Grenander estimator in terms of conditioned Poisson and gamma random variables. This representation was also used in Groeneboom and Lopuhaa (1993) to prove a central limit result of Sparre Andersen on the number of jumps of the Grenander estimator. Here we extend this to the proof of a general result on integrals of the Grenander estimator. We also correct Groeneboom and Pyke (1983), where the limit distribution of the sums of gamma and Poisson variables on which the conditioning was done did not have the right form. Saddle point methods and Cauchy's formula are important tools in our development. △ Less

Submitted 20 November, 2019; v1 submitted 23 February, 2019; originally announced February 2019.

Comments: 16 pages, 1 figure

Score estimation in the monotone single index model

Authors: Fadoua Balabdaoui, Piet Groeneboom, Kim Hendrickx

Abstract: We consider estimation in the single index model where the link function is monotone. For this model a profile least squares estimator has been proposed to estimate the unknown link function and index. Although it is natural to propose this procedure, it is still unknown whether it produces index estimates which converge at the parametric rate. We show that this holds if we solve a score equation… ▽ More We consider estimation in the single index model where the link function is monotone. For this model a profile least squares estimator has been proposed to estimate the unknown link function and index. Although it is natural to propose this procedure, it is still unknown whether it produces index estimates which converge at the parametric rate. We show that this holds if we solve a score equation corresponding to this least squares problem. Using a Lagrangian formulation, we show how one can solve this score equation without any reparametrization. This makes it easy to solve the score equations in high dimensions. We also compare our method with the Effective Dimension Reduction (EDR) and the Penalized Least Squares Estimator (PLSE) methods, both available on CRAN as R packages, and compare with link-free methods, where the covariates are ellipticallly symmetric. △ Less

Submitted 23 October, 2018; v1 submitted 15 December, 2017; originally announced December 2017.

Comments: 31 pages, 6 figures, 2 tables

Confidence intervals for the current status model

Authors: Piet Groeneboom, Kim Hendrickx

Abstract: We discuss a new way of constructing pointwise confidence intervals for the distribution function in the current status model. The confidence intervals are based on the smoothed maximum likelihood estimator (SMLE) and constructed using bootstrap methods. Other methods to construct confidence intervals, using the non-standard limit distribution of the (restricted) MLE, are compared to our approach… ▽ More We discuss a new way of constructing pointwise confidence intervals for the distribution function in the current status model. The confidence intervals are based on the smoothed maximum likelihood estimator (SMLE) and constructed using bootstrap methods. Other methods to construct confidence intervals, using the non-standard limit distribution of the (restricted) MLE, are compared to our approach via simulations and real data applications. △ Less

Submitted 24 March, 2017; v1 submitted 24 November, 2016; originally announced November 2016.

Comments: 31 pages, 10 figures, 1 table

Current status linear regression

Authors: Piet Groeneboom, Kim Hendrickx

Abstract: We construct $\sqrt{n}$-consistent and asymptotically normal estimates for the finite dimensional regression parameter in the current status linear regression model, which do not require any smoothing device and are based on maximum likelihood estimates (MLEs) of the infinite dimensional parameter. We also construct estimates, again only based on these MLEs, which are arbitrarily close to efficien… ▽ More We construct $\sqrt{n}$-consistent and asymptotically normal estimates for the finite dimensional regression parameter in the current status linear regression model, which do not require any smoothing device and are based on maximum likelihood estimates (MLEs) of the infinite dimensional parameter. We also construct estimates, again only based on these MLEs, which are arbitrarily close to efficient estimates, if the generalized Fisher information is finite. This type of efficiency is also derived under minimal conditions for estimates based on smooth non-monotone plug-in estimates of the distribution function. Algorithms for computing the estimates and for selecting the bandwidth of the smooth estimates with a bootstrap method are provided. The connection with results in the econometric literature is also pointed out. △ Less

Submitted 1 April, 2017; v1 submitted 2 January, 2016; originally announced January 2016.

Comments: 64 pages, 6 figures

MSC Class: 62G05 (Primary)

Nonparametric confidence intervals for monotone functions

Authors: Piet Groeneboom, Geurt Jongbloed

Abstract: We study nonparametric isotonic confidence intervals for monotone functions. In Banerjee and Wellner (2001) pointwise confidence intervals, based on likelihood ratio tests for the restricted and unrestricted MLE in the current status model, are introduced. We extend the method to the treatment of other models with monotone functions, and demonstrate our method by a new proof of the results in Bane… ▽ More We study nonparametric isotonic confidence intervals for monotone functions. In Banerjee and Wellner (2001) pointwise confidence intervals, based on likelihood ratio tests for the restricted and unrestricted MLE in the current status model, are introduced. We extend the method to the treatment of other models with monotone functions, and demonstrate our method by a new proof of the results in Banerjee and Wellner (2001) and also by constructing confidence intervals for monotone densities, for which still theory had to be developed. For the latter model we prove that the limit distribution of the LR test under the null hypothesis is the same as in the current status model. We compare the confidence intervals, so obtained, with confidence intervals using the smoothed maximum likelihood estimator (SMLE), using bootstrap methods. The `Lagrange-modified' cusum diagrams, developed here, are an essential tool both for the computation of the restricted MLEs and for the development of the theory for the confidence intervals, based on the LR tests. △ Less

Submitted 16 February, 2015; v1 submitted 13 July, 2014; originally announced July 2014.

Comments: 31 pages, 13 figures

MSC Class: 62G05; 62G20

Chernoff's distribution and differential equations of parabolic and Airy type

Authors: Piet Groeneboom, Steven Lalley, Nico Temme

Abstract: We give a direct derivation of the distribution of the maximum and the location of the maximum of one-sided and two-sided Brownian motion with a negative parabolic drift. The argument uses a relation between integrals of special functions, in particular involving integrals with respect to functions which can be called "incomplete Scorer functions". The relation is proved by showing that both integ… ▽ More We give a direct derivation of the distribution of the maximum and the location of the maximum of one-sided and two-sided Brownian motion with a negative parabolic drift. The argument uses a relation between integrals of special functions, in particular involving integrals with respect to functions which can be called "incomplete Scorer functions". The relation is proved by showing that both integrals, as a function of two parameters, satisfy the same extended heat equation, and the maximum principle is used to show that these solution must therefore have the stated relation. Once this relation is established, a direct derivation of the distribution of the maximum and location of the maximum of Brownian motion minus a parabola is possible, leading to a considerable shortening of the original proofs. △ Less

Submitted 17 December, 2013; v1 submitted 26 May, 2013; originally announced May 2013.

Comments: 16 pages

MSC Class: 60J65

The bivariate current status model

Authors: Piet Groeneboom

Abstract: For the univariate current status and, more generally, the interval censoring model, distribution theory has been developed for the maximum likelihood estimator (MLE) and smoothed maximum likelihood estimator (SMLE) of the unknown distribution function, see, e.g., [12], [7], [4], [5], [6], [10], [11] and [8]. For the bivariate current status and interval censoring models distribution theory of thi… ▽ More For the univariate current status and, more generally, the interval censoring model, distribution theory has been developed for the maximum likelihood estimator (MLE) and smoothed maximum likelihood estimator (SMLE) of the unknown distribution function, see, e.g., [12], [7], [4], [5], [6], [10], [11] and [8]. For the bivariate current status and interval censoring models distribution theory of this type is still absent and even the rate at which we can expect reasonable estimators to converge is unknown. We define a purely discrete plug-in estimator of the distribution function which locally converges at rate n^{1/3} and derive its (normal) limit distribution. Unlike the MLE or SMLE, this estimator is not a proper distribution function. Since the estimator is purely discrete, it demonstrates that the n^{1/3} convergence rate is in principle possible for the MLE, but whether this actually holds for the MLE is still an open problem. If the cube root n rate holds for the MLE, this would mean that the local 1-dimensional rate of the MLE continues to hold in dimension 2, a (perhaps) somewhat surprising result. The simulation results do not seem to be in contradiction with this assumption, however. We compare the behavior of the plug-in estimator with the behavior of the MLE on a sieve and the SMLE in a simulation study. This indicates that the plug-in estimator and the SMLE have a smaller variance but a larger bias than the sieved MLE. The SMLE is conjectured to have a n^{1/3}-rate of convergence if we use bandwidths of order n^{-1/6}. We derive its (normal) limit distribution, using this assumption. Finally, we demonstrate the behavior of the MLE and SMLE for the bivariate interval censored data of [1], which have been discussed by many authors, see e.g., [18], [3], [2] and [15]. △ Less

Submitted 15 June, 2013; v1 submitted 4 September, 2012; originally announced September 2012.

Comments: 18 pages, 7 figures, 4 tables

MSC Class: 62G05; 62N01 (Primary) 62G20 (Secondary)

Testing equality of functions under monotonicity constraints

Authors: Cécile Durot, Piet Groeneboom, Hendrik P. Lopuhaä

Abstract: We consider the problem of testing equality of functions $f_j:[0,1]\to \mathbb{R}$ for $j=1,2,...,J$ the basis of $J$ independent samples from possibly different distributions under the assumption that the functions are monotone. We provide a uniform approach that covers testing equality of monotone regression curves, equality of monotone densities and equality of monotone hazards in the random ce… ▽ More We consider the problem of testing equality of functions $f_j:[0,1]\to \mathbb{R}$ for $j=1,2,...,J$ the basis of $J$ independent samples from possibly different distributions under the assumption that the functions are monotone. We provide a uniform approach that covers testing equality of monotone regression curves, equality of monotone densities and equality of monotone hazards in the random censorship model. Two test statistics are proposed based on $L_1$-distances. We show that both statistics are asymptotically normal and we provide bootstrap implementations, which are shown to have critical regions with asymptotic level $α$. △ Less

Submitted 1 July, 2013; v1 submitted 9 July, 2012; originally announced July 2012.

Nonparametric (smoothed) likelihood and integral equations

Authors: Piet Groeneboom

Abstract: We show that there is an intimate connection between the theory of nonparametric (smoothed) maximum likelihood estimators for certain inverse problems and integral equations. This is illustrated by estimators for interval censoring and deconvolution problems. We also discuss the asymptotic efficiency of the MLE for smooth functionals in these models. We show that there is an intimate connection between the theory of nonparametric (smoothed) maximum likelihood estimators for certain inverse problems and integral equations. This is illustrated by estimators for interval censoring and deconvolution problems. We also discuss the asymptotic efficiency of the MLE for smooth functionals in these models. △ Less

Submitted 10 August, 2013; v1 submitted 9 May, 2012; originally announced May 2012.

Comments: 12 figures, invited paper with discussion for the Journal of Statistical Planning and Inference

MSC Class: 62G05; 62N01; 62G20

Maximum smoothed likelihood estimators for the interval censoring model

Authors: Piet Groeneboom

Abstract: We study the maximum smoothed likelihood estimator (MSLE) for interval censoring, case 2, in the so-called separated case. Characterizations in terms of convex duality conditions are given and strong consistency is proved. Moreover, we show that, under smoothness conditions on the underlying distributions and using the usual bandwidth choice in density estimation, the local convergence rate is… ▽ More We study the maximum smoothed likelihood estimator (MSLE) for interval censoring, case 2, in the so-called separated case. Characterizations in terms of convex duality conditions are given and strong consistency is proved. Moreover, we show that, under smoothness conditions on the underlying distributions and using the usual bandwidth choice in density estimation, the local convergence rate is $n^{-2/5}$ and the limit distribution is normal, in contrast with the rate $n^{-1/3}$ of the ordinary maximum likelihood estimator. △ Less

Submitted 15 October, 2014; v1 submitted 20 March, 2012; originally announced March 2012.

Comments: Published in at http://dx.doi.org/10.1214/14-AOS1256 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS1256

Journal ref: Annals of Statistics 2014, Vol. 42, No. 5, 2092-2137

The remaining area of the convex hull of a Poisson process

Authors: Piet Groeneboom

Abstract: In Cabo and Groeneboom (1994) the remaining area of the left-lower convex hull of a Poisson point process with intensity one in the first quadrant of the plane was analyzed, using the methods of Groeneboom (1988), giving formulas for the expectation and variance of the remaining area for a finite interval of slopes of the boundary of the convex hull. However, the time inversion argument of Groeneb… ▽ More In Cabo and Groeneboom (1994) the remaining area of the left-lower convex hull of a Poisson point process with intensity one in the first quadrant of the plane was analyzed, using the methods of Groeneboom (1988), giving formulas for the expectation and variance of the remaining area for a finite interval of slopes of the boundary of the convex hull. However, the time inversion argument of Groeneboom (1988) was not correctly applied in Cabo and Groeneboom (1994), leading to an incorrect scaling constant for the variance. The purpose of this note is to show how the correct application of the time inversion argument gives the right expression, which is in accordance with results in Nagaev and Khamdamov (1991) and Buchta (2003). △ Less

Submitted 12 November, 2011; v1 submitted 10 November, 2011; originally announced November 2011.

Comments: 7 pages, 3 figures

MSC Class: 5A22; 52A38

Estimators for the interval censoring problem

Authors: Piet Groeneboom, Tom Ketelaars

Abstract: We study three estimators for the interval censoring case 2 problem, a histogram-type estimator, proposed in Birgé (1999), the maximum likelihood estimator (MLE) and the smoothed MLE, using a smoothing kernel. Our focus is on the asymptotic distribution of the estimators at a fixed point. The estimators are compared in a simulation study. We study three estimators for the interval censoring case 2 problem, a histogram-type estimator, proposed in Birgé (1999), the maximum likelihood estimator (MLE) and the smoothed MLE, using a smoothing kernel. Our focus is on the asymptotic distribution of the estimators at a fixed point. The estimators are compared in a simulation study. △ Less

Submitted 12 December, 2011; v1 submitted 28 September, 2011; originally announced September 2011.

Comments: 42 pages, 4 figures

MSC Class: 62G20; 62N01 (Primary) 60F05 (Secondary)

Convex hulls of uniform samples from a convex polygon

Authors: Piet Groeneboom

Abstract: In Groeneboom (1988) a central limit theorem for the number of vertices of the convex hull of a uniform sample from the interior of convex polygon was derived. In the unpublished preprint Nagaev and Khamdamov (1991) (in Russian) a central limit result for the joint distribution of the number of vertices and the remaining area is given, using a coupling of the sample process near the border of th… ▽ More In Groeneboom (1988) a central limit theorem for the number of vertices of the convex hull of a uniform sample from the interior of convex polygon was derived. In the unpublished preprint Nagaev and Khamdamov (1991) (in Russian) a central limit result for the joint distribution of the number of vertices and the remaining area is given, using a coupling of the sample process near the border of the polygon with a Poisson point process as in Groeneboom (1988), and representing the remaining area in the Poisson approximation as a union of a doubly infinite sequence of independent standard exponential random variables. We derive this representation from the representation in Groeneboom (1988) and also prove the central limit result of Nagaev and Khamdamov (1991), using this representation. The relation between the variances of the asymptotic normal distributions of number of vertices and the area, established in Nagaev and Khamdamov (1991), corresponds to a relation between the actual sample variances of the number of vertices and the remaining area in Buchta (2005). We show how these asymptotic results all follow from one simple guiding principle. This corrects at the same time the scaling constants in Nagaev (1995) and Cabo and Groeneboom (1994). △ Less

Submitted 11 November, 2011; v1 submitted 14 September, 2011; originally announced September 2011.

Comments: 18 pages, 4 figures, To appear in the Advances in Applied Probability

MSC Class: 5A22; 52A38

A maximum smoothed likelihood estimator in the current status continuous mark model

Authors: Piet Groeneboom, Geurt Jongbloed, Birgit Witte

Abstract: We consider the problem of estimating the joint distribution function of the event time and a continuous mark variable based on censored data. More specifically, the event time is subject to current status censoring and the continuous mark is only observed in case inspection takes place after the event time. The nonparametric maximum likelihood estimator (MLE) in this model is known to be inconsis… ▽ More We consider the problem of estimating the joint distribution function of the event time and a continuous mark variable based on censored data. More specifically, the event time is subject to current status censoring and the continuous mark is only observed in case inspection takes place after the event time. The nonparametric maximum likelihood estimator (MLE) in this model is known to be inconsistent. We propose and study an alternative likelihood based estimator, maximizing a smoothed log-likelihood, hence called a maximum smoothed likelihood estimator (MSLE). This estimator is shown to be well defined and consistent, and a simple algorithm is described that can be used to compute it. The MSLE is compared with other estimators in a small simulation study. △ Less

Submitted 6 September, 2011; originally announced September 2011.

Comments: 24 pages, 6 figures

MSC Class: 62G05; 62G20; 62N02; 62H12

Likelihood ratio type two-sample tests for current status data

Authors: Piet Groeneboom

Abstract: We introduce fully nonparametric two-sample tests for testing the null hypothesis that the samples come from the same distribution if the values are only indirectly given via current status censoring. The tests are based on the likelihood ratio principle and allow the observation distributions to be different for the two samples, in contrast with earlier proposals for this situation. A bootstrap m… ▽ More We introduce fully nonparametric two-sample tests for testing the null hypothesis that the samples come from the same distribution if the values are only indirectly given via current status censoring. The tests are based on the likelihood ratio principle and allow the observation distributions to be different for the two samples, in contrast with earlier proposals for this situation. A bootstrap method is given for determining critical values and asymptotic theory is developed. A simulation study, using Weibull distributions, is presented to compare the power behavior of the tests with the power of other nonparametric tests in this situation. △ Less

Submitted 11 July, 2013; v1 submitted 19 February, 2011; originally announced February 2011.

Comments: 38 pages, 3 figures

Smooth and non-smooth estimates of a monotone hazard

Authors: Piet Groeneboom, Geurt Jongbloed

Abstract: We discuss a number of estimates of the hazard under the assumption that the hazard is monotone on an interval [0,a]. The usual isotonic least squares estimators of the hazard are inconsistent at the boundary points 0 and a. We use penalization to obtain uniformly consistent estimators. Moreover, we determine the optimal penalization constants, extending related work in this direction by Woodroofe… ▽ More We discuss a number of estimates of the hazard under the assumption that the hazard is monotone on an interval [0,a]. The usual isotonic least squares estimators of the hazard are inconsistent at the boundary points 0 and a. We use penalization to obtain uniformly consistent estimators. Moreover, we determine the optimal penalization constants, extending related work in this direction by Woodroofe and Sun (1993) and Woodroofe and Sun (1999). Two methods of obtaining smooth monotone estimates based on a non-smooth monotone estimator are discussed. One is based on kernel smoothing, the other on penalization. △ Less

Submitted 19 February, 2011; originally announced February 2011.

Comments: 19 pages, 7 figures, submitted to the volume in the IMS Lecture Notes Monograph Series in honor of the 65th birthday of Jon Wellner

MSC Class: Primary 62G05; 62G05; Secondary 62E20

Smooth plug-in inverse estimators in the current status continuous mark model

Authors: Piet Groeneboom, Geurt Jongbloed, Birgit Witte

Abstract: We consider the problem of estimating the joint distribution function of the event time and a continuous mark variable when the event time is subject to interval censoring case 1 and the continuous mark variable is only observed in case the event occurred before the time of inspection. The nonparametric maximum likelihood estimator in this model is known to be inconsistent. We study two alternativ… ▽ More We consider the problem of estimating the joint distribution function of the event time and a continuous mark variable when the event time is subject to interval censoring case 1 and the continuous mark variable is only observed in case the event occurred before the time of inspection. The nonparametric maximum likelihood estimator in this model is known to be inconsistent. We study two alternative smooth estimators, based on the explicit (inverse) expression of the distribution function of interest in terms of the density of the observable vector. We derive the pointwise asymptotic distribution of both estimators. △ Less

Submitted 9 February, 2011; originally announced February 2011.

Comments: 29 pages, 12 figures

Testing monotonicity of a hazard: asymptotic distribution theory

Authors: Piet Groeneboom, Geurt Jongbloed

Abstract: Two new test statistics are introduced to test the null hypotheses that the sampling distribution has an increasing hazard rate on a specified interval [0,a]. These statistics are empirical L_1-type distances between the isotonic estimates, which use the monotonicity constraint, and either the empirical distribution function or the empirical cumulative hazard. They measure the excursions of the em… ▽ More Two new test statistics are introduced to test the null hypotheses that the sampling distribution has an increasing hazard rate on a specified interval [0,a]. These statistics are empirical L_1-type distances between the isotonic estimates, which use the monotonicity constraint, and either the empirical distribution function or the empirical cumulative hazard. They measure the excursions of the empirical estimates with respect to the isotonic estimates, due to local non-monotonicity. Asymptotic normality of the test statistics, if the hazard is strictly increasing on [0,a], is established under mild conditions. This is done by first approximating the global empirical distance by an distance with respect to the underlying distribution function. The resulting integral is treated as sum of increasingly many local integrals to which a CLT can be applied. The behavior of the local integrals is determined by a canonical process: the difference between the stochastic process x -> W(x)+x^2 where W is standard two-sided Brownian Motion, and its greatest convex minorant. △ Less

Submitted 26 October, 2011; v1 submitted 17 January, 2011; originally announced January 2011.

Comments: 28 pages, 1 figure

MSC Class: 62E20 (Primary) 62N03 (Secondary)

Isotonic L_2-projection test for local monotonicity of a hazard

Authors: Piet Groeneboom, Geurt Jongbloed

Abstract: We introduce a new test statistic for testing the null hypothesis that the sampling distribution has an increasing hazard rate on a specified interval [0,a]. It is based on a comparison of the empirical distribution function with an isotonic estimate, using the restriction that the hazard is increasing, and measures the excursions of the empirical distribution above the isotonic estimate, due to l… ▽ More We introduce a new test statistic for testing the null hypothesis that the sampling distribution has an increasing hazard rate on a specified interval [0,a]. It is based on a comparison of the empirical distribution function with an isotonic estimate, using the restriction that the hazard is increasing, and measures the excursions of the empirical distribution above the isotonic estimate, due to local non-monotonicity. It is proved in the companion paper Groeneboom and Jongbloed (2011a) that the test statistic is asymptotically normal if the hazard is strictly increasing on the interval [0,a] and certain regularity conditions are satisfied. We discuss a bootstrap method for computing the critical values and compare the test, thus obtained, with other proposals in a simulation study. △ Less

Submitted 17 January, 2011; originally announced January 2011.

Comments: 15 pages, 6 figures

MSC Class: Primary: 62G10; secondary 62N05

The tail of the maximum of Brownian motion minus a parabola

Authors: Piet Groeneboom, Nico M. Temme

Abstract: We analyze the tail behavior of the maximum N of Brownian motion minus a parabola and give an asymptotic expansion for P(N>x) as x tends to infinity. This extends a first order result on the tail behavior, which can be deduced from Huesler and Piterbarg (1999). We also point out the relation between certain results in Groeneboom (2010) and Janson, Louchard and Martin-Löf (2010). We analyze the tail behavior of the maximum N of Brownian motion minus a parabola and give an asymptotic expansion for P(N>x) as x tends to infinity. This extends a first order result on the tail behavior, which can be deduced from Huesler and Piterbarg (1999). We also point out the relation between certain results in Groeneboom (2010) and Janson, Louchard and Martin-Löf (2010). △ Less

Submitted 11 May, 2011; v1 submitted 17 November, 2010; originally announced November 2010.

Comments: 12 pages, submitted to the Electronic Communications in Probability

MSC Class: 60J65; 60J75

Vertices of the least concave majorant of Brownian motion with parabolic drift

Authors: Piet Groeneboom

Abstract: It was shown in Groeneboom (1983) that the least concave majorant of one-sided Brownian motion without drift can be characterized by a jump process with independent increments, which is the inverse of the process of slopes of the least concave majorant. This result can be used to prove the result of Sparre Andersen (1954) that the number of vertices of the smallest concave majorant of the empirica… ▽ More It was shown in Groeneboom (1983) that the least concave majorant of one-sided Brownian motion without drift can be characterized by a jump process with independent increments, which is the inverse of the process of slopes of the least concave majorant. This result can be used to prove the result of Sparre Andersen (1954) that the number of vertices of the smallest concave majorant of the empirical distribution function of a sample of size n from the uniform distribution on [0,1] is asymptotically normal, with an asymptotic expectation and variance which are both of order log n. A similar (Markovian) inverse jump process was introduced in Groeneboom (1989), in an analysis of the least concave majorant of two-sided Brownian motion with a parabolic drift. This process is quite different from the process for one-sided Brownian motion without drift: the number of vertices in a (corresponding slopes) interval has an expectation proportional to the length of the interval and the variance of the number of vertices in such an interval is about half the size of the expectation, if the length of the interval tends to infinity. We prove an asymptotic normality result for the number of vertices in an increasing interval, which translates into a corresponding result for the least concave majorant of an empirical distribution function of a sample of size n, generated by a strictly concave distribution function. In this case the number of vertices is of order cube root n, and the variance is again about half the size of the asymptotic expectation. As a side result we obtain some interesting relations between the first moments of the number of vertices, the square of the location of the maximum of Brownian motion minus a parabola, the value of the maximum itself, the squared slope of the least concave majorant at zero, and the value of the least concave majorant at zero. △ Less

Submitted 25 March, 2013; v1 submitted 29 October, 2010; originally announced November 2010.

Comments: 17 pages, 4 figures, to appear in the Electronic Journal of Probability

MSC Class: 60J65; 60J75

Journal ref: Electronic Journal of Probability, Vol. 16 (2011), pages 2234-2258

The maximum of Brownian motion minus a parabola

Authors: Piet Groeneboom

Abstract: We derive a simple integral representation for the distribution of the maximum of Brownian motion minus a parabola, which can be used for computing the density and moments of the distribution, both for one-sided and two-sided Brownian motion. We derive a simple integral representation for the distribution of the maximum of Brownian motion minus a parabola, which can be used for computing the density and moments of the distribution, both for one-sided and two-sided Brownian motion. △ Less

Submitted 29 October, 2010; originally announced November 2010.

Comments: 7 pages, 4 figures, to appear in the Electronic Journal of Probability

MSC Class: 60J65; 60J75

Journal ref: Electronic Journal of Probability (2010), 15, 1930-1935

Elementary Statistics on Trial (the case of Lucia de Berk)

Authors: Richard D. Gill, Piet Groeneboom, Peter de Jong

Abstract: In the conviction of Lucia de Berk an important role was played by a simple hypergeometric model, used by the expert consulted by the court, which produced very small probabilities of occurrences of certain numbers of incidents. We want to draw attention to the fact that, if we take into account the variation among nurses in incidents they experience during their shifts, these probabilities can be… ▽ More In the conviction of Lucia de Berk an important role was played by a simple hypergeometric model, used by the expert consulted by the court, which produced very small probabilities of occurrences of certain numbers of incidents. We want to draw attention to the fact that, if we take into account the variation among nurses in incidents they experience during their shifts, these probabilities can become considerably larger. This points to the danger of using an oversimplified discrete probability model in these circumstances. △ Less

Submitted 22 October, 2019; v1 submitted 3 September, 2010; originally announced September 2010.

Comments: 10 pages, 3 figures and 2 tables

MSC Class: 62P99

Journal ref: CHANCE, 31:4, 9-15 (2018)

Maximum smoothed likelihood estimation and smoothed maximum likelihood estimation in the current status model

Authors: Piet Groeneboom, Geurt Jongbloed, Birgit I. Witte

Abstract: We consider the problem of estimating the distribution function, the density and the hazard rate of the (unobservable) event time in the current status model. A well studied and natural nonparametric estimator for the distribution function in this model is the nonparametric maximum likelihood estimator (MLE). We study two alternative methods for the estimation of the distribution function, assum… ▽ More We consider the problem of estimating the distribution function, the density and the hazard rate of the (unobservable) event time in the current status model. A well studied and natural nonparametric estimator for the distribution function in this model is the nonparametric maximum likelihood estimator (MLE). We study two alternative methods for the estimation of the distribution function, assuming some smoothness of the event time distribution. The first estimator is based on a maximum smoothed likelihood approach. The second method is based on smoothing the (discrete) MLE of the distribution function. These estimators can be used to estimate the density and hazard rate of the event time distribution based on the plug-in principle. △ Less

Submitted 12 January, 2010; originally announced January 2010.

Comments: Published in at http://dx.doi.org/10.1214/09-AOS721 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS721 MSC Class: 62G05; 62N01 (Primary) 62G20 (Secondary)

Journal ref: Annals of Statistics 2010, Vol. 38, No. 1, 352-387

Current status data with competing risks: Limiting distribution of the MLE

Authors: Piet Groeneboom, Marloes H. Maathuis, Jon A. Wellner

Abstract: We study nonparametric estimation for current status data with competing risks. Our main interest is in the nonparametric maximum likelihood estimator (MLE), and for comparison we also consider a simpler ``naive estimator.'' Groeneboom, Maathuis and Wellner [Ann. Statist. (2008) 36 1031--1063] proved that both types of estimators converge globally and locally at rate $n^{1/3}$. We use these resu… ▽ More We study nonparametric estimation for current status data with competing risks. Our main interest is in the nonparametric maximum likelihood estimator (MLE), and for comparison we also consider a simpler ``naive estimator.'' Groeneboom, Maathuis and Wellner [Ann. Statist. (2008) 36 1031--1063] proved that both types of estimators converge globally and locally at rate $n^{1/3}$. We use these results to derive the local limiting distributions of the estimators. The limiting distribution of the naive estimator is given by the slopes of the convex minorants of correlated Brownian motion processes with parabolic drifts. The limiting distribution of the MLE involves a new self-induced limiting process. Finally, we present a simulation study showing that the MLE is superior to the naive estimator in terms of mean squared error, both for small sample sizes and asymptotically. △ Less

Submitted 17 June, 2008; v1 submitted 1 September, 2006; originally announced September 2006.

Comments: Published in at http://dx.doi.org/10.1214/009053607000000983 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS0336 MSC Class: 62N01; 62G20 (Primary) 62G05 (Secondary)

Journal ref: Annals of Statistics 2008, Vol. 36, No. 3, 1064-1089

Current status data with competing risks: Consistency and rates of Convergence of the MLE

Authors: Piet Groeneboom, Marloes H. Maathuis, Jon A. Wellner

Abstract: We study nonparametric estimation of the sub-distribution functions for current status data with competing risks. Our main interest is in the nonparametric maximum likelihood estimator (MLE), and for comparison we also consider a simpler ``naive estimator.'' Both types of estimators were studied by Jewell, van der Laan and Henneman [Biometrika (2003) 90 183--197], but little was known about thei… ▽ More We study nonparametric estimation of the sub-distribution functions for current status data with competing risks. Our main interest is in the nonparametric maximum likelihood estimator (MLE), and for comparison we also consider a simpler ``naive estimator.'' Both types of estimators were studied by Jewell, van der Laan and Henneman [Biometrika (2003) 90 183--197], but little was known about their large sample properties. We have started to fill this gap, by proving that the estimators are consistent and converge globally and locally at rate $n^{1/3}$. We also show that this local rate of convergence is optimal in a minimax sense. The proof of the local rate of convergence of the MLE uses new methods, and relies on a rate result for the sum of the MLEs of the sub-distribution functions which holds uniformly on a fixed neighborhood of a point. Our results are used in Groeneboom, Maathuis and Wellner [Ann. Statist. (2008) 36 1064--1089] to obtain the local limiting distributions of the estimators. △ Less

Submitted 17 June, 2008; v1 submitted 1 September, 2006; originally announced September 2006.

Comments: Published in at http://dx.doi.org/10.1214/009053607000000974 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS0334 MSC Class: 62N01; 62G20 (Primary) 62G05 (Secondary)

Journal ref: Annals of Statistics 2008, Vol. 36, No. 3, 1031-1063

Second class particles and cube root asymptotics for Hammersley's process

Authors: Eric Cator, Piet Groeneboom

Abstract: We show that, for a stationary version of Hammersley's process, with Poisson sources on the positive x-axis and Poisson sinks on the positive y-axis, the variance of the length of a longest weakly North--East path $L(t,t)$ from $(0,0)$ to $(t,t)$ is equal to $2\mathbb {E}(t-X(t))_+$, where $X(t)$ is the location of a second class particle at time $t$. This implies that both… ▽ More We show that, for a stationary version of Hammersley's process, with Poisson sources on the positive x-axis and Poisson sinks on the positive y-axis, the variance of the length of a longest weakly North--East path $L(t,t)$ from $(0,0)$ to $(t,t)$ is equal to $2\mathbb {E}(t-X(t))_+$, where $X(t)$ is the location of a second class particle at time $t$. This implies that both $\mathbb {E}(t-X(t))_+$ and the variance of $L(t,t)$ are of order $t^{2/3}$. Proofs are based on the relation between the flux and the path of a second class particle, continuing the approach of Cator and Groeneboom [Ann. Probab. 33 (2005) 879--903]. △ Less

Submitted 21 September, 2006; v1 submitted 14 March, 2006; originally announced March 2006.

Comments: Published at http://dx.doi.org/10.1214/009117906000000089 in the Annals of Probability (http://www.imstat.org/aop/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOP-AOP0142 MSC Class: 60C05; 60K35 (Primary) 60F05 (Secondary)

Journal ref: Annals of Probability 2006, Vol. 34, No. 4, 1273-1295

Hammersley's process with sources and sinks

Authors: Eric Cator, Piet Groeneboom

Abstract: We show that, for a stationary version of Hammersley's process, with Poisson ``sources'' on the positive x-axis, and Poisson ``sinks'' on the positive y-axis, an isolated second-class particle, located at the origin at time zero, moves asymptotically, with probability 1, along the characteristic of a conservation equation for Hammersley's process. This allows us to show that Hammersley's process… ▽ More We show that, for a stationary version of Hammersley's process, with Poisson ``sources'' on the positive x-axis, and Poisson ``sinks'' on the positive y-axis, an isolated second-class particle, located at the origin at time zero, moves asymptotically, with probability 1, along the characteristic of a conservation equation for Hammersley's process. This allows us to show that Hammersley's process without sinks or sources, as defined by Aldous and Diaconis [Probab. Theory Related Fields 10 (1995) 199-213] converges locally in distribution to a Poisson process, a result first proved in Aldous and Diaconis (1995) by using the ergodic decomposition theorem and a construction of Hammersley's process as a one-dimensional point process, developing as a function of (continuous) time on the whole real line. As a corollary we get the result that EL(t,t)/t converges to 2, as t\to\infty, where L(t,t) is the length of a longest North-East path from (0,0) to (t,t). The proofs of these facts need neither the ergodic decomposition theorem nor the subadditive ergodic theorem. We also prove a version of Burke's theorem for the stationary process with sources and sinks and briefly discuss the relation of these results with the theory of longest increasing subsequences of random permutations. △ Less

Submitted 29 June, 2005; originally announced June 2005.

Comments: Published at http://dx.doi.org/10.1214/009117905000000053 in the Annals of Probability (http://www.imstat.org/aop/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOP-AOP055 MSC Class: 60C05\sep60K35 (Primary) 60F05 (Secondary)

Journal ref: Annals of Probability 2005, Vol. 33, No. 3, 879-903

The suppport reduction algorithm for computing nonparametric function estimates in mixture models

Authors: Piet Groeneboom, Geurt Jongbloed, Jon A. Wellner

Abstract: Vertex direction algorithms have been around for a few decades in the experimental design and mixture models literature. We briefly review this type of algorithm and describe a new member of the family: the support reduction algorithm. The support reduction algorithm is applied to the problem of computing nonparametric estimates in two inverse problems: convex density estimation and the Gaussian… ▽ More Vertex direction algorithms have been around for a few decades in the experimental design and mixture models literature. We briefly review this type of algorithm and describe a new member of the family: the support reduction algorithm. The support reduction algorithm is applied to the problem of computing nonparametric estimates in two inverse problems: convex density estimation and the Gaussian deconvolution problem. Usually, VD algorithms solve a finite dimensional (version of the) optimization problem of interest. We introduce a method to solve the true infinite dimensional optimization problem. △ Less

Submitted 26 May, 2004; originally announced May 2004.

Comments: 19 pages. See also http://www.cs.vu.nl/sto/publications/2002-13.ps

Report number: CS-VU 2002-13 MSC Class: 65C (primary); 60 (secondary); 62-04