Showing 1–3 of 3 results for author: Boysen, L

Consistencies and rates of convergence of jump-penalized least squares estimators

Authors: Leif Boysen, Angela Kempe, Volkmar Liebscher, Axel Munk, Olaf Wittich

Abstract: We study the asymptotics for jump-penalized least squares regression aiming at approximating a regression function by piecewise constant functions. Besides conventional consistency and convergence rates of the estimates in $L^2([0,1))$ our results cover other metrics like Skorokhod metric on the space of càdlàg functions and uniform metrics on $C([0,1])$. We will show that these estimators are i… ▽ More We study the asymptotics for jump-penalized least squares regression aiming at approximating a regression function by piecewise constant functions. Besides conventional consistency and convergence rates of the estimates in $L^2([0,1))$ our results cover other metrics like Skorokhod metric on the space of càdlàg functions and uniform metrics on $C([0,1])$. We will show that these estimators are in an adaptive sense rate optimal over certain classes of "approximation spaces." Special cases are the class of functions of bounded variation (piecewise) Hölder continuous functions of order $0<α\le1$ and the class of step functions with a finite but arbitrary number of jumps. In the latter setting, we will also deduce the rates known from change-point analysis for detecting the jumps. Finally, the issue of fully automatic selection of the smoothing parameter is addressed. △ Less

Submitted 27 February, 2009; originally announced February 2009.

Comments: Published in at http://dx.doi.org/10.1214/07-AOS558 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS558 MSC Class: 62G05; 62G20 (Primary) 41A10; 41A25 (Secondary)

Journal ref: Annals of Statistics 2009, Vol. 37, No. 1, 157-183

Jump estimation in inverse regression

Authors: Leif Boysen, Axel Munk

Abstract: We consider estimation of a step function $f$ from noisy observations of a deconvolution $φ*f$, where $φ$ is some bounded $L_1$-function. We use a penalized least squares estimator to reconstruct the signal $f$ from the observations, with penalty equal to the number of jumps of the reconstruction. Asymptotically, it is possible to correctly estimate the number of jumps with probability one. Give… ▽ More We consider estimation of a step function $f$ from noisy observations of a deconvolution $φ*f$, where $φ$ is some bounded $L_1$-function. We use a penalized least squares estimator to reconstruct the signal $f$ from the observations, with penalty equal to the number of jumps of the reconstruction. Asymptotically, it is possible to correctly estimate the number of jumps with probability one. Given that the number of jumps is correctly estimated, we show that the corresponding parameter estimates of the jump locations and jump heights are $n^{-1/2}$ consistent and converge to a joint normal distribution with covariance structure depending on $φ$, and that this rate is minimax for bounded continuous kernels $φ$. As special case we obtain the asymptotic distribution of the least squares estimator in multiphase regression and generalisations thereof. In contrast to the results obtained for bounded $φ$, we show that for kernels with a singularity of order $O(| x|^{-α}),1/2<α<1$, a jump location can be estimated at a rate of $n^{-1/(3-2α)}$, which is again the minimax rate. We find that these rate do not depend on the spectral information of the operator rather on its localization properties in the time domain. Finally, it turns out that adaptive sampling does not improve the rate of convergence, in strict contrast to the case of direct regression. △ Less

Submitted 14 March, 2008; originally announced March 2008.

Comments: Submitted to the Electronic Journal of Statistics (http://www.i-journals.org/ejs/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-EJS-EJS_2008_204 MSC Class: 62G05; 62G20 (Primary) 42A82; 46E22 (Secondary)

Scale space consistency of piecewise constant least squares estimators -- another look at the regressogram

Authors: Leif Boysen, Volkmar Liebscher, Axel Munk, Olaf Wittich

Abstract: We study the asymptotic behavior of piecewise constant least squares regression estimates, when the number of partitions of the estimate is penalized. We show that the estimator is consistent in the relevant metric if the signal is in $L^2([0,1])$, the space of càdlàg functions equipped with the Skorokhod metric or $C([0,1])$ equipped with the supremum metric. Moreover, we consider the family of… ▽ More We study the asymptotic behavior of piecewise constant least squares regression estimates, when the number of partitions of the estimate is penalized. We show that the estimator is consistent in the relevant metric if the signal is in $L^2([0,1])$, the space of càdlàg functions equipped with the Skorokhod metric or $C([0,1])$ equipped with the supremum metric. Moreover, we consider the family of estimates under a varying smoothing parameter, also called scale space. We prove convergence of the empirical scale space towards its deterministic target. △ Less

Submitted 11 September, 2007; v1 submitted 13 September, 2006; originally announced September 2006.

Comments: Published at http://dx.doi.org/10.1214/074921707000000274 in the IMS Lecture Notes Monograph Series (http://www.imstat.org/publications/lecnotes.htm) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-LNMS55-LNMS5503 MSC Class: 62G05; 62G20 (Primary); 41A10; 41A25 (Secondary)

Journal ref: IMS Lecture Notes Monograph Series 2007, Vol. 55, 65-84