-
Testing for changes in the error distribution in functional linear models
Authors:
Natalie Neumeyer,
Leonie Selk
Abstract:
We consider linear models with scalar responses and covariates from a separable Hilbert space. The aim is to detect change points in the error distribution, based on sequential residual empirical distribution functions. Expansions for those estimated functions are more challenging in models with infinite-dimensional covariates than in regression models with scalar or vector-valued covariates due t…
▽ More
We consider linear models with scalar responses and covariates from a separable Hilbert space. The aim is to detect change points in the error distribution, based on sequential residual empirical distribution functions. Expansions for those estimated functions are more challenging in models with infinite-dimensional covariates than in regression models with scalar or vector-valued covariates due to a slower rate of convergence of the parameter estimators. Yet the suggested change point test is asymptotically distribution-free and consistent for one-change point alternatives. In the latter case we also show consistency of a change point estimator.
△ Less
Submitted 7 November, 2024;
originally announced November 2024.
-
Nonparametric Regression and Classification with Functional, Categorical, and Mixed Covariates
Authors:
Leonie Selk,
Jan Gertheiss
Abstract:
We consider nonparametric prediction with multiple covariates, in particular categorical or functional predictors, or a mixture of both. The method proposed bases on an extension of the Nadaraya-Watson estimator where a kernel function is applied on a linear combination of distance measures each calculated on single covariates, with weights being estimated from the training data. The dependent var…
▽ More
We consider nonparametric prediction with multiple covariates, in particular categorical or functional predictors, or a mixture of both. The method proposed bases on an extension of the Nadaraya-Watson estimator where a kernel function is applied on a linear combination of distance measures each calculated on single covariates, with weights being estimated from the training data. The dependent variable can be categorical (binary or multi-class) or continuous, thus we consider both classification and regression problems. The methodology presented is illustrated and evaluated on artificial and real world data. Particularly it is observed that prediction accuracy can be increased, and irrelevant, noise variables can be identified/removed by `downgrading' the corresponding distance measures in a completely data-driven way.
△ Less
Submitted 4 August, 2022; v1 submitted 4 November, 2021;
originally announced November 2021.
-
Hypotheses tests in boundary regression models
Authors:
Holger Drees,
Natalie Neumeyer,
Leonie Selk
Abstract:
Consider a nonparametric regression model with one-sided errors and regression function in a general Hölder class. We estimate the regression function via minimization of the local integral of a polynomial approximation. We show uniform rates of convergence for the simple regression estimator as well as for a smooth version. These rates carry over to mean regression models with a symmetric and bou…
▽ More
Consider a nonparametric regression model with one-sided errors and regression function in a general Hölder class. We estimate the regression function via minimization of the local integral of a polynomial approximation. We show uniform rates of convergence for the simple regression estimator as well as for a smooth version. These rates carry over to mean regression models with a symmetric and bounded error distribution. In such a setting, one obtains faster rates for irregular error distributions concentrating sufficient mass near the endpoints than for the usual regular distributions. The results are applied to prove asymptotic $\sqrt{n}$-equivalence of a residual-based (sequential) empirical distribution function to the (sequential) empirical distribution function of unobserved errors in the case of irregular error distributions. This result is remarkably different from corresponding results in mean regression with regular errors. It can readily be applied to develop goodness-of-fit tests for the error distribution. We present some examples and investigate the small sample performance in a simulation study. We further discuss asymptotically distribution-free hypotheses tests for independence of the error distribution from the points of measurement and for monotonicity of the boundary function as well.
△ Less
Submitted 11 October, 2016; v1 submitted 18 August, 2014;
originally announced August 2014.
-
Testing for a change of the innovation distribution in nonparametric autoregression - the sequential empirical process approach
Authors:
Leonie Selk,
Natalie Neumeyer
Abstract:
We consider a nonparametric autoregression model under conditional heteroscedasticity with the aim to test whether the innovation distribution changes in time. To this end we develop an asymptotic expansion for the sequential empirical process of nonparametrically estimated innovations (residuals). We suggest a Kolmogorov-Smirnov statistic based on the difference of the estimated innovation distri…
▽ More
We consider a nonparametric autoregression model under conditional heteroscedasticity with the aim to test whether the innovation distribution changes in time. To this end we develop an asymptotic expansion for the sequential empirical process of nonparametrically estimated innovations (residuals). We suggest a Kolmogorov-Smirnov statistic based on the difference of the estimated innovation distributions built from the first ns and the last n-ns residuals, respectively. Weak convergence of the underlying stochastic process to a Gaussian process is proved under the null hypothesis of no change point. The result implies that the test is asymptotically distribution-free. Consistency against fixed alternatives is shown. The small sample performances of the proposed test is investigated in a simulation study and the test is applied to data examples.
△ Less
Submitted 6 November, 2012;
originally announced November 2012.
-
A note on nonparametric testing for Gaussian innovations in AR-ARCH models
Authors:
Natalie Neumeyer,
Leonie Selk
Abstract:
In this paper we consider autoregressive models with conditional autoregressive variance, including the case of homoscedastic AR-models and the case of ARCH models. Our aim is to test the hypothesis of normality for the innovations in a completely nonparametric way, i. e. without imposing parametric assumptions on the conditional mean and volatility functions. To this end the Cramér-von Mises test…
▽ More
In this paper we consider autoregressive models with conditional autoregressive variance, including the case of homoscedastic AR-models and the case of ARCH models. Our aim is to test the hypothesis of normality for the innovations in a completely nonparametric way, i. e. without imposing parametric assumptions on the conditional mean and volatility functions. To this end the Cramér-von Mises test based on the empirical distribution function of nonparametrically estimated residuals is shown to be asymptotically distribution-free. We demonstrate its good performance for finite sample sizes in a simulation study.
△ Less
Submitted 6 November, 2012;
originally announced November 2012.
