Showing 1–32 of 32 results for author: Kulik, R

A remarkable example on clustering of extremes for regularly-varying stochastic processes

Authors: Shuyang Bai, Rafał Kulik, Yizao Wang

Abstract: The stable-regenerative multiple-stable model has been shown recently to have distinct candidate extremal index and extremal index. To understand further this rare phenomenon, two more results are established here for the double-stable model. The first is the convergence of point processes for the clusters of extremes, enhancing the previous result on the weak convergence of random sup-measures. M… ▽ More The stable-regenerative multiple-stable model has been shown recently to have distinct candidate extremal index and extremal index. To understand further this rare phenomenon, two more results are established here for the double-stable model. The first is the convergence of point processes for the clusters of extremes, enhancing the previous result on the weak convergence of random sup-measures. Most interestingly, the second result reveals a new phase transition at the mesoscopic level when computing the asymptotic exceedance probability over a block, $\mathbb P(\max_{k=1,\dots,d_n} X_k>b_n)$, as $n\to\infty$. Here, the mesoscopic level is referred to the fact that the block size $d_n$ is allowed to grow at the rate $n^ρ$ with $ρ\in[0,1]$, while the threshold $b_n$ is such that $\mathbb P(X_1>b_n)\sim 1/n$. The recently discovered discrepancy between the candidate extremal index and the extremal index is shown to be just a reflection of this phase transition that is prohibited by the anticlustering condition. △ Less

Submitted 9 October, 2024; v1 submitted 26 September, 2024; originally announced September 2024.

Comments: 38 pages; corrected a few typos and implemented some minor edits

Asymptotic expansions for blocks estimators: PoT framework

Authors: Zaoli Chen, Rafał Kulik

Abstract: We consider disjoint and sliding blocks estimators of cluster indices for multivariate, regularly varying time series in the Peak-over-Threshold framework. We aim to provide a complete description of the limiting behaviour of these estimators. This is achieved by a precise expansion for the difference between the sliding and the disjoint blocks statistics. The rates in the expansion stem from inte… ▽ More We consider disjoint and sliding blocks estimators of cluster indices for multivariate, regularly varying time series in the Peak-over-Threshold framework. We aim to provide a complete description of the limiting behaviour of these estimators. This is achieved by a precise expansion for the difference between the sliding and the disjoint blocks statistics. The rates in the expansion stem from internal clusters and boundary clusters. To obtain these rates we need to extend the existing results on vague convergence of cluster measures. We reveal dichotomous behaviour between small blocks and large blocks scenario. △ Less

Submitted 6 September, 2023; originally announced September 2023.

Comments: 52 pages

Limit theorems for unbounded cluster functionals of regularly varying time series

Authors: Zaoli Chen, Rafal Kulik

Abstract: A blocks method is used to define clusters of extreme values in stationary time series. The cluster starts at the first large value in the block and ends at the last one. The block cluster measure (the point measure at clusters) encodes different aspects of extremal properties. Its limiting behaviour is handled by vague convergence, hence the set of test functions consists of bounded, shift-invari… ▽ More A blocks method is used to define clusters of extreme values in stationary time series. The cluster starts at the first large value in the block and ends at the last one. The block cluster measure (the point measure at clusters) encodes different aspects of extremal properties. Its limiting behaviour is handled by vague convergence, hence the set of test functions consists of bounded, shift-invariant functionals that vanish around zero. If unbounded or non shift-invariant functionals are considered, we may obtain convergence at a different rate, depending on the type of the functional and the block size (small vs. large blocks). There are two prominent examples of such functionals: the locations of large jumps and the cluster length. We obtain a comprehensive characterization of the limiting behaviour of the block cluster measure evaluated at such functionals for stationary, regularly varying time series. Once the convergence of the block cluster measure is established, we can proceed with consistency of the empirical cluster measure. Consistency holds in the small and moderate blocks scenario, while fails in the large blocks situation. Next, we continue with weak convergence of the empirical cluster processes. The starting point is the seminal paper by Drees and Rootzen (2010). Under the appropriate uniform integrability condition (related to small blocks) the results in the latter paper are still valid. In the moderate and large blocks scenario, the Drees and Rootzen empirical cluster process diverges, but converges weakly when re-normalized properly. △ Less

Submitted 30 August, 2023; originally announced August 2023.

Comments: 35 pages

Estimation of cluster functionals for regularly varying time series: runs estimators

Authors: Youssouph Cissokho, Rafal Kulik

Abstract: Cluster indices describe extremal behaviour of stationary time series. We consider runs estimators of cluster indices. Using a modern theory of multivariate, regularly varying time series, we obtain central limit theorems under conditions that can be easily verified for a large class of models. In particular, we show that blocks and runs estimators have the same limiting variance. Cluster indices describe extremal behaviour of stationary time series. We consider runs estimators of cluster indices. Using a modern theory of multivariate, regularly varying time series, we obtain central limit theorems under conditions that can be easily verified for a large class of models. In particular, we show that blocks and runs estimators have the same limiting variance. △ Less

Submitted 5 September, 2021; originally announced September 2021.

Comments: 47 pages, 2 figures, 2 tables. arXiv admin note: text overlap with arXiv:2005.11378

Change-point tests for the tail parameter of Long Memory Stochastic Volatility time series

Authors: Annika Betken, Davide Giraudo, Rafał Kulik

Abstract: We consider a change-point test based on the Hill estimator to test for structural changes in the tail index of Long Memory Stochastic Volatility time series. In order to determine the asymptotic distribution of the corresponding test statistic, we prove a uniform reduction principle for the tail empirical process in a two-parameter Skorohod space. It is shown that such a process displays a dichot… ▽ More We consider a change-point test based on the Hill estimator to test for structural changes in the tail index of Long Memory Stochastic Volatility time series. In order to determine the asymptotic distribution of the corresponding test statistic, we prove a uniform reduction principle for the tail empirical process in a two-parameter Skorohod space. It is shown that such a process displays a dichotomous behavior according to an interplay between the Hurst parameter, i.e., a parameter characterizing the dependence in the data, and the tail index. Our theoretical results are accompanied by simulation studies and the analysis of financial time series with regard to structural changes in the tail index. △ Less

Submitted 4 June, 2020; originally announced June 2020.

Estimation of cluster functionals for regularly varying time series: sliding blocks estimators

Authors: Youssouph Cissokho, Rafal Kulik

Abstract: Cluster indices describe extremal behaviour of stationary time series. We consider their sliding blocks estimators. Using a modern theory of multivariate, regularly varying time series, we obtain central limit theorems under conditions that can be easily verified for a large class of models. In particular, we show that in the Peak over Threshold framework, sliding and disjoint blocks estimators ha… ▽ More Cluster indices describe extremal behaviour of stationary time series. We consider their sliding blocks estimators. Using a modern theory of multivariate, regularly varying time series, we obtain central limit theorems under conditions that can be easily verified for a large class of models. In particular, we show that in the Peak over Threshold framework, sliding and disjoint blocks estimators have the same limiting variance. △ Less

Submitted 22 May, 2020; originally announced May 2020.

Comments: 42 pages

MSC Class: 62G32; 62G05

Statistical inference for heavy tailed series with extremal independence

Authors: Clemonell Bilayi-Biakana, Rafal Kulik, Philippe Soulier

Abstract: We consider stationary time series $\{X_j, j \in Z\} whose finite dimensional distributions are regularly varying with extremal independence. We assume that for each $h \geq 1$, conditionally on $X_0$ to exceed a threshold tending to infinity, the conditional distribution of $X_h$ suitably normalized converges weakly to a non degenerate distribution. We consider in this paper the estimation of the… ▽ More We consider stationary time series $\{X_j, j \in Z\} whose finite dimensional distributions are regularly varying with extremal independence. We assume that for each $h \geq 1$, conditionally on $X_0$ to exceed a threshold tending to infinity, the conditional distribution of $X_h$ suitably normalized converges weakly to a non degenerate distribution. We consider in this paper the estimation of the normalization and of the limiting distribution. △ Less

Submitted 29 April, 2018; originally announced April 2018.

MSC Class: 62G32; 62M10

Testing for Change in Stochastic Volatility with Long Range Dependence

Authors: Annika Betken, Rafał Kulik

Abstract: In this paper, change-point problems for long memory stochastic volatility models are considered. A general testing problem which includes various alternative hypotheses is discussed. Under the hypothesis of stationarity the limiting behavior of CUSUM- and Wilcoxon-type test statistics is derived. In this context, a limit theorem for the two-parameter empirical process of long memory stochastic vo… ▽ More In this paper, change-point problems for long memory stochastic volatility models are considered. A general testing problem which includes various alternative hypotheses is discussed. Under the hypothesis of stationarity the limiting behavior of CUSUM- and Wilcoxon-type test statistics is derived. In this context, a limit theorem for the two-parameter empirical process of long memory stochastic volatility time series is proved. In particular, it is shown that the asymptotic distribution of CUSUM test statistics may not be affected by long memory, unlike Wilcoxon test statistics which are typically influenced by long range dependence. To avoid the estimation of nuisance parameters in applications, the usage of self-normalized test statistics is proposed. The theoretical results are accompanied by simulation studies which characterize the finite sample behavior of the considered testing procedures when testing for changes in mean, in variance, and in the tail index. △ Less

Submitted 20 June, 2017; originally announced June 2017.

Long range dependence of heavy tailed random functions

Authors: Rafal Kulik, Evgeny Spodarev

Abstract: We introduce a definition of long range dependence of random processes and fields on an (unbounded) index space $T\subseteq \R^d$ in terms of integrability of the covariance of indicators that a random function exceeds any given level. This definition is particularly designed to cover the case of random functions with infinite variance. We show the value of this new definition and its connection t… ▽ More We introduce a definition of long range dependence of random processes and fields on an (unbounded) index space $T\subseteq \R^d$ in terms of integrability of the covariance of indicators that a random function exceeds any given level. This definition is particularly designed to cover the case of random functions with infinite variance. We show the value of this new definition and its connection to limit theorems on some examples including subordinated Gaussian as well as random volatility fields and time series. △ Less

Submitted 13 August, 2020; v1 submitted 2 June, 2017; originally announced June 2017.

Comments: 34 pages. Revised version

MSC Class: 60G10 (Primary); 60G60; 60G15; 60F05 (Secondary)

The tail empirical process of regularly varying functions of geometrically ergodic Markov chains

Authors: Rafal Kulik, Philippe Soulier, Olivier Wintenberger, Rafa Kulik

Abstract: We consider a stationary regularly varying time series which can be expressedas a function of a geometrically ergodic Markov chain. We obtain practical conditionsfor the weak convergence of the tail array sums and feasible estimators ofcluster statistics. These conditions include the so-called geometric drift or Foster-Lyapunovcondition and can be easily checked for most usual time series models w… ▽ More We consider a stationary regularly varying time series which can be expressedas a function of a geometrically ergodic Markov chain. We obtain practical conditionsfor the weak convergence of the tail array sums and feasible estimators ofcluster statistics. These conditions include the so-called geometric drift or Foster-Lyapunovcondition and can be easily checked for most usual time series models witha Markovian structure. We illustrate these conditions on several models and statisticalapplications. A counterexample is given to show a different limiting behaviorwhen the geometric drift condition is not fulfilled. △ Less

Submitted 24 September, 2018; v1 submitted 16 November, 2015; originally announced November 2015.

The accessibility of convex bodies and derandomization of the hit and run algorithm

Authors: Benoit Collins, Termeh Kousha, Rafał Kulik, Tomasz Szarek, Karol Życzkowski

Abstract: We introduce the concept of accessibility and prove that any convex body $X$ in $\mathbb R^d$ is accessible with relevant constants depending on $d$ only. This property leads to a new algorithm which may be considered as a natural derandomization of the hit and run algorithm applied to generate a sequence of random points covering $X$ uniformly. We prove stability of the Markov chain generated by… ▽ More We introduce the concept of accessibility and prove that any convex body $X$ in $\mathbb R^d$ is accessible with relevant constants depending on $d$ only. This property leads to a new algorithm which may be considered as a natural derandomization of the hit and run algorithm applied to generate a sequence of random points covering $X$ uniformly. We prove stability of the Markov chain generated by the proposed algorithm and provide its rate of convergence. △ Less

Submitted 18 September, 2016; v1 submitted 26 December, 2013; originally announced December 2013.

Comments: revised version, new title and abstract; 13 pages, 2 figures

MSC Class: 65C40; 60J05; 81P40; 81P45

Journal ref: J. Convex Anal. 24 (2017), no. 3, 903-916

Multichannel Deconvolution with Long Range Dependence: Upper bounds on the $L^p$-risk $(1 \le p < \infty)$

Authors: Rafal Kulik, Theofanis Sapatinas, Justin Rory Wishart

Abstract: We consider multichannel deconvolution in a periodic setting with long-memory errors under three different scenarios for the convolution operators, i.e., super-smooth, regular-smooth and box-car convolutions. We investigate global performances of linear and hard-thresholded non-linear wavelet estimators for functions over a wide range of Besov spaces and for a variety of loss functions defining th… ▽ More We consider multichannel deconvolution in a periodic setting with long-memory errors under three different scenarios for the convolution operators, i.e., super-smooth, regular-smooth and box-car convolutions. We investigate global performances of linear and hard-thresholded non-linear wavelet estimators for functions over a wide range of Besov spaces and for a variety of loss functions defining the risk. In particular, we obtain upper bounds on convergence rates using the $L^p$-risk $(1 \le p < \infty)$. Contrary to the case where the errors follow independent Brownian motions, it is demonstrated that multichannel deconvolution with errors that follow independent fractional Brownian motions with different Hurst parameters results in a much more involved situation. An extensive finite-sample numerical study is performed to supplement the theoretical findings. △ Less

Submitted 5 May, 2014; v1 submitted 6 August, 2013; originally announced August 2013.

Heavy tailed time series with extremal independence

Authors: Rafal Kulik, Philippe Soulier

Abstract: We consider strictly stationary heavy tailed time series whose finite-dimensional exponent measures are concentrated on axes, and hence their extremal properties cannot be tackled using classical multivariate regular variation that is suitable for time series with extremal dependence. We recover relevant information about limiting behavior of time series with extremal independence by introducing a… ▽ More We consider strictly stationary heavy tailed time series whose finite-dimensional exponent measures are concentrated on axes, and hence their extremal properties cannot be tackled using classical multivariate regular variation that is suitable for time series with extremal dependence. We recover relevant information about limiting behavior of time series with extremal independence by introducing a sequence of scaling functions and conditional scaling exponent. Both quantities provide more information about joint extremes than a widely used tail dependence coefficient. We calculate the scaling functions and the scaling exponent for variety of models, including Markov chains, exponential autoregressive model, stochastic volatility with heavy tailed innovations or volatility. △ Less

Submitted 9 October, 2014; v1 submitted 4 July, 2013; originally announced July 2013.

Comments: Revised version

Multichannel Deconvolution with Long-Range Dependence: A Minimax Study

Authors: Rida Benhaddou, Rafal Kulik, Marianna Pensky, Theofanis Sapatinas

Abstract: We consider the problem of estimating the unknown response function in the multichannel deconvolution model with long-range dependent Gaussian errors. We do not limit our consideration to a specific type of long-range dependence rather we assume that the errors should satisfy a general assumption in terms of the smallest and larger eigenvalues of their covariance matrices. We derive minimax lower… ▽ More We consider the problem of estimating the unknown response function in the multichannel deconvolution model with long-range dependent Gaussian errors. We do not limit our consideration to a specific type of long-range dependence rather we assume that the errors should satisfy a general assumption in terms of the smallest and larger eigenvalues of their covariance matrices. We derive minimax lower bounds for the quadratic risk in the proposed multichannel deconvolution model when the response function is assumed to belong to a Besov ball and the blurring function is assumed to possess some smoothness properties, including both regular-smooth and super-smooth convolutions. Furthermore, we propose an adaptive wavelet estimator of the response function that is asymptotically optimal (in the minimax sense), or near-optimal within a logarithmic factor, in a wide range of Besov balls. It is shown that the optimal convergence rates depend on the balance between the smoothness parameter of the response function, the kernel parameters of the blurring function, the long memory parameters of the errors, and how the total number of observations is distributed among the total number of channels. Some examples of inverse problems in mathematical physics where one needs to recover initial or boundary conditions on the basis of observations from a noisy solution of a partial differential equation are used to illustrate the application of the theory we developed. The optimal convergence rates and the adaptive estimators we consider extend the ones studied by Pensky and Sapatinas (2009, 2010) for independent and identically distributed Gaussian errors to the case of long-range dependent Gaussian errors. △ Less

Submitted 1 May, 2013; originally announced May 2013.

Journal ref: Journal of Statistical Planning and Inference, Vol. 148, 1-19 (2014). (Invited Paper)

Strong approximations for long memory sequences based partial sums, counting and their Vervaat processes

Authors: Endre Csáki, Miklós Csörgö, Rafal Kulik

Abstract: We study the asymptotic behaviour of partial sums of long range dependent random variables and that of their counting process, together with an appropriately normalized integral process of the sum of these two processes, the so-called Vervaat process. The first two of these processes are approximated by an appropriately constructed fractional Brownian motion, while the Vervaat process in turn is a… ▽ More We study the asymptotic behaviour of partial sums of long range dependent random variables and that of their counting process, together with an appropriately normalized integral process of the sum of these two processes, the so-called Vervaat process. The first two of these processes are approximated by an appropriately constructed fractional Brownian motion, while the Vervaat process in turn is approximated by the square of the same fractional Brownian motion. △ Less

Submitted 15 February, 2013; originally announced February 2013.

Comments: 20 pages

MSC Class: 60F15 60F17 60G22

Heavy tailed branching process with immigration

Authors: Bojan Basrak, Rafał Kulik, Zbigniew Palmowski

Abstract: In this paper we analyze a branching process with immigration defined recursively by $X_t=θ_t\circ X_{t-1}+B_t$ for a sequence $(B_t)$ of i.i.d. random variables and random mappings $ θ_t\circ x:=θ_t(x)=\sum_{i=1}^xA_i^{(t)}, $ with $(A_i^{(t)})_{i\in \mathbb{N}_0}$ being a sequence of $\mathbb{N}_0$-valued i.i.d. random variables independent of $B_t$. We assume that one of generic variables $A$ a… ▽ More In this paper we analyze a branching process with immigration defined recursively by $X_t=θ_t\circ X_{t-1}+B_t$ for a sequence $(B_t)$ of i.i.d. random variables and random mappings $ θ_t\circ x:=θ_t(x)=\sum_{i=1}^xA_i^{(t)}, $ with $(A_i^{(t)})_{i\in \mathbb{N}_0}$ being a sequence of $\mathbb{N}_0$-valued i.i.d. random variables independent of $B_t$. We assume that one of generic variables $A$ and $B$ has a regularly varying tail distribution. We identify the tail behaviour of the distribution of the stationary solution $X_t$. We also prove CLT for the partial sums that could be further generalized to FCLT. Finally, we also show that partial maxima have a Fréchet limiting distribution. △ Less

Submitted 30 July, 2012; originally announced July 2012.

Limit theorems for long memory stochastic volatility models with infinite variance: Partial Sums and Sample Covariances

Authors: Rafal Kulik, Philippe Soulier

Abstract: Long Memory Stochastic volatility (LMSV) models capture two standardized features of financial data: the log-returns are uncorrelated, but their squares, or absolute values are (highly) dependent and they may have heavy tails. EGARCH and related models were introduced to model leverage, i.e. negative dependence between previous returns and future volatility. Limit theorems for partial sums, sample… ▽ More Long Memory Stochastic volatility (LMSV) models capture two standardized features of financial data: the log-returns are uncorrelated, but their squares, or absolute values are (highly) dependent and they may have heavy tails. EGARCH and related models were introduced to model leverage, i.e. negative dependence between previous returns and future volatility. Limit theorems for partial sums, sample variance and sample covariances are basic tools to investigate the presence of long memory and heavy tails and their consequences. In this paper we extend the existing literature on the asymptotic behaviour of the partial sums and the sample covariances of long memory stochastic volatility models in the case of infinite variance. We also consider models with leverage, for which our results are entirely new in the infinite variance case. Depending on the nterplay between the tail behaviour and the intensity of dependence, wo types of convergence rates and limiting distributions can arise. In articular, we show that the asymptotic behaviour of partial sums is the same for both LMSV and models with leverage, whereas there is a crucial difference when sample covariances are considered. △ Less

Submitted 22 March, 2012; v1 submitted 24 September, 2011; originally announced September 2011.

Journal ref: Advances in Applied Probability, 44(4), 1113-1141, 2012

Estimation of limiting conditional distributions for the heavy tailed long memory stochastic volatility process

Authors: Rafał Kulik, Philippe Soulier

Abstract: We consider Stochastic Volatility processes with heavy tails and possible long memory in volatility. We study the limiting conditional distribution of future events given that some present or past event was extreme (i.e. above a level which tends to infinity). Even though extremes of stochastic volatility processes are asymptotically independent (in the sense of extreme value theory), these limiti… ▽ More We consider Stochastic Volatility processes with heavy tails and possible long memory in volatility. We study the limiting conditional distribution of future events given that some present or past event was extreme (i.e. above a level which tends to infinity). Even though extremes of stochastic volatility processes are asymptotically independent (in the sense of extreme value theory), these limiting conditional distributions differ from the i.i.d. case. We introduce estimators of these limiting conditional distributions and study their asymptotic properties. If volatility has long memory, then the rate of convergence and the limiting distribution of the centered estimators can depend on the long memory parameter (Hurst index). △ Less

Submitted 15 August, 2011; originally announced August 2011.

Comments: 28 pages, 1 figure

Some results on random design regression with long memory errors and predictors

Authors: Rafal Kulik, Pawel Lorek

Abstract: This paper studies nonparametric regression with long memory (LRD) errors and predictors. First, we formulate general conditions which guarantee the standard rate of convergence for a nonparametric kernel estimator. Second, we calculate the Mean Integrated Squared Error (MISE). In particular, we show that LRD of errors may influence MISE. On the other hand, an estimator for a shape function is typ… ▽ More This paper studies nonparametric regression with long memory (LRD) errors and predictors. First, we formulate general conditions which guarantee the standard rate of convergence for a nonparametric kernel estimator. Second, we calculate the Mean Integrated Squared Error (MISE). In particular, we show that LRD of errors may influence MISE. On the other hand, an estimator for a shape function is typically not influenced by LRD in errors. Finally, we investigate properties of a data-driven bandwidth choice. We show that Averaged Squared Error (ASE) is a good approximation of MISE, however, this is not the case for a cross-validation criterion. △ Less

Submitted 21 February, 2011; originally announced February 2011.

Journal ref: Journal of Statistical Planning and Inference, 141, 508--523, 2011

Empirical process of residuals for regression models with long memory errors

Authors: Pawel Lorek, Rafal Kulik

Abstract: We consider the residual empirical process in random design regression with long memory errors. We establish its limiting behaviour, showing that its rates of convergence are different from the rates of convergence for to the empirical process based on (unobserved) errors. Also, we study a residual empirical process with estimated parameters. Its asymptotic distribution can be used to construct Ko… ▽ More We consider the residual empirical process in random design regression with long memory errors. We establish its limiting behaviour, showing that its rates of convergence are different from the rates of convergence for to the empirical process based on (unobserved) errors. Also, we study a residual empirical process with estimated parameters. Its asymptotic distribution can be used to construct Kolmogorov-Smirnov, Cramér-Smirnov-von Mises, or other goodness-of-fit tests. Theoretical results are justified by simulation studies. △ Less

Submitted 21 February, 2011; originally announced February 2011.

Tail behaviour of the area under a random process, with applications to queueing systems, insurance and percolations

Authors: Rafal Kulik, Zbigniew Palmowski

Abstract: The areas under workload process and under queuing process in a single server queue over the busy period have many applications not only in queuing theory but also in risk theory or percolation theory. We focus here on the tail behaviour of distribution of these two integrals. We present various open problems and conjectures, which are supported by partial results for some special cases. The areas under workload process and under queuing process in a single server queue over the busy period have many applications not only in queuing theory but also in risk theory or percolation theory. We focus here on the tail behaviour of distribution of these two integrals. We present various open problems and conjectures, which are supported by partial results for some special cases. △ Less

Submitted 5 February, 2011; originally announced February 2011.

Kink estimation in stochastic regression with dependent errors and predictors

Authors: Justin Wishart, Rafal Kulik

Abstract: In this article we study the estimation of the location of jump points in the first derivative (referred to as kinks) of a regression function μin two random design models with different long-range dependent (LRD) structures. The method is based on the zero-crossing technique and makes use of high-order kernels. The rate of convergence of the estimator is contingent on the level of dependence an… ▽ More In this article we study the estimation of the location of jump points in the first derivative (referred to as kinks) of a regression function μin two random design models with different long-range dependent (LRD) structures. The method is based on the zero-crossing technique and makes use of high-order kernels. The rate of convergence of the estimator is contingent on the level of dependence and the smoothness of the regression function μ. In one of the models, the convergence rate is the same as the minimax rate for kink estimation in the fixed design scenario with i.i.d. errors which suggests that the method is optimal in the minimax sense. △ Less

Submitted 7 March, 2010; originally announced March 2010.

Comments: 35 pages

MSC Class: 62G08; 62G05; 62G20

The tail empirical process for some long memory sequences

Authors: Rafal Kulik, Philippe Soulier

Abstract: This paper describes limiting behaviour of tail empirical process associated with long memory stochastic volatility models. We show that such process has dichotomous behaviour, according to an interplay between a Hurst parameter and a tail index. In particular, the limit may be non-Gaussian and/or degenerate, indicating an influence of long memory. On the other hand, tail empirical process with ra… ▽ More This paper describes limiting behaviour of tail empirical process associated with long memory stochastic volatility models. We show that such process has dichotomous behaviour, according to an interplay between a Hurst parameter and a tail index. In particular, the limit may be non-Gaussian and/or degenerate, indicating an influence of long memory. On the other hand, tail empirical process with random levels never suffers from long memory. This is very desirable from a practical point of view, since such the process may be used to construct Hill estimator of the tail index. To prove our results we need to establish several new results for regularly varying distribution functions, which may be of independent interest. △ Less

Submitted 15 September, 2010; v1 submitted 17 January, 2010; originally announced January 2010.

Journal ref: Stochastic Processes and their Applications 121, 1 (2011) 109-134

Wavelet regression in random design with heteroscedastic dependent errors

Authors: Rafał Kulik, Marc Raimondo

Abstract: We investigate function estimation in nonparametric regression models with random design and heteroscedastic correlated noise. Adaptive properties of warped wavelet nonlinear approximations are studied over a wide range of Besov scales, $f\in\mathcal{B}^s_{π,r}$, and for a variety of $L^p$ error measures. We consider error distributions with Long-Range-Dependence parameter $α,0<α\leq1$; heterosc… ▽ More We investigate function estimation in nonparametric regression models with random design and heteroscedastic correlated noise. Adaptive properties of warped wavelet nonlinear approximations are studied over a wide range of Besov scales, $f\in\mathcal{B}^s_{π,r}$, and for a variety of $L^p$ error measures. We consider error distributions with Long-Range-Dependence parameter $α,0<α\leq1$; heteroscedasticity is modeled with a design dependent function $σ$. We prescribe a tuning paradigm, under which warped wavelet estimation achieves partial or full adaptivity results with the rates that are shown to be the minimax rates of convergence. For $p>2$, it is seen that there are three rate phases, namely the dense, sparse and long range dependence phase, depending on the relative values of $s,p,π$ and $α$. Furthermore, we show that long range dependence does not come into play for shape estimation $f-\int f$. The theory is illustrated with some numerical examples. △ Less

Submitted 2 September, 2009; originally announced September 2009.

Comments: Published in at http://dx.doi.org/10.1214/09-AOS684 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-AOS-AOS684 MSC Class: 62G05 (Primary); 62G08; 62G20 (Secondary)

Journal ref: Annals of Statistics 2009, Vol. 37, No. 6A, 3396-3430

Reduction principles for quantile and Bahadur-Kiefer processes of long-range dependent linear sequences

Authors: Miklós Csörgő, Rafal Kulik

Abstract: In this paper we consider quantile and Bahadur-Kiefer processes for long range dependent linear sequences. These processes, unlike in previous studies, are considered on the whole interval $(0,1)$. As it is well-known, quantile processes can have very erratic behavior on the tails. We overcome this problem by considering these processes with appropriate weight functions. In this way we conclude… ▽ More In this paper we consider quantile and Bahadur-Kiefer processes for long range dependent linear sequences. These processes, unlike in previous studies, are considered on the whole interval $(0,1)$. As it is well-known, quantile processes can have very erratic behavior on the tails. We overcome this problem by considering these processes with appropriate weight functions. In this way we conclude strong approximations that yield some remarkable phenomena that are not shared with i.i.d. sequences, including weak convergence of the Bahadur-Kiefer processes, a different pointwise behavior of the general and uniform Bahadur-Kiefer processes, and a somewhat "strange" behavior of the general quantile process. △ Less

Submitted 7 February, 2008; originally announced February 2008.

Comments: Preprint. The final version will appear in Probability Theory and Related Fields

Nonparametric deconvolution problem for dependent sequences

Authors: Rafał Kulik

Abstract: We consider the nonparametric estimation of the density function of weakly and strongly dependent processes with noisy observations. We show that in the ordinary smooth case the optimal bandwidth choice can be influenced by long range dependence, as opposite to the standard case, when no noise is present. In particular, if the dependence is moderate the bandwidth, the rates of mean-square conver… ▽ More We consider the nonparametric estimation of the density function of weakly and strongly dependent processes with noisy observations. We show that in the ordinary smooth case the optimal bandwidth choice can be influenced by long range dependence, as opposite to the standard case, when no noise is present. In particular, if the dependence is moderate the bandwidth, the rates of mean-square convergence and, additionally, central limit theorem are the same as in the i.i.d. case. If the dependence is strong enough, then the bandwidth choice is influenced by the strength of dependence, which is different when compared to the non-noisy case. Also, central limit theorem are influenced by the strength of dependence. On the other hand, if the density is supersmooth, then long range dependence has no effect at all on the optimal bandwidth choice. △ Less

Submitted 13 August, 2008; v1 submitted 26 November, 2007; originally announced November 2007.

Comments: Published in at http://dx.doi.org/10.1214/07-EJS154 the Electronic Journal of Statistics (http://www.i-journals.org/ejs/) by the Institute of Mathematical Statistics (http://www.imstat.org)

Report number: IMS-EJS-EJS_2007_154 MSC Class: 62G05 (Primary) 62G07; 60F05 (Secondary)

Journal ref: Electronic Journal of Statistics 2008, Vol. 2, 722-740

Weak convergence of Vervaat and Vervaat Error processes of long-range dependent sequences

Authors: Miklós Csörgő, Rafał Kulik

Abstract: Following Csörgő, Szyszkowicz and Wang (Ann. Statist. {\bf 34}, (2006), 1013--1044) we consider a long range dependent linear sequence. We prove weak convergence of the uniform Vervaat and the uniform Vervaat error processes, extending their results to distributions with unbounded support and removing normality assumption. Following Csörgő, Szyszkowicz and Wang (Ann. Statist. {\bf 34}, (2006), 1013--1044) we consider a long range dependent linear sequence. We prove weak convergence of the uniform Vervaat and the uniform Vervaat error processes, extending their results to distributions with unbounded support and removing normality assumption. △ Less

Submitted 26 September, 2007; originally announced September 2007.

Empirical process of long-range dependent sequences when parameters are estimated

Authors: Rafal Kulik

Abstract: In this paper we study the asymptotic behaviour of empirical processes when parameters are estimated, assuming that the underlying sequence of random variables is long-range dependent. We show completely different phenomena compared to i.i.d. situation, as well as compared to ordinary empirical processes of long range dependent sequences. Applications include Kolmogorov-Smirnov and Cramer-Smirno… ▽ More In this paper we study the asymptotic behaviour of empirical processes when parameters are estimated, assuming that the underlying sequence of random variables is long-range dependent. We show completely different phenomena compared to i.i.d. situation, as well as compared to ordinary empirical processes of long range dependent sequences. Applications include Kolmogorov-Smirnov and Cramer-Smirnov-von Mises goodness-of-fit statistics. △ Less

Submitted 4 February, 2007; originally announced February 2007.

Comments: 12 pages

MSC Class: 62E20; 62F05

Sums of extreme values of subordinated long-range dependent sequences: moving averages with finite variance

Authors: Rafal Kulik

Abstract: In this paper we characterize the limiting behavior of sums of extreme values of long range dependent sequences defined as functionals of linear processes with finite variance. The extremal sums behave completely different by compared to the i.i.d case. In particular, though we still have asymptotic normality, the scaling factor is relatively bigger than in the i.i.d case, meaning that the maxim… ▽ More In this paper we characterize the limiting behavior of sums of extreme values of long range dependent sequences defined as functionals of linear processes with finite variance. The extremal sums behave completely different by compared to the i.i.d case. In particular, though we still have asymptotic normality, the scaling factor is relatively bigger than in the i.i.d case, meaning that the maximal terms have relatively smaller contribution to the whole sum. Also, the scaling need not depend on the tail index of the underlying marginal distribution, as it is well-known to be so in the i.i.d. situation. Furthermore, subordination may completely change the asymptotic properties of sums of extremes. △ Less

Submitted 21 September, 2006; originally announced September 2006.

Poisson limits for empirical point processes

Authors: André Dabrowski, Gail Ivanoof, Rafal Kulik

Abstract: Define the scaled empirical point process on an independent and identically distributed sequence $\{Y_i: i\le n\}$ as the random point measure with masses at $a_n^{-1} Y_i$. For suitable $a_n$ we obtain the weak limit of these point processes through a novel use of a dimension-free method based on the convergence of compensators of multiparameter martingales. The method extends previous results… ▽ More Define the scaled empirical point process on an independent and identically distributed sequence $\{Y_i: i\le n\}$ as the random point measure with masses at $a_n^{-1} Y_i$. For suitable $a_n$ we obtain the weak limit of these point processes through a novel use of a dimension-free method based on the convergence of compensators of multiparameter martingales. The method extends previous results in several directions. We obtain limits at points where the density of $Y_i$ may be zero, but has regular variation. The joint limit of the empirical process evaluated at distinct points is given by independent Poisson processes. These results also hold for multivariate $Y_i$ with little additional effort. Applications are provided both to nearest-neighbour density estimation in high dimensions, and to the asymptotic behaviour of multivariate extremes such as those arising from bivariate normal copulas. △ Less

Submitted 15 May, 2006; originally announced May 2006.

Comments: 15 pages

MSC Class: 60F05

Optimal rates in the Bahadur-Kiefer representation for GARCH sequences

Authors: Rafal Kulik

Abstract: In this paper we establish the Bahadur-Kiefer representation for sample quantiles of GARCH sequences with optimal rates. In this paper we establish the Bahadur-Kiefer representation for sample quantiles of GARCH sequences with optimal rates. △ Less

Submitted 10 May, 2006; originally announced May 2006.

Comments: 12 pages

MSC Class: 62G30

Bahadur--Kiefer theory for sample quantiles of weakly dependent linear processes

Authors: Rafał Kulik

Abstract: In this paper, we establish the Bahadur--Kiefer representation for sample quantiles for a class of weakly dependent linear processes. The rate of approximation is the same as for i.i.d. sequences and is thus optimal. In this paper, we establish the Bahadur--Kiefer representation for sample quantiles for a class of weakly dependent linear processes. The rate of approximation is the same as for i.i.d. sequences and is thus optimal. △ Less

Submitted 28 November, 2007; v1 submitted 10 May, 2006; originally announced May 2006.

Comments: Published in at http://dx.doi.org/10.3150/07-BEJ6086 the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)

Report number: IMS-BEJ-BEJ6086

Journal ref: Bernoulli 2007, Vol. 13, No. 4, 1071-1090