-
Balancing the edge effect and dimension of spectral spatial statistics under irregular sampling with applications to isotropy testing
Authors:
Theresa Eckle,
Anne van Delft,
Holger Dette
Abstract:
We investigate distributional properties of a class of spectral spatial statistics under irregular sampling of a random field that is defined on $\mathbb{R}^d$, and use this to obtain a test for isotropy. Within this context, edge effects are well-known to create a bias in classical estimators commonly encountered in the analysis of spatial data. This bias increases with dimension $d$ and, for…
▽ More
We investigate distributional properties of a class of spectral spatial statistics under irregular sampling of a random field that is defined on $\mathbb{R}^d$, and use this to obtain a test for isotropy. Within this context, edge effects are well-known to create a bias in classical estimators commonly encountered in the analysis of spatial data. This bias increases with dimension $d$ and, for $d>1$, can become non-negligible in the limiting distribution of such statistics to the extent that a nondegenerate distribution does not exist. We provide a general theory for a class of (integrated) spectral statistics that enables to 1) significantly reduce this bias and 2) that ensures that asymptotically Gaussian limits can be derived for $d \le 3$ for appropriately tapered versions of such statistics. We use this to address some crucial gaps in the literature, and demonstrate that tapering with a sufficiently smooth function is necessary to achieve such results. Our findings specifically shed a new light on a recent result in Subba Rao (2018a). Our theory then is used to propose a novel test for isotropy. In contrast to most of the literature, which validates this assumption on a finite number of spatial locations (or a finite number of Fourier frequencies), we develop a test for isotropy on the full spatial domain by means of its characterization in the frequency domain. More precisely, we derive an explicit expression for the minimum $L^2$-distance between the spectral density of the random field and its best approximation by a spectral density of an isotropic process. We prove asymptotic normality of an estimator of this quantity in the mixed increasing domain framework and use this result to derive an asymptotic level $α$-test.
△ Less
Submitted 15 January, 2024;
originally announced January 2024.
-
A general framework to quantify deviations from structural assumptions in the analysis of nonstationary function-valued processes
Authors:
Anne van Delft,
Holger Dette
Abstract:
We present a general theory to quantify the uncertainty from imposing structural assumptions on the second-order structure of nonstationary Hilbert space-valued processes, which can be measured via functionals of time-dependent spectral density operators. The second-order dynamics are well-known to be elements of the space of trace-class operators, the latter is a Banach space of type 1 and of cot…
▽ More
We present a general theory to quantify the uncertainty from imposing structural assumptions on the second-order structure of nonstationary Hilbert space-valued processes, which can be measured via functionals of time-dependent spectral density operators. The second-order dynamics are well-known to be elements of the space of trace-class operators, the latter is a Banach space of type 1 and of cotype 2, which makes the development of statistical inference tools more challenging. A part of our contribution is to obtain a weak invariance principle as well as concentration inequalities for (functionals of) the sequential time-varying spectral density operator. In addition, we introduce deviation measures in the nonstationary context, and derive estimators that are asymptotically pivotal. We then apply this framework and propose statistical methodology to investigate the validity of structural assumptions for nonstationary response surface data, such as low-rank assumptions in the context of time-varying dynamic fPCA and principle separable component analysis, deviations from stationarity with respect to the square root distance, and deviations from zero functional canonical coherency.
△ Less
Submitted 16 September, 2023; v1 submitted 22 August, 2022;
originally announced August 2022.
-
Pivotal tests for relevant differences in the second order dynamics of functional time series
Authors:
Anne van Delft,
Holger Dette
Abstract:
Motivated by the need to statistically quantify differences between modern (complex) data-sets which commonly result as high-resolution measurements of stochastic processes varying over a continuum, we propose novel testing procedures to detect relevant differences between the second order dynamics of two functional time series. In order to take the between-function dynamics into account that char…
▽ More
Motivated by the need to statistically quantify differences between modern (complex) data-sets which commonly result as high-resolution measurements of stochastic processes varying over a continuum, we propose novel testing procedures to detect relevant differences between the second order dynamics of two functional time series. In order to take the between-function dynamics into account that characterize this type of functional data, a frequency domain approach is taken. Test statistics are developed to compare differences in the spectral density operators and in the primary modes of variation as encoded in the associated eigenelements. Under mild moment conditions, we show convergence of the underlying statistics to Brownian motions and construct pivotal test statistics. The latter is essential because the nuisance parameters can be unwieldy and their robust estimation infeasible, especially if the two functional time series are dependent. In addition to these novel features, the properties of the tests are robust to any choice of frequency band enabling also to compare energy contents at a single frequency. The finite sample performance of the tests are verified through a simulation study and are illustrated with an application to fMRI data.
△ Less
Submitted 13 June, 2022; v1 submitted 9 April, 2020;
originally announced April 2020.
-
A similarity measure for second order properties of non-stationary functional time series with applications to clustering and testing
Authors:
Anne van Delft,
Holger Dette
Abstract:
Due to the surge of data storage techniques, the need for the development of appropriate techniques to identify patterns and to extract knowledge from the resulting enormous data sets, which can be viewed as collections of dependent functional data, is of increasing interest in many scientific areas. We develop a similarity measure for spectral density operators of a collection of functional time…
▽ More
Due to the surge of data storage techniques, the need for the development of appropriate techniques to identify patterns and to extract knowledge from the resulting enormous data sets, which can be viewed as collections of dependent functional data, is of increasing interest in many scientific areas. We develop a similarity measure for spectral density operators of a collection of functional time series, which is based on the aggregation of Hilbert-Schmidt differences of the individual time-varying spectral density operators. Under fairly general conditions, the asymptotic properties of the corresponding estimator are derived and asymptotic normality is established. The introduced statistic lends itself naturally to quantify (dis)-similarity between functional time series, which we subsequently exploit in order to build a spectral clustering algorithm. Our algorithm is the first of its kind in the analysis of non-stationary (functional) time series and enables to discover particular patterns by grouping together `similar' series into clusters, thereby reducing the complexity of the analysis considerably. The algorithm is simple to implement and computationally feasible. As a further application we provide a simple test for the hypothesis that the second order properties of two non-stationary functional time series coincide.
△ Less
Submitted 1 December, 2018; v1 submitted 18 October, 2018;
originally announced October 2018.
-
A nonparametric test for stationarity in functional time series
Authors:
Anne van Delft,
Vaidotas Characiejus,
Holger Dette
Abstract:
We propose a new measure for stationarity of a functional time series, which is based on an explicit representation of the $L^2$-distance between the spectral density operator of a non-stationary process and its best ($L^2$-)approximation by a spectral density operator corresponding to a stationary process. This distance can easily be estimated by sums of Hilbert-Schmidt inner products of periodog…
▽ More
We propose a new measure for stationarity of a functional time series, which is based on an explicit representation of the $L^2$-distance between the spectral density operator of a non-stationary process and its best ($L^2$-)approximation by a spectral density operator corresponding to a stationary process. This distance can easily be estimated by sums of Hilbert-Schmidt inner products of periodogram operators (evaluated at different frequencies), and asymptotic normality of an appropriately standardized version of the estimator can be established for the corresponding estimate under the null hypothesis and alternative. As a result we obtain a simple asymptotic frequency domain level $α$ test (using the quantiles of the normal distribution) for the hypothesis of stationarity of functional time series. Other applications such as asymptotic confidence intervals for a measure of stationarity or the construction of tests for "relevant deviations from stationarity", are also briefly mentioned. We demonstrate in a small simulation study that the new method has very good finite sample properties. Moreover, we apply our test to annual temperature curves.
△ Less
Submitted 13 August, 2018; v1 submitted 17 August, 2017;
originally announced August 2017.
-
Testing for stationarity of functional time series in the frequency domain
Authors:
Alexander Aue,
Anne van Delft
Abstract:
Interest in functional time series has spiked in the recent past with papers covering both methodology and applications being published at a much increased pace. This article contributes to the research in this area by proposing a new stationarity test for functional time series based on frequency domain methods. The proposed test statistics is based on joint dimension reduction via functional pri…
▽ More
Interest in functional time series has spiked in the recent past with papers covering both methodology and applications being published at a much increased pace. This article contributes to the research in this area by proposing a new stationarity test for functional time series based on frequency domain methods. The proposed test statistics is based on joint dimension reduction via functional principal components analysis across the spectral density operators at all Fourier frequencies, explicitly allowing for frequency-dependent levels of truncation to adapt to the dynamics of the underlying functional time series. The properties of the test are derived both under the null hypothesis of stationary functional time series and under the smooth alternative of locally stationary functional time series. The methodology is theoretically justified through asymptotic results. Evidence from simulation studies and an application to annual temperature curves suggests that the test works well in finite samples.
△ Less
Submitted 29 April, 2019; v1 submitted 6 January, 2017;
originally announced January 2017.
-
Locally Stationary Functional Time Series
Authors:
Anne van Delft,
Michael Eichler
Abstract:
The literature on time series of functional data has focused on processes of which the probabilistic law is either constant over time or constant up to its second-order structure. Especially for long stretches of data it is desirable to be able to weaken this assumption. This paper introduces a framework that will enable meaningful statistical inference of functional data of which the dynamics cha…
▽ More
The literature on time series of functional data has focused on processes of which the probabilistic law is either constant over time or constant up to its second-order structure. Especially for long stretches of data it is desirable to be able to weaken this assumption. This paper introduces a framework that will enable meaningful statistical inference of functional data of which the dynamics change over time. We put forward the concept of local stationarity in the functional setting and establish a class of processes that have a functional time-varying spectral representation. Subsequently, we derive conditions that allow for fundamental results from nonstationary multivariate time series to carry over to the function space. In particular, time-varying functional ARMA processes are investigated and shown to be functional locally stationary according to the proposed definition. As a side-result, we establish a Cramér representation for an important class of weakly stationary functional processes. Important in our context is the notion of a time-varying spectral density operator of which the properties are studied and uniqueness is derived. Finally, we provide a consistent nonparametric estimator of this operator and show it is asymptotically Gaussian using a weaker tightness criterion than what is usually deemed necessary.
△ Less
Submitted 10 December, 2017; v1 submitted 16 February, 2016;
originally announced February 2016.
-
Data-adaptive estimation of time-varying spectral densities
Authors:
Anne van Delft,
Michael Eichler
Abstract:
This paper introduces a data-adaptive non-parametric approach for the estimation of time-varying spectral densities from nonstationary time series. Time-varying spectral densities are commonly estimated by local kernel smoothing. The performance of these nonparametric estimators, however, depends crucially on the smoothing bandwidths that need to be specified in both time and frequency direction.…
▽ More
This paper introduces a data-adaptive non-parametric approach for the estimation of time-varying spectral densities from nonstationary time series. Time-varying spectral densities are commonly estimated by local kernel smoothing. The performance of these nonparametric estimators, however, depends crucially on the smoothing bandwidths that need to be specified in both time and frequency direction. As an alternative and extension to traditional bandwidth selection methods, we propose an iterative algorithm for constructing localized smoothing kernels data-adaptively. The main idea, inspired by the concept of propagation-separation (Polzehl and Spokoiny 2006), is to determine for a point in the time-frequency plane the largest local vicinity over which smoothing is justified by the data. By shaping the smoothing kernels nonparametrically, our method not only avoids the problem of bandwidth selection in the strict sense but also becomes more flexible. It not only adapts to changing curvature in smoothly varying spectra but also adjusts for structural breaks in the time-varying spectrum.
△ Less
Submitted 12 June, 2018; v1 submitted 2 December, 2015;
originally announced December 2015.
