-
Testing the Missing Completely at Random Assumption for Functional Data
Authors:
Maximilian Ofner,
Siegfried Hörmann,
David Kraus,
Dominik Liebl
Abstract:
We consider functional data which have only been observed on a subset of their domain. This paper aims to develop statistical tests to determine whether the function and the domain over which it is observed are independent. The assumption that data is missing completely at random (MCAR) is essential for many functional data methods handling incomplete observations. However, no general testing proc…
▽ More
We consider functional data which have only been observed on a subset of their domain. This paper aims to develop statistical tests to determine whether the function and the domain over which it is observed are independent. The assumption that data is missing completely at random (MCAR) is essential for many functional data methods handling incomplete observations. However, no general testing procedures have been established to validate this assumption. We address this critical gap by introducing such tests, along with their asymptotic theory and real data applications.
△ Less
Submitted 13 May, 2025;
originally announced May 2025.
-
Prediction in functional regression with discretely observed and noisy covariates
Authors:
Siegfried Hörmann,
Fatima Jammoul
Abstract:
In practice functional data are sampled on a discrete set of observation points and often susceptible to noise. We consider in this paper the setting where such data are used as explanatory variables in a regression problem. If the primary goal is prediction, we show that the gain by embedding the problem into a scalar-on-function regression is limited. Instead we impose a factor model on the pred…
▽ More
In practice functional data are sampled on a discrete set of observation points and often susceptible to noise. We consider in this paper the setting where such data are used as explanatory variables in a regression problem. If the primary goal is prediction, we show that the gain by embedding the problem into a scalar-on-function regression is limited. Instead we impose a factor model on the predictors and suggest regressing the response on an appropriate number of factor scores. This approach is shown to be consistent under mild technical assumptions, numerically efficient and gives good practical performance in both simulations as well as real data settings.
△ Less
Submitted 13 December, 2021;
originally announced December 2021.
-
Testing normality of spatially indexed functional data
Authors:
Thomas Kuenzer,
Siegfried Hörmann,
Piotr Kokoszka
Abstract:
We develop a test of normality for spatially indexed functions. The assumption of normality is common in spatial statistics, yet no significance tests, or other means of assessment, have been available for functional data. This paper aims at filling this gap in the case of functional observations on a spatial grid. Our test compares the moments of the spatial (frequency domain) principal component…
▽ More
We develop a test of normality for spatially indexed functions. The assumption of normality is common in spatial statistics, yet no significance tests, or other means of assessment, have been available for functional data. This paper aims at filling this gap in the case of functional observations on a spatial grid. Our test compares the moments of the spatial (frequency domain) principal component scores to those of a suitable Gaussian distribution. Critical values can be readily obtained from a chi-squared distribution. We provide rigorous theoretical justification for a broad class of weakly stationary functional random fields. We perform simulation studies to assess the the power of the test against various alternatives. An application to Surface Incoming Shortwave Radiation illustrates the practical value of this procedure.
△ Less
Submitted 30 June, 2021;
originally announced June 2021.
-
Preprocessing noisy functional data: a multivariate perspective
Authors:
Siegfried Hörmann,
Fatima Jammoul
Abstract:
We consider functional data which are measured on a discrete set of observation points. Often such data are measured with additional noise. We explore in this paper the factor structure underlying this type of data. We show that the latent signal can be attributed to the common components of a corresponding factor model and can be estimated accordingly, by borrowing methods from factor model liter…
▽ More
We consider functional data which are measured on a discrete set of observation points. Often such data are measured with additional noise. We explore in this paper the factor structure underlying this type of data. We show that the latent signal can be attributed to the common components of a corresponding factor model and can be estimated accordingly, by borrowing methods from factor model literature. We also show that principal components, which play a key role in functional data analysis, can be accurately estimated after taking such a multivariate instead of a `functional' perspective. In addition to the estimation problem, we also address testing of the null-hypothesis of iid noise. While this assumption is largely prevailing in the literature, we believe that it is often unrealistic and not supported by a residual analysis.
△ Less
Submitted 22 November, 2021; v1 submitted 10 December, 2020;
originally announced December 2020.
-
DeepLocalization: Landmark-based Self-Localization with Deep Neural Networks
Authors:
Nico Engel,
Stefan Hoermann,
Markus Horn,
Vasileios Belagiannis,
Klaus Dietmayer
Abstract:
We address the problem of vehicle self-localization from multi-modal sensor information and a reference map. The map is generated off-line by extracting landmarks from the vehicle's field of view, while the measurements are collected similarly on the fly. Our goal is to determine the autonomous vehicle's pose from the landmark measurements and map landmarks. To learn this mapping, we propose DeepL…
▽ More
We address the problem of vehicle self-localization from multi-modal sensor information and a reference map. The map is generated off-line by extracting landmarks from the vehicle's field of view, while the measurements are collected similarly on the fly. Our goal is to determine the autonomous vehicle's pose from the landmark measurements and map landmarks. To learn this mapping, we propose DeepLocalization, a deep neural network that regresses the vehicle's translation and rotation parameters from unordered and dynamic input landmarks. The proposed network architecture is robust to changes of the dynamic environment and can cope with a small number of extracted landmarks. During the training process we rely on synthetically generated ground-truth. In our experiments, we evaluate two inference approaches in real-world scenarios. We show that DeepLocalization can be combined with regular GPS signals and filtering algorithms such as the extended Kalman filter. Our approach achieves state-of-the-art accuracy and is about ten times faster than the related work.
△ Less
Submitted 19 July, 2019; v1 submitted 18 April, 2019;
originally announced April 2019.
-
Detection of periodicity in functional time series
Authors:
Siegfried Hörmann,
Piotr Kokoszka,
Gilles Nisol
Abstract:
We derive several tests for the presence of a periodic component in a time series of functions. We consider both the traditional setting in which the periodic functional signal is contaminated by functional white noise, and a more general setting of a contaminating process which is weakly dependent. Several forms of the periodic component are considered. Our tests are motivated by the likelihood p…
▽ More
We derive several tests for the presence of a periodic component in a time series of functions. We consider both the traditional setting in which the periodic functional signal is contaminated by functional white noise, and a more general setting of a contaminating process which is weakly dependent. Several forms of the periodic component are considered. Our tests are motivated by the likelihood principle and fall into two broad categories, which we term multivariate and fully functional. Overall, for the functional series that motivate this research, the fully functional tests exhibit a superior balance of size and power. Asymptotic null distributions of all tests are derived and their consistency is established. Their finite sample performance is examined and compared by numerical studies and application to pollution data.
△ Less
Submitted 7 July, 2016;
originally announced July 2016.
-
Dynamic Functional Principal Component
Authors:
Siegfried Hörmann,
Łukasz Kidziński,
Marc Hallin
Abstract:
In this paper, we address the problem of dimension reduction for time series of functional data $(X_t\colon t\in\mathbb{Z})$. Such {\it functional time series} frequently arise, e.g., when a continuous-time process is segmented into some smaller natural units, such as days. Then each~$X_t$ represents one intraday curve. We argue that functional principal component analysis (FPCA), though a key tec…
▽ More
In this paper, we address the problem of dimension reduction for time series of functional data $(X_t\colon t\in\mathbb{Z})$. Such {\it functional time series} frequently arise, e.g., when a continuous-time process is segmented into some smaller natural units, such as days. Then each~$X_t$ represents one intraday curve. We argue that functional principal component analysis (FPCA), though a key technique in the field and a benchmark for any competitor, does not provide an adequate dimension reduction in a time-series setting. FPCA indeed is a {\it static} procedure which ignores the essential information provided by the serial dependence structure of the functional data under study. Therefore, inspired by Brillinger's theory of {\it dynamic principal components}, we propose a {\it dynamic} version of FPCA, which is based on a frequency-domain approach. By means of a simulation study and an empirical illustration, we show the considerable improvement the dynamic approach entails when compared to the usual static procedure.
△ Less
Submitted 2 June, 2015; v1 submitted 26 October, 2012;
originally announced October 2012.
-
On the prediction of stationary functional time series
Authors:
Alexander Aue,
Diogo Dubart Norinho,
Siegfried Hörmann
Abstract:
This paper addresses the prediction of stationary functional time series. Existing contributions to this problem have largely focused on the special case of first-order functional autoregressive processes because of their technical tractability and the current lack of advanced functional time series methodology. It is shown here how standard multivariate prediction techniques can be utilized in th…
▽ More
This paper addresses the prediction of stationary functional time series. Existing contributions to this problem have largely focused on the special case of first-order functional autoregressive processes because of their technical tractability and the current lack of advanced functional time series methodology. It is shown here how standard multivariate prediction techniques can be utilized in this context. The connection between functional and multivariate predictions is made precise for the important case of vector and functional autoregressions. The proposed method is easy to implement, making use of existing statistical software packages, and may therefore be attractive to a broader, possibly non-academic, audience. Its practical applicability is enhanced through the introduction of a novel functional final prediction error model selection criterion that allows for an automatic determination of the lag structure and the dimensionality of the model. The usefulness of the proposed methodology is demonstrated in a simulation study and an application to environmental data, namely the prediction of daily pollution curves describing the concentration of particulate matter in ambient air. It is found that the proposed prediction method often significantly outperforms existing methods.
△ Less
Submitted 31 March, 2014; v1 submitted 14 August, 2012;
originally announced August 2012.
