Inference on the change point with the jump size near the boundary of the region of detectability in high dimensional time series models
Authors:
Abhishek Kaul,
Venkata K Jandhyala,
Stergios B Fotopoulos
Abstract:
We develop a projected least squares estimator for the change point parameter in a high dimensional time series model with a potential change point. Importantly we work under the setup where the jump size may be near the boundary of the region of detectability. The proposed methodology yields an optimal rate of convergence despite high dimensionality of the assumed model and a potentially diminish…
▽ More
We develop a projected least squares estimator for the change point parameter in a high dimensional time series model with a potential change point. Importantly we work under the setup where the jump size may be near the boundary of the region of detectability. The proposed methodology yields an optimal rate of convergence despite high dimensionality of the assumed model and a potentially diminishing jump size. The limiting distribution of this estimate is derived, thereby allowing construction of a confidence interval for the location of the change point. A secondary near optimal estimate is proposed which is required for the implementation of the optimal projected least squares estimate. The prestep estimation procedure is designed to also agnostically detect the case where no change point exists, thereby removing the need to pretest for the existence of a change point for the implementation of the inference methodology. Our results are presented under a general positive definite spatial dependence setup, assuming no special structure on this dependence. The proposed methodology is designed to be highly scalable, and applicable to very large data. Theoretical results regarding detection and estimation consistency and the limiting distribution are numerically supported via monte carlo simulations.
△ Less
Submitted 17 September, 2019;
originally announced September 2019.
Detection and estimation of parameters in high dimensional multiple change point regression models via $\ell_1/\ell_0$ regularization and discrete optimization
Authors:
Abhishek Kaul,
Venkata K Jandhyala,
Stergios B Fotopoulos
Abstract:
Binary segmentation, which is sequential in nature is thus far the most widely used method for identifying multiple change points in statistical models. Here we propose a top down methodology called arbitrary segmentation that proceeds in a conceptually reverse manner. We begin with an arbitrary superset of the parametric space of the change points, and locate unknown change points by suitably fil…
▽ More
Binary segmentation, which is sequential in nature is thus far the most widely used method for identifying multiple change points in statistical models. Here we propose a top down methodology called arbitrary segmentation that proceeds in a conceptually reverse manner. We begin with an arbitrary superset of the parametric space of the change points, and locate unknown change points by suitably filtering this space down. Critically, we reframe the problem as that of variable selection in the change point parameters, this enables the filtering down process to be achieved in a single step with the aid of an $\ell_0$ regularization, thus avoiding the sequentiality of binary segmentation. We study this method under a high dimensional multiple change point linear regression model and show that rates convergence of the error in the regression and change point estimates are near optimal. We propose a simulated annealing (SA) approach to implement a key finite state space discrete optimization that arises in our method. Theoretical results are numerically supported via simulations. The proposed method is shown to possess the ability to agnostically detect the `no change' scenario. Furthermore, its computational complexity is of order $O(Np^2)$+SA, where SA is the cost of a SA optimization on a $N$(no. of change points) dimensional grid. Thus, the proposed methodology is significantly more computationally efficient than existing approaches. Finally, our theoretical results are obtained under weaker model conditions than those assumed in the current literature.
△ Less
Submitted 11 June, 2019;
originally announced June 2019.
