-
Traffic Flow Data Completion and Anomaly Diagnosis via Sparse and Low-Rank Tensor Optimization
Authors:
Junxi Man,
Yumin Lin,
Xiaoyu Li
Abstract:
Spatiotemporal traffic time series, such as traffic speed data, collected from sensing systems are often incomplete, with considerable corruption and large amounts of missing values. A vast amount of data conceals implicit data structures, which poses significant challenges for data recovery issues, such as mining the potential spatio-temporal correlations of data and identifying abnormal data. In…
▽ More
Spatiotemporal traffic time series, such as traffic speed data, collected from sensing systems are often incomplete, with considerable corruption and large amounts of missing values. A vast amount of data conceals implicit data structures, which poses significant challenges for data recovery issues, such as mining the potential spatio-temporal correlations of data and identifying abnormal data. In this paper, we propose a Tucker decomposition-based sparse low-rank high-order tensor optimization model (TSLTO) for data imputation and anomaly diagnosis. We decompose the traffic tensor data into low-rank and sparse tensors, and establish a sparse low-rank high-order tensor optimization model based on Tucker decomposition. By utilizing tools of non-smooth analysis for tensor functions, we explore the optimality conditions of the proposed tensor optimization model and design an ADMM optimization algorithm for solving the model. Finally, numerical experiments are conducted on both synthetic data and a real-world dataset: the urban traffic speed dataset of Guangzhou. Numerical comparisons with several representative existing algorithms demonstrate that our proposed approach achieves higher accuracy and efficiency in traffic flow data recovery and anomaly diagnosis tasks.
△ Less
Submitted 2 April, 2025;
originally announced April 2025.
-
Inverse modeling of hydrologic systems with adaptive multi-fidelity Markov chain Monte Carlo simulations
Authors:
Jiangjiang Zhang,
Jun Man,
Guang Lin,
Laosheng Wu,
Lingzao Zeng
Abstract:
Markov chain Monte Carlo (MCMC) simulation methods are widely used to assess parametric uncertainties of hydrologic models conditioned on measurements of observable state variables. However, when the model is CPU-intensive and high-dimensional, the computational cost of MCMC simulation will be prohibitive. In this situation, a CPU-efficient while less accurate low-fidelity model (e.g., a numerical…
▽ More
Markov chain Monte Carlo (MCMC) simulation methods are widely used to assess parametric uncertainties of hydrologic models conditioned on measurements of observable state variables. However, when the model is CPU-intensive and high-dimensional, the computational cost of MCMC simulation will be prohibitive. In this situation, a CPU-efficient while less accurate low-fidelity model (e.g., a numerical model with a coarser discretization, or a data-driven surrogate) is usually adopted. Nowadays, multi-fidelity simulation methods that can take advantage of both the efficiency of the low-fidelity model and the accuracy of the high-fidelity model are gaining popularity. In the MCMC simulation, as the posterior distribution of the unknown model parameters is the region of interest, it is wise to distribute most of the computational budget (i.e., the high-fidelity model evaluations) therein. Based on this idea, in this paper we propose an adaptive multi-fidelity MCMC algorithm for efficient inverse modeling of hydrologic systems. In this method, we evaluate the high-fidelity model mainly in the posterior region through iteratively running MCMC based on a Gaussian process (GP) system that is adaptively constructed with multi-fidelity simulation. The error of the GP system is rigorously considered in the MCMC simulation and gradually reduced to a negligible level in the posterior region. Thus, the proposed method can obtain an accurate estimate of the posterior distribution with a small number of the high-fidelity model evaluations. The performance of the proposed method is demonstrated by three numerical case studies in inverse modeling of hydrologic systems.
△ Less
Submitted 14 June, 2018; v1 submitted 6 December, 2017;
originally announced December 2017.
-
Complete gradient shrinking Ricci solitons have finite topological type
Authors:
Fuquan Fang,
Jianwen man,
Zhenlei Zhang
Abstract:
We show that a complete Riemannian manifold has finite topological type (i.e., homeomorphic to the interior of a compact manifold with boundary), provided its Bakry-Émery Ricci tensor has a positive lower bound, and either of the following conditions:
(i) the Ricci curvature is bounded from above; (ii) the Ricci curvature is bounded from below and injectivity radius is bounded away from zero.…
▽ More
We show that a complete Riemannian manifold has finite topological type (i.e., homeomorphic to the interior of a compact manifold with boundary), provided its Bakry-Émery Ricci tensor has a positive lower bound, and either of the following conditions:
(i) the Ricci curvature is bounded from above; (ii) the Ricci curvature is bounded from below and injectivity radius is bounded away from zero.
Moreover, a complete shrinking Ricci soliton has finite topological type if its scalar curvature is bounded.
△ Less
Submitted 30 December, 2007;
originally announced January 2008.