-
Non-Asymptotic Analysis of Classical Spectrum Estimators for $L$-mixing Time-series Data with Unknown Means
Authors:
Yuping Zheng,
Andrew Lamperski
Abstract:
Spectral estimation is an important tool in time series analysis, with applications including economics, astronomy, and climatology. The asymptotic theory for non-parametric estimation is well-known but the development of non-asymptotic theory is still ongoing. Our recent work obtained the first non-asymptotic error bounds on the Bartlett and Welch methods for $L$-mixing stochastic processes. The…
▽ More
Spectral estimation is an important tool in time series analysis, with applications including economics, astronomy, and climatology. The asymptotic theory for non-parametric estimation is well-known but the development of non-asymptotic theory is still ongoing. Our recent work obtained the first non-asymptotic error bounds on the Bartlett and Welch methods for $L$-mixing stochastic processes. The class of $L$-mixing processes contains common models in time series analysis, including autoregressive processes and measurements of geometrically ergodic Markov chains. Our prior analysis assumes that the process has zero mean. While zero-mean assumptions are common, real-world time-series data often has unknown, non-zero mean. In this work, we derive non-asymptotic error bounds for both Bartlett and Welch estimators for $L$-mixing time-series data with unknown means. The obtained error bounds are of $O(\frac{1}{\sqrt{k}})$, where $k$ is the number of data segments used in the algorithm, which are tighter than our previous results under the zero-mean assumption.
△ Less
Submitted 31 March, 2025;
originally announced April 2025.
-
Function Gradient Approximation with Random Shallow ReLU Networks with Control Applications
Authors:
Andrew Lamperski,
Siddharth Salapaka
Abstract:
Neural networks are widely used to approximate unknown functions in control. A common neural network architecture uses a single hidden layer (i.e. a shallow network), in which the input parameters are fixed in advance and only the output parameters are trained. The typical formal analysis asserts that if output parameters exist to approximate the unknown function with sufficient accuracy, then des…
▽ More
Neural networks are widely used to approximate unknown functions in control. A common neural network architecture uses a single hidden layer (i.e. a shallow network), in which the input parameters are fixed in advance and only the output parameters are trained. The typical formal analysis asserts that if output parameters exist to approximate the unknown function with sufficient accuracy, then desired control performance can be achieved. A long-standing theoretical gap was that no conditions existed to guarantee that, for the fixed input parameters, required accuracy could be obtained by training the output parameters. Our recent work has partially closed this gap by demonstrating that if input parameters are chosen randomly, then for any sufficiently smooth function, with high-probability there are output parameters resulting in $O((1/m)^{1/2})$ approximation errors, where $m$ is the number of neurons. However, some applications, notably continuous-time value function approximation, require that the network approximates the both the unknown function and its gradient with sufficient accuracy. In this paper, we show that randomly generated input parameters and trained output parameters result in gradient errors of $O((\log(m)/m)^{1/2})$, and additionally, improve the constants from our prior work. We show how to apply the result to policy evaluation problems.
△ Less
Submitted 7 October, 2024;
originally announced October 2024.
-
Approximation with Random Shallow ReLU Networks with Applications to Model Reference Adaptive Control
Authors:
Andrew Lamperski,
Tyler Lekang
Abstract:
Neural networks are regularly employed in adaptive control of nonlinear systems and related methods of reinforcement learning. A common architecture uses a neural network with a single hidden layer (i.e. a shallow network), in which the weights and biases are fixed in advance and only the output layer is trained. While classical results show that there exist neural networks of this type that can a…
▽ More
Neural networks are regularly employed in adaptive control of nonlinear systems and related methods of reinforcement learning. A common architecture uses a neural network with a single hidden layer (i.e. a shallow network), in which the weights and biases are fixed in advance and only the output layer is trained. While classical results show that there exist neural networks of this type that can approximate arbitrary continuous functions over bounded regions, they are non-constructive, and the networks used in practice have no approximation guarantees. Thus, the approximation properties required for control with neural networks are assumed, rather than proved. In this paper, we aim to fill this gap by showing that for sufficiently smooth functions, ReLU networks with randomly generated weights and biases achieve $L_{\infty}$ error of $O(m^{-1/2})$ with high probability, where $m$ is the number of neurons. It suffices to generate the weights uniformly over a sphere and the biases uniformly over an interval. We show how the result can be used to get approximations of required accuracy in a model reference adaptive control application.
△ Less
Submitted 16 April, 2024; v1 submitted 25 March, 2024;
originally announced March 2024.
-
Non-Asymptotic Pointwise and Worst-Case Bounds for Classical Spectrum Estimators
Authors:
Andrew Lamperski
Abstract:
Spectrum estimation is a fundamental methodology in the analysis of time-series data, with applications including medicine, speech analysis, and control design. The asymptotic theory of spectrum estimation is well-understood, but the theory is limited when the number of samples is fixed and finite. This paper gives non-asymptotic error bounds for a broad class of spectral estimators, both pointwis…
▽ More
Spectrum estimation is a fundamental methodology in the analysis of time-series data, with applications including medicine, speech analysis, and control design. The asymptotic theory of spectrum estimation is well-understood, but the theory is limited when the number of samples is fixed and finite. This paper gives non-asymptotic error bounds for a broad class of spectral estimators, both pointwise (at specific frequencies) and in the worst case over all frequencies. The general method is used to derive error bounds for the classical Blackman-Tukey, Bartlett, and Welch estimators. In particular, these are first non-asymptotic error bounds for Bartlett and Welch estimators.
△ Less
Submitted 14 August, 2023; v1 submitted 21 March, 2023;
originally announced March 2023.
-
Topology Learning in Radial Dynamical Systems with Unreliable Data
Authors:
Venkat Ram Subramanian,
Deepjyoti Deka,
Saurav Talukdar,
Andy Lamperski,
Murti Salapaka
Abstract:
Many complex engineering systems admit bidirectional and linear couplings between their agents. Blind and passive methods to identify such influence pathways/couplings from data are central to many applications. However, dynamically related data-streams originating at different sources are prone to corruption caused by asynchronous time-stamps of different streams, packet drops and noise. Such imp…
▽ More
Many complex engineering systems admit bidirectional and linear couplings between their agents. Blind and passive methods to identify such influence pathways/couplings from data are central to many applications. However, dynamically related data-streams originating at different sources are prone to corruption caused by asynchronous time-stamps of different streams, packet drops and noise. Such imperfect information may be present in the entire observation period, and hence not detected by change-detection algorithms that require an initial clean observation period. Prior work has shown that spurious links are inferred in the graph structure due to the corrupted data-streams, which prevents consistent learning. In this article, we provide a novel approach to detect the location of corrupt agents as well as present an algorithm to learn the structure of radial dynamical systems despite corrupted data streams. In particular, we show that our approach provably learns the true radial structure if the unknown corrupted nodes are at least three hops away from each other. Our theoretical results are further validated in test dynamical network.
△ Less
Submitted 28 September, 2020;
originally announced September 2020.
-
Network Structure Identification from Corrupt Data Streams
Authors:
Venkat Ram Subramanian,
Andrew Lamperski,
Murti V. Salapaka
Abstract:
Complex networked systems can be modeled as graphs with nodes representing the agents and links describing the dynamic coupling between them. Previous work on network identification has shown that the network structure of linear time-invariant (LTI) systems can be reconstructed from the joint power spectrum of the data streams. These results assumed that data is perfectly measured. However, real-w…
▽ More
Complex networked systems can be modeled as graphs with nodes representing the agents and links describing the dynamic coupling between them. Previous work on network identification has shown that the network structure of linear time-invariant (LTI) systems can be reconstructed from the joint power spectrum of the data streams. These results assumed that data is perfectly measured. However, real-world data is subject to many corruptions, such as inaccurate time-stamps, noise, and data loss. We show that identifying the structure of linear time-invariant systems using corrupt measurements results in the inference of erroneous links. We provide an exact characterization and prove that such erroneous links are restricted to the neighborhood of the perturbed node. We extend the analysis of LTI systems to the case of Markov random fields with corrupt measurements. We show that data corruption in Markov random fields results in spurious probabilistic relationships in precisely the locations where spurious links arise in LTI systems.
△ Less
Submitted 8 June, 2020;
originally announced June 2020.
-
Causal Structure Identification from Corrupt Data-Streams
Authors:
Venkat Ram Subramanian,
Andrew Lamperski,
Murti V. Salapaka
Abstract:
Complex networked systems can be modeled and represented as graphs, with nodes representing the agents and the links describing the dynamic coupling between them. The fundamental objective of network identification for dynamic systems is to identify causal influence pathways. However, dynamically related data-streams that originate from different sources are prone to corruption caused by asynchron…
▽ More
Complex networked systems can be modeled and represented as graphs, with nodes representing the agents and the links describing the dynamic coupling between them. The fundamental objective of network identification for dynamic systems is to identify causal influence pathways. However, dynamically related data-streams that originate from different sources are prone to corruption caused by asynchronous time stamps, packet drops, and noise. In this article, we show that identifying causal structure using corrupt measurements results in the inference of spurious links. A necessary and sufficient condition that delineates the effects of corruption on a set of nodes is obtained. Our theory applies to nonlinear systems, and systems with feedback loops. Our results are obtained by the analysis of conditional directed information in dynamic Bayesian networks. We provide consistency results for the conditional directed information estimator that we use by showing almost-sure convergence.
△ Less
Submitted 8 June, 2020;
originally announced June 2020.
-
First-Order Algorithms for Constrained Nonlinear Dynamic Games
Authors:
Bolei Di,
Andrew Lamperski
Abstract:
This paper presents algorithms for non-zero sum nonlinear constrained dynamic games with full information. Such problems emerge when multiple players with action constraints and differing objectives interact with the same dynamic system. They model a wide range of applications including economics, defense, and energy systems. We show how to exploit the temporal structure in projected gradient and…
▽ More
This paper presents algorithms for non-zero sum nonlinear constrained dynamic games with full information. Such problems emerge when multiple players with action constraints and differing objectives interact with the same dynamic system. They model a wide range of applications including economics, defense, and energy systems. We show how to exploit the temporal structure in projected gradient and Douglas-Rachford (DR) splitting methods. The resulting algorithms converge locally to open-loop Nash equilibria (OLNE) at linear rates. Furthermore, we extend stagewise Newton method to find a local feedback policy around an OLNE. In the of linear dynamics and polyhedral constraints, we show that this local feedback controller is an approximated feedback Nash equilibrium (FNE). Numerical examples are provided.
△ Less
Submitted 6 January, 2020;
originally announced January 2020.
-
Non-asymptotic Closed-Loop System Identification using Autoregressive Processes and Hankel Model Reduction
Authors:
Bruce Lee,
Andrew Lamperski
Abstract:
One of the primary challenges of system identification is determining how much data is necessary to adequately fit a model. Non-asymptotic characterizations of the performance of system identification methods provide this knowledge. Such characterizations are available for several algorithms performing open-loop identification. Often times, however, data is collected in closed-loop. Application of…
▽ More
One of the primary challenges of system identification is determining how much data is necessary to adequately fit a model. Non-asymptotic characterizations of the performance of system identification methods provide this knowledge. Such characterizations are available for several algorithms performing open-loop identification. Often times, however, data is collected in closed-loop. Application of open-loop identification methods to closed-loop data can result in biased estimates. One method used by subspace identification techniques to eliminate these biases involves first fitting a long-horizon autoregressive model, then performing model reduction. The asymptotic behavior of such algorithms is well characterized, but the non-asymptotic behavior is not. This work provides a non-asymptotic characterization of one particular variant of these algorithms. More specifically, we provide non-asymptotic upper bounds on the generalization error of the produced model, as well as high probability bounds on the difference between the produced model and the finite horizon Kalman Filter.
△ Less
Submitted 4 September, 2019;
originally announced September 2019.
-
Newton's Method and Differential Dynamic Programming for Unconstrained Nonlinear Dynamic Games
Authors:
Bolei Di,
Andrew Lamperski
Abstract:
Dynamic games arise when multiple agents with differing objectives control a dynamic system. They model a wide variety of applications in economics, defense, energy systems and etc. However, compared to single-agent control problems, the computational methods for dynamic games are relatively limited. As in the single-agent case, only specific dynamic games can be solved exactly, so approximation a…
▽ More
Dynamic games arise when multiple agents with differing objectives control a dynamic system. They model a wide variety of applications in economics, defense, energy systems and etc. However, compared to single-agent control problems, the computational methods for dynamic games are relatively limited. As in the single-agent case, only specific dynamic games can be solved exactly, so approximation algorithms are required. In this paper, we show how to extend a recursive Newton's algorithm and the popular differential dynamic programming (DDP) for single-agent optimal control to the case of full-information non-zero sum dynamic games. In the single-agent case, the convergence of DDP is proved by comparison with Newton's method, which converges locally at a quadratic rate. We show that the iterates of Newton's method and DDP are sufficiently close for the DDP to inherit the quadratic convergence rate of Newton's method. We also prove both methods result in an open-loop Nash equilibrium and a local feedback $O(ε^2)$-Nash equilibrium. Numerical examples are provided.
△ Less
Submitted 6 January, 2020; v1 submitted 19 June, 2019;
originally announced June 2019.
-
Stability of Asynchronous Networked Control Systems with Probabilistic Clocks
Authors:
Andrew Lamperski
Abstract:
This paper studies the stability of sampled and networked control systems with sampling and communication times governed by probabilistic clocks. The clock models have few restrictions, and can be used to model numerous phenomena such as deterministic sampling, jitter, and transmission times of packet dropping networks. Moreover, the stability theory can be applied to an arbitrary number of clocks…
▽ More
This paper studies the stability of sampled and networked control systems with sampling and communication times governed by probabilistic clocks. The clock models have few restrictions, and can be used to model numerous phenomena such as deterministic sampling, jitter, and transmission times of packet dropping networks. Moreover, the stability theory can be applied to an arbitrary number of clocks with different distributions, operating asynchronously. The paper gives Lyapunov-type sufficient conditions for stochastic stability of nonlinear networked systems. For linear systems, the paper gives necessary and sufficient conditions for exponential mean square stability, based on linear matrix inequalities. In both the linear and nonlinear cases, the Lyapunov inequalities are constructed from a simple linear combination of the classical inequalities from continuous and discrete time. Crucially, the stability theorems only depend on the mean sampling intervals. Thus, they can be applied with only limited statistical information about the clocks. The Lyapunov theorems are then applied to systems with multirate sampling, asynchronous communication, delays, and packet losses.
△ Less
Submitted 8 October, 2014; v1 submitted 2 October, 2014;
originally announced October 2014.
-
Optimal Two Player LQR State Feedback With Varying Delay
Authors:
Nikolai Matni,
Andrew Lamperski,
John C. Doyle
Abstract:
This paper presents an explicit solution to a two player distributed LQR problem in which communication between controllers occurs across a communication link with varying delay. We extend known dynamic programming methods to accommodate this varying delay, and show that under suitable assumptions, the optimal control actions are linear in their information, and that the resulting controller has p…
▽ More
This paper presents an explicit solution to a two player distributed LQR problem in which communication between controllers occurs across a communication link with varying delay. We extend known dynamic programming methods to accommodate this varying delay, and show that under suitable assumptions, the optimal control actions are linear in their information, and that the resulting controller has piecewise linear dynamics dictated by the current effective delay regime.
△ Less
Submitted 30 March, 2014;
originally announced March 2014.
-
Optimal Control with Noisy Time
Authors:
Andrew Lamperski,
Noah J. Cowan
Abstract:
This paper examines stochastic optimal control problems in which the state is perfectly known, but the controller's measure of time is a stochastic process derived from a strictly increasing Lévy process. We provide dynamic programming results for continuous-time finite-horizon control and specialize these results to solve a noisy-time variant of the linear quadratic regulator problem and a portfo…
▽ More
This paper examines stochastic optimal control problems in which the state is perfectly known, but the controller's measure of time is a stochastic process derived from a strictly increasing Lévy process. We provide dynamic programming results for continuous-time finite-horizon control and specialize these results to solve a noisy-time variant of the linear quadratic regulator problem and a portfolio optimization problem with random trade activity rates. For the linear quadratic case, the optimal controller is linear and can be computed from a generalization of the classical Riccati differential equation.
△ Less
Submitted 31 December, 2013;
originally announced January 2014.
-
The H2 Control Problem for Quadratically Invariant Systems with Delays
Authors:
Andrew Lamperski,
John C. Doyle
Abstract:
This paper gives a new solution to the output feedback H2 problem for quadratically invariant communication delay patterns. A characterization of all stabilizing controllers satisfying the delay constraints is given and the decentralized H2 problem is cast as a convex model matching problem. The main result shows that the model matching problem can be reduced to a finite-dimensional quadratic prog…
▽ More
This paper gives a new solution to the output feedback H2 problem for quadratically invariant communication delay patterns. A characterization of all stabilizing controllers satisfying the delay constraints is given and the decentralized H2 problem is cast as a convex model matching problem. The main result shows that the model matching problem can be reduced to a finite-dimensional quadratic program. A recursive state-space method for computing the optimal controller based on vectorization is given.
△ Less
Submitted 7 October, 2014; v1 submitted 30 December, 2013;
originally announced December 2013.
-
Optimal Decentralized State-Feedback Control with Sparsity and Delays
Authors:
Andrew Lamperski,
Laurent Lessard
Abstract:
This work presents the solution to a class of decentralized linear quadratic state-feedback control problems, in which the plant and controller must satisfy the same combination of delay and sparsity constraints. Using a novel decomposition of the noise history, the control problem is split into independent subproblems that are solved using dynamic programming. The approach presented herein both u…
▽ More
This work presents the solution to a class of decentralized linear quadratic state-feedback control problems, in which the plant and controller must satisfy the same combination of delay and sparsity constraints. Using a novel decomposition of the noise history, the control problem is split into independent subproblems that are solved using dynamic programming. The approach presented herein both unifies and generalizes many existing results.
△ Less
Submitted 23 November, 2014; v1 submitted 31 May, 2013;
originally announced June 2013.
-
Output Feedback H_2 Model Matching for Decentralized Systems with Delays
Authors:
Andrew Lamperski,
John C. Doyle
Abstract:
This paper gives a new solution to the output feedback H_2 model matching problem for a large class of delayed information sharing patterns. Existing methods for such problems typically reduce the decentralized problem to a centralized problem of higher state dimension. In contrast, the controller given in this paper is constructed from the solutions to the centralized control and estimation Ricca…
▽ More
This paper gives a new solution to the output feedback H_2 model matching problem for a large class of delayed information sharing patterns. Existing methods for such problems typically reduce the decentralized problem to a centralized problem of higher state dimension. In contrast, the controller given in this paper is constructed from the solutions to the centralized control and estimation Riccati equations for the original system. The problem is solved by decomposing the controller into two components. One is centralized, but delayed, while the other is decentralized with finite impulse response (FIR). It is then shown that the optimal controller can be constructed through a combination of centralized spectral factorization and quadratic programming.
△ Less
Submitted 17 September, 2012;
originally announced September 2012.
