-
Parameterizations for Large-Scale Variational System Identification Using Unconstrained Optimization
Authors:
Dimas Abreu Archanjo Dutra
Abstract:
This paper details how to parameterize the posterior distribution of state-space systems to generate improved optimization problems for system identification using variational inference. Three different parameterizations of the assumed state-path posterior distribution are proposed based on this representation: time-varying, steady-state, and convolution smoother; each resulting in a different par…
▽ More
This paper details how to parameterize the posterior distribution of state-space systems to generate improved optimization problems for system identification using variational inference. Three different parameterizations of the assumed state-path posterior distribution are proposed based on this representation: time-varying, steady-state, and convolution smoother; each resulting in a different parameter estimator. In contrast to existing methods for variational system identification, the proposed estimators can be implemented with unconstrained optimization methods. Furthermore, when applied to mini-batches in conjunction with stochastic optimization, the convolution-smoother formulation enables identification of large linear and nonlinear state-space systems from very large datasets. For linear systems, the method achieves the same performance as the inherently sequential prediction-error methods using an embarrassingly parallel algorithm that benefits from large speedups when computed in modern graphical processing units (GPUs). The ability of the proposed estimators to identify large models, work with large datasets split into mini-batches, and work in parallel on GPUs make them well-suited for identifying deep models for applications in systems and control.
△ Less
Submitted 24 September, 2024; v1 submitted 15 April, 2024;
originally announced April 2024.
-
Uncertainty estimation in equality-constrained MAP and maximum likelihood estimation with applications to system identification and state estimation
Authors:
Dimas Abreu Archanjo Dutra
Abstract:
In unconstrained maximum a posteriori (MAP) and maximum likelihood estimation, the inverse of minus the merit-function Hessian matrix is an approximation of the estimate covariance matrix. In the Bayesian context of MAP estimation, it is the covariance of a normal approximation of the posterior around the mode; while in maximum likelihood estimation, it an approximation of the inverse Fisher infor…
▽ More
In unconstrained maximum a posteriori (MAP) and maximum likelihood estimation, the inverse of minus the merit-function Hessian matrix is an approximation of the estimate covariance matrix. In the Bayesian context of MAP estimation, it is the covariance of a normal approximation of the posterior around the mode; while in maximum likelihood estimation, it an approximation of the inverse Fisher information matrix, to which the covariance of efficient estimators converge. These measures are routinely used in system identification to evaluate the estimate uncertainties and diagnose problems such as overparametrization, improper excitation and unidentifiability. A wide variety of estimation problems in systems and control, however, can be formulated as equality-constrained optimizations with additional decision variables to exploit parallelism in computer hardware, simplify implementation and increase the convergence basin and efficiency of the nonlinear program solver. The introduction of the extra variables, however, dissociates the inverse Hessian from the covariance matrix. Instead, submatrices of the inverse Hessian of the constrained-problem's Lagrangian must be used. In this paper, we derive these relationships, showing how the estimates' covariance can be estimated directly from the augmented problem. Application examples are shown in system identification with the output-error method and joint state-path and parameter estimation.
△ Less
Submitted 16 March, 2020; v1 submitted 25 February, 2020;
originally announced February 2020.
-
Collocation-Based Output-Error Method for Aircraft System Identification
Authors:
Dimas Abreu Archanjo Dutra
Abstract:
The output-error method is a mainstay of aircraft system identification from flight-test data. It is the method of choice for a wide range of applications, from the estimation of stability and control derivatives for aerodynamic database generation to sensor bias estimation in flight-path reconstruction. However, notable limitations of the output-error method are that it requires ad hoc modificati…
▽ More
The output-error method is a mainstay of aircraft system identification from flight-test data. It is the method of choice for a wide range of applications, from the estimation of stability and control derivatives for aerodynamic database generation to sensor bias estimation in flight-path reconstruction. However, notable limitations of the output-error method are that it requires ad hoc modifications for applications to unstable systems and it is an iterative method which is particularly sensitive to the initial guess. In this paper, we show how to reformulate the estimation as a collocation problem, an approach common in other disciplines but seldomly used in flight vehicle system identification. Both formulations are equivalent in terms of having the same solution, but the collocation-based can be applied without modifications or loss of efficiency to unstable systems. Examples with simulated and real-world flight-test data also show that convergence to the optimum is obtained even with poor initial guesses.
△ Less
Submitted 4 September, 2019;
originally announced September 2019.
-
Maximum a Posteriori Joint State Path and Parameter Estimation in Stochastic Differential Equations
Authors:
Dimas Abreu Dutra
Abstract:
A wide variety of phenomena of engineering and scientific interest are of a continuous-time nature and can be modeled by stochastic differential equations (SDEs), which represent the evolution of the uncertainty in the states of a system. For systems of this class, some parameters of the SDE might be unknown and the measured data often includes noise, so state and parameter estimators are needed t…
▽ More
A wide variety of phenomena of engineering and scientific interest are of a continuous-time nature and can be modeled by stochastic differential equations (SDEs), which represent the evolution of the uncertainty in the states of a system. For systems of this class, some parameters of the SDE might be unknown and the measured data often includes noise, so state and parameter estimators are needed to perform inference and further analysis using the system state path. The distributions of SDEs which are nonlinear or subject to non-Gaussian measurement noise do not admit tractable analytic expressions, so state and parameter estimators for these systems are often approximations based on heuristics, such as the extended and unscented Kalman smoothers, or the prediction error method using nonlinear Kalman filters. However, the Onsager Machlup functional can be used to obtain fictitious densities for the parameters and state-paths of SDEs with analytic expressions. In this thesis, we provide a unified theoretical framework for maximum a posteriori (MAP) estimation of general random variables, possibly infinite-dimensional, and show how the Onsager--Machlup functional can be used to construct the joint MAP state-path and parameter estimator for SDEs. We also prove that the minimum energy estimator, which is often thought to be the MAP state-path estimator, actually gives the state paths associated to the MAP noise paths. Furthermore, we prove that the discretized MAP state-path and parameter estimators, which have emerged recently as powerful alternatives to nonlinear Kalman smoothers, converge hypographically as the discretization step vanishes. Their hypographical limit, however, is the MAP estimator for SDEs when the trapezoidal discretization is used and the minimum energy estimator when the Euler discretization is used, associating different interpretations to each discretized estimate.
△ Less
Submitted 6 April, 2017;
originally announced April 2017.
-
Joint Maximum a Posteriori State Path and Parameter Estimation in Stochastic Differential Equations
Authors:
Dimas Abreu Archanjo Dutra,
Bruno Otávio Soares Teixeira,
Luis Antonio Aguirre
Abstract:
In this article, we introduce the joint maximum a posteriori state path and parameter estimator (JME) for continuous-time systems described by stochastic differential equations (SDEs). This estimator can be applied to nonlinear systems with discrete-time (sampled) measurements with a wide range of measurement distributions. We also show that the minimum-energy state path and parameter estimator (M…
▽ More
In this article, we introduce the joint maximum a posteriori state path and parameter estimator (JME) for continuous-time systems described by stochastic differential equations (SDEs). This estimator can be applied to nonlinear systems with discrete-time (sampled) measurements with a wide range of measurement distributions. We also show that the minimum-energy state path and parameter estimator (MEE) obtains the joint maximum a posteriori noise path, initial conditions, and parameters. These estimators are demonstrated in simulated experiments, in which they are compared to the prediction error method (PEM) using the unscented Kalman filter and smoother. The experiments show that the MEE is biased for the damping parameters of the drift function. Furthermore, for robust estimation in the presence of outliers, the JME attains lower state estimation errors than the PEM.
△ Less
Submitted 5 April, 2017;
originally announced April 2017.
-
Maximum a Posteriori State Path Estimation: Discretization Limits and their Interpretation
Authors:
Dimas Abreu Dutra,
Bruno Otávio Soares Teixeira,
Luis Antonio Aguirre
Abstract:
Continuous-discrete models with dynamics described by stochastic differential equations are used in a wide variety of applications. For these systems, the maximum a posteriori (MAP) state path can be defined as the curves around which lie the infinitesimal tubes with greatest posterior probability, which can be found by maximizing a merit function built upon the Onsager--Machlup functional. A comm…
▽ More
Continuous-discrete models with dynamics described by stochastic differential equations are used in a wide variety of applications. For these systems, the maximum a posteriori (MAP) state path can be defined as the curves around which lie the infinitesimal tubes with greatest posterior probability, which can be found by maximizing a merit function built upon the Onsager--Machlup functional. A common approach used in the engineering literature to obtain the MAP state path is to discretize the dynamics and obtain the MAP state path for the discretized system. In this paper, we prove that if the trapezoidal scheme is used for discretization, then the discretized MAP state path estimation converges hypographically to the continuous-discrete MAP state path estimation as the discretization gets finer. However, if the stochastic Euler scheme is used instead, then the discretized estimation converges to the minimum energy estimation. The minimum energy estimates are, in turn, proved to be the state paths associated with the MAP noise paths, which in some cases differ from the MAP state paths. Therefore, the discretized MAP state paths can have different interpretations depending on the discretization scheme used.
△ Less
Submitted 20 March, 2014;
originally announced March 2014.
