-
Noise Sensitivity of the Semidefinite Programs for Direct Data-Driven LQR
Authors:
Xiong Zeng,
Laurent Bako,
Necmiye Ozay
Abstract:
In this paper, we study the noise sensitivity of the semidefinite program (SDP) proposed for direct data-driven infinite-horizon linear quadratic regulator (LQR) problem for discrete-time linear time-invariant systems. While this SDP is shown to find the true LQR controller in the noise-free setting, we show that it leads to a trivial solution with zero gain matrices when data is corrupted by nois…
▽ More
In this paper, we study the noise sensitivity of the semidefinite program (SDP) proposed for direct data-driven infinite-horizon linear quadratic regulator (LQR) problem for discrete-time linear time-invariant systems. While this SDP is shown to find the true LQR controller in the noise-free setting, we show that it leads to a trivial solution with zero gain matrices when data is corrupted by noise, even when the noise is arbitrarily small. We then study a variant of the SDP that includes a robustness promoting regularization term and prove that regularization does not fully eliminate the sensitivity issue. In particular, the solution of the regularized SDP converges in probability also to a trivial solution.
△ Less
Submitted 27 December, 2024;
originally announced December 2024.
-
Minimal L2-Consistent Data-Transmission
Authors:
Antoine Aspeel,
Laurent Bako,
Necmiye Ozay
Abstract:
In this work, we consider non-collocated sensors and actuators, and we address the problem of minimizing the number of sensor-to-actuator transmissions while ensuring that the L2 gain of the system remains under a threshold. By using causal factorization and system level synthesis, we reformulate this problem as a rank minimization problem over a convex set. When heuristics like nuclear norm minim…
▽ More
In this work, we consider non-collocated sensors and actuators, and we address the problem of minimizing the number of sensor-to-actuator transmissions while ensuring that the L2 gain of the system remains under a threshold. By using causal factorization and system level synthesis, we reformulate this problem as a rank minimization problem over a convex set. When heuristics like nuclear norm minimization are used for rank minimization, the resulting matrix is only numerically low rank and must be truncated, which can lead to an infeasible solution. To address this issue, we introduce approximate causal factorization to control the factorization error and provide a bound on the degradation of the L2 gain in terms of the factorization error. The effectiveness of our method is demonstrated using a benchmark.
△ Less
Submitted 7 August, 2024;
originally announced August 2024.
-
Proximal observers for secure state estimation
Authors:
Laurent Bako,
Madiha Nadri,
Vincent Andrieu,
Qinghua Zhang
Abstract:
This paper discusses a general framework for designing robust state estimators for a class of discrete-time nonlinear systems. We consider systems that may be impacted by impulsive (sparse but otherwise arbitrary) measurement noise sequences. We show that a family of state estimators, robust to this type of undesired signal, can be obtained by minimizing a class of nonsmooth convex functions at ea…
▽ More
This paper discusses a general framework for designing robust state estimators for a class of discrete-time nonlinear systems. We consider systems that may be impacted by impulsive (sparse but otherwise arbitrary) measurement noise sequences. We show that a family of state estimators, robust to this type of undesired signal, can be obtained by minimizing a class of nonsmooth convex functions at each time step. The resulting state observers are defined through proximal operators. We obtain a nonlinear implicit dynamical system in term of estimation error and prove, in the noise-free setting, that it vanishes asymptotically when the minimized loss function and the to-be-observed system enjoy appropriate properties. From a computational perspective, even though the proposed observers can be implemented via efficient numerical procedures, they do not admit closed-form expressions. The paper argues that by adopting appropriate relaxations, simple and fast analytic expressions can be derived.
△ Less
Submitted 20 August, 2024; v1 submitted 11 January, 2024;
originally announced January 2024.
-
Minimality and identifiability of discrete-time SARX systems
Authors:
M. Petreczky,
L. Bako,
S. Lecoeuche,
K. M. D. Motchon
Abstract:
The paper studies the problem of minimality and identifiability for Switched Auto-Regressive eXogenous (abbreviated by SARX) systems. We propose formal definitions of the concepts of identifiability and minimality for SARX models. Based on these formalizations, we derive conditions for minimality and identifiability of SARX systems. In particular, we show that polynomially parametrized SARX system…
▽ More
The paper studies the problem of minimality and identifiability for Switched Auto-Regressive eXogenous (abbreviated by SARX) systems. We propose formal definitions of the concepts of identifiability and minimality for SARX models. Based on these formalizations, we derive conditions for minimality and identifiability of SARX systems. In particular, we show that polynomially parametrized SARX systems are generically identifiable.
△ Less
Submitted 5 February, 2020;
originally announced February 2020.
-
State and parameter estimation: a nonlinear Luenberger observer approach
Authors:
Chouaib Afri,
Vincent Andrieu,
Laurent Bako,
Pascal Dufour
Abstract:
The design of a nonlinear Luenberger observer for a parametrized linear SISO (single-input single-output) system is studied. From an observability assumption of the system, the existence of such an observer is concluded. In a second step, a novel algorithm for the identification of such systems is suggested and is implemented on a third order system. Compared to the adaptive observer available in…
▽ More
The design of a nonlinear Luenberger observer for a parametrized linear SISO (single-input single-output) system is studied. From an observability assumption of the system, the existence of such an observer is concluded. In a second step, a novel algorithm for the identification of such systems is suggested and is implemented on a third order system. Compared to the adaptive observer available in the litterature, it has the advantage to be of low dimension and to admit a strict Lyapunov function. This is a long version of a paper which is published in IEEE TAC 2017.
△ Less
Submitted 10 May, 2016; v1 submitted 24 November, 2015;
originally announced November 2015.
-
Analysis of A Nonsmooth Optimization Approach to Robust Estimation
Authors:
Laurent Bako,
Henrik Ohlsson
Abstract:
In this paper, we consider the problem of identifying a linear map from measurements which are subject to intermittent and arbitarily large errors. This is a fundamental problem in many estimation-related applications such as fault detection, state estimation in lossy networks, hybrid system identification, robust estimation, etc. The problem is hard because it exhibits some intrinsic combinatoria…
▽ More
In this paper, we consider the problem of identifying a linear map from measurements which are subject to intermittent and arbitarily large errors. This is a fundamental problem in many estimation-related applications such as fault detection, state estimation in lossy networks, hybrid system identification, robust estimation, etc. The problem is hard because it exhibits some intrinsic combinatorial features. Therefore, obtaining an effective solution necessitates relaxations that are both solvable at a reasonable cost and effective in the sense that they can return the true parameter vector. The current paper discusses a nonsmooth convex optimization approach and provides a new analysis of its behavior. In particular, it is shown that under appropriate conditions on the data, an exact estimate can be recovered from data corrupted by a large (even infinite) number of gross errors.
△ Less
Submitted 7 August, 2016; v1 submitted 8 February, 2014;
originally announced February 2014.
-
A numerical solution to the minimum-time control problem for linear discrete-time systems
Authors:
Laurent Bako,
Dulin Chen,
Stéphane Lecoeuche
Abstract:
The minimum-time control problem consists in finding a control policy that will drive a given dynamic system from a given initial state to a given target state (or a set of states) as quickly as possible. This is a well-known challenging problem in optimal control theory for which closed-form solutions exist only for a few systems of small dimensions. This paper presents a very generic solution to…
▽ More
The minimum-time control problem consists in finding a control policy that will drive a given dynamic system from a given initial state to a given target state (or a set of states) as quickly as possible. This is a well-known challenging problem in optimal control theory for which closed-form solutions exist only for a few systems of small dimensions. This paper presents a very generic solution to the minimum-time problem for arbitrary discrete-time linear systems. It is a numerical solution based on sparse optimization, that is the minimization of the number of nonzero elements in the state sequence over a fixed control horizon. We consider both single input and multiple inputs systems. An important observation is that, contrary to the continuous-time case, the minimum-time control for discrete-time systems is not necessarily entirely bang-bang.
△ Less
Submitted 11 October, 2011; v1 submitted 17 September, 2011;
originally announced September 2011.
-
On the notion of persistence of excitation for linear switched systems
Authors:
Mihaly Petreczky,
Laurent Bako
Abstract:
The paper formulates the concept of persistence of excitation for discrete-time linear switched systems, and provides sufficient conditions for an input signal to be persistently exciting. Persistence of excitation is formulated as a property of the input signal, and it is not tied to any specific identification algorithm. The results of the paper rely on realization theory and on the notion of Ma…
▽ More
The paper formulates the concept of persistence of excitation for discrete-time linear switched systems, and provides sufficient conditions for an input signal to be persistently exciting. Persistence of excitation is formulated as a property of the input signal, and it is not tied to any specific identification algorithm. The results of the paper rely on realization theory and on the notion of Markov-parameters for linear switched systems.
△ Less
Submitted 7 March, 2011;
originally announced March 2011.
-
Realization theory of discrete-time linear switched systems
Authors:
Mihaly Petreczy,
Laurent Bako,
Jan H. van Schuppen
Abstract:
The paper presents realization theory of discrete-time linear switched systems. A discrete-time linear switched system is a hybrid system, such that the continuous sub-system associated with each discrete state is linear. In this paper we present necessary and sufficient conditions for an input-output map to admit a discrete-time linear switched state-space realization. The conditions are formulat…
▽ More
The paper presents realization theory of discrete-time linear switched systems. A discrete-time linear switched system is a hybrid system, such that the continuous sub-system associated with each discrete state is linear. In this paper we present necessary and sufficient conditions for an input-output map to admit a discrete-time linear switched state-space realization. The conditions are formulated as finite rank conditions of a generalized Hankel-matrix. In addition, we present a characterization of minimality of discrete-time linear switched systems in terms of reachability and observable.Further, we prove that minimal realizations are unique up to isomorphism. We also discuss procedures for converting a linear switched system to a minimal one and we present an algorithm for constructing a state-space representation from input-output data.The paper uses the theory rational formal power series in non-commutative variables. The latter theory was successfully applied to bilinear and state-affine systems in the past.
△ Less
Submitted 23 February, 2012; v1 submitted 7 March, 2011;
originally announced March 2011.
