-
On Dynamic Mode Decomposition of Control-affine Systems
Authors:
Moad Abudia,
Joel A. Rosenfeld,
Rushikesh Kamalapurkar
Abstract:
This paper builds on the theoretical foundations for dynamic mode decomposition (DMD) of control-affine dynamical systems by leveraging the theory of vector-valued reproducing kernel Hilbert spaces (RKHSs). Specifically, control Liouville operators and control occupation kernels are used to separate the drift dynamics from the input dynamics. A provably convergent finite-rank estimation of a compa…
▽ More
This paper builds on the theoretical foundations for dynamic mode decomposition (DMD) of control-affine dynamical systems by leveraging the theory of vector-valued reproducing kernel Hilbert spaces (RKHSs). Specifically, control Liouville operators and control occupation kernels are used to separate the drift dynamics from the input dynamics. A provably convergent finite-rank estimation of a compact control Liouville operator is obtained, provided sufficiently rich data are available. A matrix representation of the finite-rank operator is used to construct a data-driven representation of its singular values, left singular functions, and right singular functions. The singular value decomposition is used to generate a data-driven model of the control-affine nonlinear system. The developed method generates a model that can be used to predict the trajectories of the system in response to any admissible control input. Numerical experiments are included to demonstrate the efficacy of the developed technique.
△ Less
Submitted 13 March, 2025;
originally announced March 2025.
-
On Convergent Dynamic Mode Decomposition and its Equivalence with Occupation Kernel Regression
Authors:
Moad Abudia,
Joel A. Rosenfeld,
Rushikesh Kamalapurkar
Abstract:
This paper presents a new technique for norm-convergent dynamic mode decomposition of deterministic systems. The developed method utilizes recent results on singular dynamic mode decomposition where it is shown that by appropriate selection of domain and range Hilbert spaces, the Liouville operator (also known as the Koopman generator) can be made to be compact. In this paper, it is shown that by…
▽ More
This paper presents a new technique for norm-convergent dynamic mode decomposition of deterministic systems. The developed method utilizes recent results on singular dynamic mode decomposition where it is shown that by appropriate selection of domain and range Hilbert spaces, the Liouville operator (also known as the Koopman generator) can be made to be compact. In this paper, it is shown that by selecting appropriate collections of finite basis functions in the domain and the range, a novel finite-rank representation of the Liouville operator may be obtained. It is also shown that the model resulting from dynamic mode decomposition of the finite-rank representation is closely related to regularized regression using the so-called occupation kernels as basis functions.
△ Less
Submitted 18 September, 2024;
originally announced September 2024.
-
Carleman Lifting for Nonlinear System Identification with Guaranteed Error Bounds
Authors:
Moad Abudia,
Joel A. Rosenfeld,
Rushikesh Kamalapurkar
Abstract:
This paper concerns identification of uncontrolled or closed loop nonlinear systems using a set of trajectories that are generated by the system in a domain of attraction. The objective is to ensure that the trajectories of the identified systems are close to the trajectories of the real system, as quantified by an error bound that is prescribed a priori. A majority of existing methods for nonline…
▽ More
This paper concerns identification of uncontrolled or closed loop nonlinear systems using a set of trajectories that are generated by the system in a domain of attraction. The objective is to ensure that the trajectories of the identified systems are close to the trajectories of the real system, as quantified by an error bound that is prescribed a priori. A majority of existing methods for nonlinear system identification rely on techniques such as neural networks, autoregressive moving averages, and spectral decomposition that do not provide systematic approaches to meet pre-defined error bounds. The developed method is based on Carleman linearization-based lifting of the nonlinear system to an infinite dimensional linear system. The linear system is then truncated to a suitable order, computed based on the prescribed error bound, and parameters of the truncated linear system are estimated from data. The effectiveness of the technique is demonstrated by identifying an approximation of the Van der Pol oscillator from data within a prescribed error bound.
△ Less
Submitted 22 October, 2022; v1 submitted 30 May, 2022;
originally announced May 2022.
-
Singular Dynamic Mode Decompositions
Authors:
Joel A. Rosenfeld,
Rushikesh Kamalapurkar
Abstract:
This manuscript is aimed at addressing several long standing limitations of dynamic mode decompositions in the application of Koopman analysis. Principle among these limitations are the convergence of associated Dynamic Mode Decomposition algorithms and the existence of Koopman modes. To address these limitations, two major modifications are made, where Koopman operators are removed from the analy…
▽ More
This manuscript is aimed at addressing several long standing limitations of dynamic mode decompositions in the application of Koopman analysis. Principle among these limitations are the convergence of associated Dynamic Mode Decomposition algorithms and the existence of Koopman modes. To address these limitations, two major modifications are made, where Koopman operators are removed from the analysis in light of Liouville operators (known as Koopman generators in special cases), and these operators are shown to be compact for certain pairs of Hilbert spaces selected separately as the domain and range of the operator. While eigenfunctions are discarded in the general analysis, a viable reconstruction algorithm is still demonstrated, and the sacrifice of eigenfunctions realizes the theoretical goals of DMD analysis that have yet to be achieved in other contexts. However, in the case where the domain is embedded in the range, an eigenfunction approach is still achievable, where a more typical DMD routine is established, but that leverages a finite rank representation that converges in norm. The manuscript concludes with the description of two Dynamic Mode Decomposition algorithms that converges when a dense collection of occupation kernels, arising from the data, are leveraged in the analysis.
△ Less
Submitted 13 June, 2021; v1 submitted 6 June, 2021;
originally announced June 2021.
-
An occupation kernel approach to optimal control
Authors:
Rushikesh Kamalapurkar,
Joel A. Rosenfeld
Abstract:
In this effort, a novel operator theoretic framework is developed for data-driven solution of optimal control problems. The developed methods focus on the use of trajectories (i.e., time-series) as the fundamental unit of data for the resolution of optimal control problems in dynamical systems. Trajectory information in the dynamical systems is embedded in a reproducing kernel Hilbert space (RKHS)…
▽ More
In this effort, a novel operator theoretic framework is developed for data-driven solution of optimal control problems. The developed methods focus on the use of trajectories (i.e., time-series) as the fundamental unit of data for the resolution of optimal control problems in dynamical systems. Trajectory information in the dynamical systems is embedded in a reproducing kernel Hilbert space (RKHS) through what are called occupation kernels. The occupation kernels are tied to the dynamics of the system through the densely defined Liouville operator. The pairing of Liouville operators and occupation kernels allows for lifting of nonlinear finite-dimensional optimal control problems into the space of infinite-dimensional linear programs over RKHSs.
△ Less
Submitted 1 June, 2021;
originally announced June 2021.
-
The kernel perspective on dynamic mode decomposition
Authors:
Efrain Gonzalez,
Moad Abudia,
Michael Jury,
Rushikesh Kamalapurkar,
Joel A. Rosenfeld
Abstract:
This manuscript revisits theoretical assumptions concerning dynamic mode decomposition (DMD) of Koopman operators, including the existence of lattices of eigenfunctions, common eigenfunctions between Koopman operators, and boundedness and compactness of Koopman operators. Counterexamples that illustrate restrictiveness of the assumptions are provided for each of the assumptions. In particular, thi…
▽ More
This manuscript revisits theoretical assumptions concerning dynamic mode decomposition (DMD) of Koopman operators, including the existence of lattices of eigenfunctions, common eigenfunctions between Koopman operators, and boundedness and compactness of Koopman operators. Counterexamples that illustrate restrictiveness of the assumptions are provided for each of the assumptions. In particular, this manuscript proves that the native reproducing kernel Hilbert space (RKHS) of the Gaussian RBF kernel function only supports bounded Koopman operators if the dynamics are affine. In addition, a new framework for DMD, that requires only densely defined Koopman operators over RKHSs is introduced, and its effectiveness is demonstrated through numerical examples.
△ Less
Submitted 17 April, 2023; v1 submitted 31 May, 2021;
originally announced June 2021.
-
Control Occupation Kernel Regression for Nonlinear Control-Affine Systems
Authors:
Moad Abudia,
Tejasvi Channagiri,
Joel A. Rosenfeld,
Rushikesh Kamalapurkar
Abstract:
This manuscript presents an algorithm for obtaining an approximation of nonlinear high order control affine dynamical systems, that leverages the controlled trajectories as the central unit of information. As the fundamental basis elements leveraged in approximation, higher order control occupation kernels represent iterated integration after multiplication by a given controller in a vector valued…
▽ More
This manuscript presents an algorithm for obtaining an approximation of nonlinear high order control affine dynamical systems, that leverages the controlled trajectories as the central unit of information. As the fundamental basis elements leveraged in approximation, higher order control occupation kernels represent iterated integration after multiplication by a given controller in a vector valued reproducing kernel Hilbert space. In a regularized regression setting, the unique optimizer for a particular optimization problem is expressed as a linear combination of these occupation kernels, which converts an infinite dimensional optimization problem to a finite dimensional optimization problem through the representer theorem. Interestingly, the vector valued structure of the Hilbert space allows for simultaneous approximation of the drift and control effectiveness components of the control affine system. Several experiments are performed to demonstrate the effectiveness of the approach.
△ Less
Submitted 31 May, 2021;
originally announced June 2021.
-
Reachable Set Estimation and Safety Verification for Piecewise Linear Systems with Neural Network Controllers
Authors:
Weiming Xiang,
Hoang-Dung Tran,
Joel A. Rosenfeld,
Taylor T. Johnson
Abstract:
In this work, the reachable set estimation and safety verification problems for a class of piecewise linear systems equipped with neural network controllers are addressed. The neural network is considered to consist of Rectified Linear Unit (ReLU) activation functions. A layer-by-layer approach is developed for the output reachable set computation of ReLU neural networks. The computation is formul…
▽ More
In this work, the reachable set estimation and safety verification problems for a class of piecewise linear systems equipped with neural network controllers are addressed. The neural network is considered to consist of Rectified Linear Unit (ReLU) activation functions. A layer-by-layer approach is developed for the output reachable set computation of ReLU neural networks. The computation is formulated in the form of a set of manipulations for a union of polytopes. Based on the output reachable set for neural network controllers, the output reachable set for a piecewise linear feedback control system can be estimated iteratively for a given finite-time interval. With the estimated output reachable set, the safety verification for piecewise linear systems with neural network controllers can be performed by checking the existence of intersections of unsafe regions and output reach set. A numerical example is presented to illustrate the effectiveness of our approach.
△ Less
Submitted 20 February, 2018;
originally announced February 2018.
-
Invariance-like results for Nonautonomous Switched Systems
Authors:
Rushikesh Kamalapurkar,
Joel A. Rosenfeld,
Anup Parikh,
Andrew R. Teel,
Warren E. Dixon
Abstract:
This paper generalizes the Lasalle-Yoshizawa Theorem to switched nonsmooth systems. Filippov and Krasovskii regularizations of a switched system are shown to be contained within the convex hull of the Filippov and Krasovskii regularizations of the subsystems, respectively. A candidate common Lyapunov function that has a negative semidefinite derivative along the trajectories of the subsystems is s…
▽ More
This paper generalizes the Lasalle-Yoshizawa Theorem to switched nonsmooth systems. Filippov and Krasovskii regularizations of a switched system are shown to be contained within the convex hull of the Filippov and Krasovskii regularizations of the subsystems, respectively. A candidate common Lyapunov function that has a negative semidefinite derivative along the trajectories of the subsystems is shown to be sufficient to establish LaSalle-Yoshizawa results for the switched system. Results for regular and non-regular candidate Lyapunov functions are presented using an appropriate generalization of the time derivative. The developed generalization is motivated by adaptive control of switched systems where the derivative of the candidate Lyapunov function is typically negative semidefinite.
△ Less
Submitted 29 August, 2017; v1 submitted 19 September, 2016;
originally announced September 2016.
-
Efficient model-based reinforcement learning for approximate online optimal
Authors:
Rushikesh Kamalapurkar,
Joel A. Rosenfeld,
Warren E. Dixon
Abstract:
In this paper the infinite horizon optimal regulation problem is solved online for a deterministic control-affine nonlinear dynamical system using the state following (StaF) kernel method to approximate the value function. Unlike traditional methods that aim to approximate a function over a large compact set, the StaF kernel method aims to approximate a function in a small neighborhood of a state…
▽ More
In this paper the infinite horizon optimal regulation problem is solved online for a deterministic control-affine nonlinear dynamical system using the state following (StaF) kernel method to approximate the value function. Unlike traditional methods that aim to approximate a function over a large compact set, the StaF kernel method aims to approximate a function in a small neighborhood of a state that travels within a compact set. Simulation results demonstrate that stability and approximate optimality of the control system can be achieved with significantly fewer basis functions than may be required for global approximation methods.
△ Less
Submitted 9 February, 2015;
originally announced February 2015.
-
Decentralized formation control with connectivity maintenance and collision avoidance under limited and intermittent sensing
Authors:
Teng-Hu Cheng,
Zhen Kan,
Joel A. Rosenfeld,
Warren E. Dixon
Abstract:
A decentralized switched controller is developed for dynamic agents to perform global formation configuration convergence while maintaining network connectivity and avoiding collision within agents and between stationary obstacles, using only local feedback under limited and intermittent sensing. Due to the intermittent sensing, constant position feedback may not be available for agents all the ti…
▽ More
A decentralized switched controller is developed for dynamic agents to perform global formation configuration convergence while maintaining network connectivity and avoiding collision within agents and between stationary obstacles, using only local feedback under limited and intermittent sensing. Due to the intermittent sensing, constant position feedback may not be available for agents all the time. Intermittent sensing can also lead to a disconnected network or collisions between agents. Using a navigation function framework, a decentralized switched controller is developed to navigate the agents to the desired positions while ensuring network maintenance and collision avoidance.
△ Less
Submitted 1 October, 2013;
originally announced October 2013.
-
Supporting Lemmas for RISE-based Control Methods
Authors:
Rushikesh Kamalapurkar,
Joel A. Rosenfeld,
Justin Klotz,
Ryan J. Downey,
Warren E. Dixon
Abstract:
A class of continuous controllers termed Robust Integral of the Signum of the Error (RISE) have been published over the last decade as a means to yield asymptotic convergence of the tracking error for classes of nonlinear systems that are subject to exogenous disturbances and/or modeling uncertainties. The development of this class of controllers relies on a property related to the integral of the…
▽ More
A class of continuous controllers termed Robust Integral of the Signum of the Error (RISE) have been published over the last decade as a means to yield asymptotic convergence of the tracking error for classes of nonlinear systems that are subject to exogenous disturbances and/or modeling uncertainties. The development of this class of controllers relies on a property related to the integral of the signum of an error signal. A proof for this property is not available in previous literature. The stability of some RISE controllers is analyzed using differential inclusions. Such results rely on the hypothesis that a set of points is Lebesgue negligible. This paper states and proves two lemmas related to the properties.
△ Less
Submitted 26 May, 2015; v1 submitted 14 June, 2013;
originally announced June 2013.
