-
Reachable Set Estimation for Neural Network Control Systems: A Simulation-Guided Approach
Authors:
Weiming Xiang,
Hoang-Dung Tran,
Xiaodong Yang,
Taylor T. Johnson
Abstract:
The vulnerability of artificial intelligence (AI) and machine learning (ML) against adversarial disturbances and attacks significantly restricts their applicability in safety-critical systems including cyber-physical systems (CPS) equipped with neural network components at various stages of sensing and control. This paper addresses the reachable set estimation and safety verification problems for…
▽ More
The vulnerability of artificial intelligence (AI) and machine learning (ML) against adversarial disturbances and attacks significantly restricts their applicability in safety-critical systems including cyber-physical systems (CPS) equipped with neural network components at various stages of sensing and control. This paper addresses the reachable set estimation and safety verification problems for dynamical systems embedded with neural network components serving as feedback controllers. The closed-loop system can be abstracted in the form of a continuous-time sampled-data system under the control of a neural network controller. First, a novel reachable set computation method in adaptation to simulations generated out of neural networks is developed. The reachability analysis of a class of feedforward neural networks called multilayer perceptrons (MLP) with general activation functions is performed in the framework of interval arithmetic. Then, in combination with reachability methods developed for various dynamical system classes modeled by ordinary differential equations, a recursive algorithm is developed for over-approximating the reachable set of the closed-loop system. The safety verification for neural network control systems can be performed by examining the emptiness of the intersection between the over-approximation of reachable sets and unsafe sets. The effectiveness of the proposed approach has been validated with evaluations on a robotic arm model and an adaptive cruise control system.
△ Less
Submitted 25 April, 2020;
originally announced April 2020.
-
Dynamic Mode Decomposition for Continuous Time Systems with the Liouville Operator
Authors:
Joel A. Rosenfeld,
Rushikesh Kamalapurkar,
L. Forest Gruss,
Taylor T. Johnson
Abstract:
Dynamic Mode Decomposition (DMD) has become synonymous with the Koopman operator, where continuous time dynamics are examined through a discrete time proxy determined by a fixed timestep using Koopman (i.e. composition) operators. Using the newly introduced "occupation kernels," the present manuscript develops an approach to DMD that treats continuous time dynamics directly through the Liouville o…
▽ More
Dynamic Mode Decomposition (DMD) has become synonymous with the Koopman operator, where continuous time dynamics are examined through a discrete time proxy determined by a fixed timestep using Koopman (i.e. composition) operators. Using the newly introduced "occupation kernels," the present manuscript develops an approach to DMD that treats continuous time dynamics directly through the Liouville operator, which can include Koopman generators. This manuscript outlines the technical and theoretical differences between Koopman based DMD for discrete time systems and Liouville based DMD for continuous time systems, which includes an examination of these operators over several reproducing kernel Hilbert spaces (RKHSs). While Liouville operators are modally unbounded, this manuscript introduces the concept of a scaled Liouville operator, which for many dynamical systems yields a compact operator over the exponential dot product kernel's native space. Hence, norm convergence of the DMD procedure is established when using scaled Liouville operators, which is a decided advantage over Koopman based DMD methods.
△ Less
Submitted 28 May, 2021; v1 submitted 9 October, 2019;
originally announced October 2019.
-
The Occupation Kernel Method for Nonlinear System Identification
Authors:
Joel A. Rosenfeld,
Benjamin Russo,
Rushikesh Kamalapurkar,
Taylor T. Johnson
Abstract:
This manuscript presents a novel approach to nonlinear system identification leveraging densely defined Liouville operators and a new "kernel" function that represents an integration functional over a reproducing kernel Hilbert space (RKHS) dubbed an occupation kernel. The manuscript thoroughly explores the concept of occupation kernels in the contexts of RKHSs of continuous functions, and establi…
▽ More
This manuscript presents a novel approach to nonlinear system identification leveraging densely defined Liouville operators and a new "kernel" function that represents an integration functional over a reproducing kernel Hilbert space (RKHS) dubbed an occupation kernel. The manuscript thoroughly explores the concept of occupation kernels in the contexts of RKHSs of continuous functions, and establishes Liouville operators over RKHS where several dense domains are found for specific examples of this unbounded operator. The combination of these two concepts allow for the embedding of a dynamical system into a RKHS, where function theoretic tools may be leveraged for the examination of such systems. This framework allows for trajectories of a nonlinear dynamical system to be treated as a fundamental unit of data for nonlinear system identification routine. The approach to nonlinear system identification is demonstrated to identify parameters of a dynamical system accurately, while also exhibiting a certain robustness to noise.
△ Less
Submitted 15 June, 2021; v1 submitted 25 September, 2019;
originally announced September 2019.
-
Numerical Verification of Affine Systems with up to a Billion Dimensions
Authors:
Stanley Bak,
Hoang-Dung Tran,
Taylor T. Johnson
Abstract:
Affine systems reachability is the basis of many verification methods. With further computation, methods exist to reason about richer models with inputs, nonlinear differential equations, and hybrid dynamics. As such, the scalability of affine systems verification is a prerequisite to scalable analysis for more complex systems. In this paper, we improve the scalability of affine systems verificati…
▽ More
Affine systems reachability is the basis of many verification methods. With further computation, methods exist to reason about richer models with inputs, nonlinear differential equations, and hybrid dynamics. As such, the scalability of affine systems verification is a prerequisite to scalable analysis for more complex systems. In this paper, we improve the scalability of affine systems verification, in terms of the number of dimensions (variables) in the system.
The reachable states of affine systems can be written in terms of the matrix exponential, and safety checking can be performed at specific time steps with linear programming. Unfortunately, for large systems with many state variables, this direct approach requires an intractable amount of memory while using an intractable amount of computation time. We overcome these challenges by combining several methods that leverage common problem structure. Memory is reduced by exploiting initial states that are not full-dimensional and safety properties (outputs) over a few linear projections of the state variables. Computation time is saved by using numerical simulations to compute only projections of the matrix exponential relevant for the verification problem. Since large systems often have sparse dynamics, we use Krylov-subspace simulation approaches based on the Arnoldi or Lanczos iterations. Our method produces accurate counter-examples when properties are violated and, in the extreme case with sufficient problem structure, can analyze a system with one billion real-valued state variables.
△ Less
Submitted 5 March, 2019; v1 submitted 4 April, 2018;
originally announced April 2018.
