Showing 1–29 of 29 results for author: Sanfelice, R

HyRRT-Connect: Bidirectional Motion Planning for Hybrid Dynamical Systems

Authors: Nan Wang, Ricardo G. Sanfelice

Abstract: This paper proposes a bidirectional rapidly-exploring random trees (RRT) algorithm to solve the motion planning problem for hybrid systems. The proposed algorithm, called HyRRT-Connect, propagates in both forward and backward directions in hybrid time until an overlap between the forward and backward propagation results is detected. Then, HyRRT-Connect constructs a motion plan through the reversal… ▽ More This paper proposes a bidirectional rapidly-exploring random trees (RRT) algorithm to solve the motion planning problem for hybrid systems. The proposed algorithm, called HyRRT-Connect, propagates in both forward and backward directions in hybrid time until an overlap between the forward and backward propagation results is detected. Then, HyRRT-Connect constructs a motion plan through the reversal and concatenation of functions defined on hybrid time domains, ensuring that the motion plan satisfies the given hybrid dynamics. To address the potential discontinuity along the flow caused by tolerating some distance between the forward and backward partial motion plans, we reconstruct the backward partial motion plan by a forward-in-hybrid-time simulation from the final state of the forward partial motion plan. effectively eliminating the discontinuity. The proposed algorithm is applied to an actuated bouncing ball system and a walking robot example to highlight its computational improvement. △ Less

Submitted 14 April, 2025; originally announced April 2025.

Comments: 59 pages, 9 figures, submitted to IJRR. arXiv admin note: substantial text overlap with arXiv:2403.18413; text overlap with arXiv:2406.01802

A Hybrid Systems Model of Feedback Optimization for Linear Systems

Authors: Oscar Jed Chuy, Matthew Hale, Ricardo Sanfelice

Abstract: Feedback optimization algorithms compute inputs to a system in real time, which helps mitigate the effects of unknown disturbances. However, existing work models both system dynamics and computations in either discrete or continuous time, which does not faithfully model some applications. In this work, we model linear system dynamics in continuous time, and we model the computations of inputs in d… ▽ More Feedback optimization algorithms compute inputs to a system in real time, which helps mitigate the effects of unknown disturbances. However, existing work models both system dynamics and computations in either discrete or continuous time, which does not faithfully model some applications. In this work, we model linear system dynamics in continuous time, and we model the computations of inputs in discrete time. Therefore, we present a novel hybrid systems framework for modeling feedback optimization of linear time-invariant systems that are subject to unknown, constant disturbances. For this setup, we first establish the well-posedness of the hybrid model and establish completeness of solutions while ruling out Zeno behavior. Then, our main result derives a convergence rate and an error bound for the full hybrid computation-in-theloop system and shows that it converges exponentially towards a ball of known radius about a desired fixed point. Simulation results show that this approach successfully mitigates the effects of disturbances, with the magnitude of steady-state error being 81% less than the magnitude of the disturbances in the system. △ Less

Submitted 22 May, 2025; v1 submitted 31 March, 2025; originally announced April 2025.

Comments: 14 Pages, 3 Figures, submitted to Conference on Decision and Control 2025

A Safe Hybrid Control Framework for Car-like Robot with Guaranteed Global Path-Invariance using a Control Barrier Function

Authors: Nan Wang, Adeel Akhtar, Ricardo G. Sanfelice

Abstract: This work proposes a hybrid framework for car-like robots with obstacle avoidance, global convergence, and safety, where safety is interpreted as path invariance, namely, once the robot converges to the path, it never leaves the path. Given a priori obstacle-free feasible path where obstacles can be around the path, the task is to avoid obstacles while reaching the path and then staying on the pat… ▽ More This work proposes a hybrid framework for car-like robots with obstacle avoidance, global convergence, and safety, where safety is interpreted as path invariance, namely, once the robot converges to the path, it never leaves the path. Given a priori obstacle-free feasible path where obstacles can be around the path, the task is to avoid obstacles while reaching the path and then staying on the path without leaving it. The problem is solved in two stages. Firstly, we define a ``tight'' obstacle-free neighborhood along the path and design a local controller to ensure convergence to the path and path invariance. The control barrier function technology is involved in the control design to steer the system away from its singularity points, where the local path invariant controller is not defined. Secondly, we design a hybrid control framework that integrates this local path-invariant controller with any global tracking controller from the existing literature without path invariance guarantee, ensuring convergence from any position to the desired path, namely, global convergence. This framework guarantees path invariance and robustness to sensor noise. Detailed simulation results affirm the effectiveness of the proposed scheme. △ Less

Submitted 10 February, 2025; originally announced February 2025.

Comments: 9 pages, 9 figures, initial submission to CCTA25

Two-Player Zero-Sum Hybrid Games

Authors: Santiago J. Leudo, Ricardo G. Sanfelice

Abstract: In this paper, we formulate a two-player zero-sum game under dynamic constraints defined by hybrid dynamical equations. The game consists of a min-max problem involving a cost functional that depends on the actions and resulting solutions to the hybrid system, defined as functions of hybrid time and, hence, can flow or jump. A terminal set conveniently defined allows to recast both finite and infi… ▽ More In this paper, we formulate a two-player zero-sum game under dynamic constraints defined by hybrid dynamical equations. The game consists of a min-max problem involving a cost functional that depends on the actions and resulting solutions to the hybrid system, defined as functions of hybrid time and, hence, can flow or jump. A terminal set conveniently defined allows to recast both finite and infinite horizon problems. We present sufficient conditions given in terms of Hamilton-Jacobi-Bellman-Isaacs-like equations to guarantee to attain a solution to the game. It is shown that when the players select the optimal strategy, the value function can be evaluated without computing solutions to the hybrid system. Under additional conditions, we show that the optimal state-feedback laws render a set of interest asymptotically stable for the resulting hybrid closed-loop system. Applications of these games, presented here as robust control problems, include disturbance rejection and security problems. △ Less

Submitted 16 May, 2025; v1 submitted 14 July, 2024; originally announced July 2024.

Comments: 21 pages

Motion Planning for Hybrid Dynamical Systems: Framework, Algorithm Template, and a Sampling-based Approach

Authors: Nan Wang, Ricardo G. Sanfelice

Abstract: This paper focuses on the motion planning problem for the systems exhibiting both continuous and discrete behaviors, which we refer to as hybrid dynamical systems. Firstly, the motion planning problem for hybrid systems is formulated using the hybrid equation framework, which is general to capture most hybrid systems. Secondly, a propagation algorithm template is proposed that describes a general… ▽ More This paper focuses on the motion planning problem for the systems exhibiting both continuous and discrete behaviors, which we refer to as hybrid dynamical systems. Firstly, the motion planning problem for hybrid systems is formulated using the hybrid equation framework, which is general to capture most hybrid systems. Secondly, a propagation algorithm template is proposed that describes a general framework to solve the motion planning problem for hybrid systems. Thirdly, a rapidly-exploring random trees (RRT) implementation of the proposed algorithm template is designed to solve the motion planning problem for hybrid systems. At each iteration, the proposed algorithm, called HyRRT, randomly picks a state sample and extends the search tree by flow or jump, which is also chosen randomly when both regimes are possible. Through a definition of concatenation of functions defined on hybrid time domains, we show that HyRRT is probabilistically complete, namely, the probability of failing to find a motion plan approaches zero as the number of iterations of the algorithm increases. This property is guaranteed under mild conditions on the data defining the motion plan, which include a relaxation of the usual positive clearance assumption imposed in the literature of classical systems. The motion plan is computed through the solution of two optimization problems, one associated with the flow and the other with the jumps of the system. The proposed algorithm is applied to an actuated bouncing ball system and a walking robot system so as to highlight its generality and computational features. △ Less

Submitted 3 June, 2024; originally announced June 2024.

Comments: 33 pages, 8 figures. Submitted to IJRR. arXiv admin note: text overlap with arXiv:2210.15082

HyRRT-Connect: A Bidirectional Rapidly-Exploring Random Trees Motion Planning Algorithm for Hybrid Systems

Authors: Nan Wang, Ricardo G. Sanfelice

Abstract: This paper proposes a bidirectional rapidly-exploring random trees (RRT) algorithm to solve the motion planning problem for hybrid systems. The proposed algorithm, called HyRRT-Connect, propagates in both forward and backward directions in hybrid time until an overlap between the forward and backward propagation results is detected. Then, HyRRT-Connect constructs a motion plan through the reversal… ▽ More This paper proposes a bidirectional rapidly-exploring random trees (RRT) algorithm to solve the motion planning problem for hybrid systems. The proposed algorithm, called HyRRT-Connect, propagates in both forward and backward directions in hybrid time until an overlap between the forward and backward propagation results is detected. Then, HyRRT-Connect constructs a motion plan through the reversal and concatenation of functions defined on hybrid time domains, ensuring the motion plan thoroughly satisfies the given hybrid dynamics. To address the potential discontinuity along the flow caused by tolerating some distance between the forward and backward partial motion plans, we reconstruct the backward partial motion plan by a forward-in-hybrid-time simulation from the final state of the forward partial motion plan. By applying the reversed input of the backward partial motion plan, the reconstruction process effectively eliminates the discontinuity and ensures that as the tolerance distance decreases to zero, the distance between the endpoint of the reconstructed motion plan and the final state set approaches zero. The proposed algorithm is applied to an actuated bouncing ball example and a walking robot example so as to highlight its generality and computational improvement. △ Less

Submitted 29 March, 2024; v1 submitted 27 March, 2024; originally announced March 2024.

Comments: Accepted by the 8th IFAC International Conference on Analysis and Design of Hybrid Systems (ADHS 2024)

Deep Nonlinear Adaptive Control for Unmanned Aerial Systems Operating under Dynamic Uncertainties

Authors: Zachary Lamb, Zachary I. Bell, Matthew Longmire, Jared Paquet, Prashant Ganesh, Ricardo Sanfelice

Abstract: Recent literature in the field of machine learning (ML) control has shown promising theoretical results for a Deep Neural Network (DNN) based Nonlinear Adaptive Controller (DNAC) capable of achieving trajectory tracking for nonlinear systems. Expanding on this work, this paper applies DNAC to the Attitude Control System (ACS) of a quadrotor and shows improvement to attitude control performance und… ▽ More Recent literature in the field of machine learning (ML) control has shown promising theoretical results for a Deep Neural Network (DNN) based Nonlinear Adaptive Controller (DNAC) capable of achieving trajectory tracking for nonlinear systems. Expanding on this work, this paper applies DNAC to the Attitude Control System (ACS) of a quadrotor and shows improvement to attitude control performance under disturbed flying conditions where the model uncertainty is high. Moreover, these results are noteworthy for ML control because they were achieved with no prior training data and an arbitrary system dynamics initialization; simply put, the controller presented in this paper is practically modelless, yet yields the ability to force trajectory tracking for nonlinear systems while rejecting significant undesirable model disturbances learned through a DNN. The combination of ML techniques to learn a system's dynamics and the Lyapunov analysis required to provide stability guarantees leads to a controller with applications in safety-critical systems that may undergo uncertain model changes, as is the case for most aerial systems. Experimental findings are analyzed in the final section of this paper, and DNAC is shown to outperform the trajectory tracking capabilities of PID, MRAC, and the recently developed Deep Model Reference Adaptive Control (DMRAC) schemes. △ Less

Submitted 14 October, 2023; originally announced October 2023.

HySST: A Stable Sparse Rapidly-Exploring Random Trees Optimal Motion Planning Algorithm for Hybrid Dynamical Systems

Authors: Nan Wang, Ricardo G. Sanfelice

Abstract: This paper proposes a stable sparse rapidly-exploring random trees (SST) algorithm to solve the optimal motion planning problem for hybrid systems. At each iteration, the proposed algorithm, called HySST, selects a vertex with the lowest cost among all the vertices within the neighborhood of a randomly selected sample and then extends the search tree by flow or jump, which is also chosen randomly… ▽ More This paper proposes a stable sparse rapidly-exploring random trees (SST) algorithm to solve the optimal motion planning problem for hybrid systems. At each iteration, the proposed algorithm, called HySST, selects a vertex with the lowest cost among all the vertices within the neighborhood of a randomly selected sample and then extends the search tree by flow or jump, which is also chosen randomly when both regimes are possible. In addition, HySST maintains a static set of witness points such that all the vertices within the neighborhood of each witness are pruned except the vertex with the lowest cost. Through a definition of concatenation of functions defined on hybrid time domains, we show that HySST is asymptotically near optimal, namely, the probability of failing to find a motion plan such that its cost is close to the optimal cost approaches zero as the number of iterations of the algorithm increases to infinity. This property is guaranteed under mild conditions on the data defining the motion plan, which include a relaxation of the usual positive clearance assumption imposed in the literature of classical systems. The proposed algorithm is applied to an actuated bouncing ball system and a collision-resilient tensegrity multicopter system so as to highlight its generality and computational features. △ Less

Submitted 29 May, 2023; originally announced May 2023.

Comments: This paper has been submitted to the 2023 Conference of Decision and Control (CDC). arXiv admin note: substantial text overlap with arXiv:2210.15082

ACM Class: I.2.9

An Observer-based Switching Algorithm for Safety under Sensor Denial-of-Service Attacks

Authors: Santiago Jimenez Leudo, Kunal Garg, Ricardo G. Sanfelice, Alvaro A. Cardenas

Abstract: The design of safe-critical control algorithms for systems under Denial-of-Service (DoS) attacks on the system output is studied in this work. We aim to address scenarios where attack-mitigation approaches are not feasible, and the system needs to maintain safety under adversarial attacks. We propose an attack-recovery strategy by designing a switching observer and characterizing bounds in the err… ▽ More The design of safe-critical control algorithms for systems under Denial-of-Service (DoS) attacks on the system output is studied in this work. We aim to address scenarios where attack-mitigation approaches are not feasible, and the system needs to maintain safety under adversarial attacks. We propose an attack-recovery strategy by designing a switching observer and characterizing bounds in the error of a state estimation scheme by specifying tolerable limits on the time length of attacks. Then, we propose a switching control algorithm that renders forward invariant a set for the observer. Thus, by satisfying the error bounds of the state estimation, we guarantee that the safe set is rendered conditionally invariant with respect to a set of initial conditions. A numerical example illustrates the efficacy of the approach. △ Less

Submitted 21 March, 2023; originally announced March 2023.

Comments: Accepted at the 2023 American Control Conference (ACC)

robust synergistic hybrid feedback

Authors: Pedro Casau, Ricardo G. Sanfelice, Carlos Silvestre

Abstract: Synergistic hybrid feedback refers to a collection of feedback laws that allow for global asymptotic stabilization of a compact set through the following switching logic: given a collection of Lyapunov functions that are indexed by a logic variable, whenever the currently selected Lyapunov function exceeds the value of another function in the collection by a given margin, then a switch to the corr… ▽ More Synergistic hybrid feedback refers to a collection of feedback laws that allow for global asymptotic stabilization of a compact set through the following switching logic: given a collection of Lyapunov functions that are indexed by a logic variable, whenever the currently selected Lyapunov function exceeds the value of another function in the collection by a given margin, then a switch to the corresponding feedback law is triggered. This kind of feedback has been under development over the past decade and it has led to multiple solutions for global asymptotic stabilization on compact manifolds. The contributions of this paper include a synergistic controller design in which the logic variable is not necessarily constant between jumps, a synergistic hybrid feedback that is able to tackle the presence of parametric uncertainty, backstepping of adaptive synergistic hybrid feedbacks, and a demonstration of the proposed solutions to the problem of global obstacle avoidance. △ Less

Submitted 31 December, 2022; originally announced January 2023.

Comments: 17 pages, 2 figures, submitted for publication

Optimal Safety for Constrained Differential Inclusions using Nonsmooth Control Barrier Functions

Authors: Masoumeh Ghanbarpour, Axton Isaly, Ricardo G. Sanfelice, Warren E. Dixon

Abstract: For a broad class of nonlinear systems, we formulate the problem of guaranteeing safety with optimality under constraints. Specifically, we define controlled safety for differential inclusions with constraints on the states and the inputs. Through the use of nonsmooth analysis tools, we show that a continuous optimal control law can be selected from a set-valued constraint capturing the system con… ▽ More For a broad class of nonlinear systems, we formulate the problem of guaranteeing safety with optimality under constraints. Specifically, we define controlled safety for differential inclusions with constraints on the states and the inputs. Through the use of nonsmooth analysis tools, we show that a continuous optimal control law can be selected from a set-valued constraint capturing the system constraints and conditions guaranteeing safety using control barrier functions. Our results guarantee optimality and safety via a continuous state-feedback law designed using nonsmooth control barrier functions. An example pertaining to obstacle avoidance with a target illustrates our results and the associated benefits of using nonsmooth control barrier functions. △ Less

Submitted 22 November, 2022; originally announced November 2022.

Comments: Submitted to LCSS

Control Design under Actuator Saturation and Multi-Rate Sampling

Authors: Francesco Ferrante, Ricardo G. Sanfelice, Sophie Tarbouriech

Abstract: The problem of designing a stabilizing feedback controller in the presence of saturating actuators and multi-rate (asynchronous) aperiodic state measurements is studied. Specifically, we consider a scenario in which measurements of the plant states are collected at the controller end in a sporadic and asynchronous fashion. A hybrid controller is used to perform a fusion of measurements sampled at… ▽ More The problem of designing a stabilizing feedback controller in the presence of saturating actuators and multi-rate (asynchronous) aperiodic state measurements is studied. Specifically, we consider a scenario in which measurements of the plant states are collected at the controller end in a sporadic and asynchronous fashion. A hybrid controller is used to perform a fusion of measurements sampled at different times. In between sampling events, the controller behaves as a copy of the plant and provides a feedback control signal based on the reconstruction of the plant state. The presence of saturation at the plant input limits the value of the components of this signal to a bounded range. When a new measurement is available, the controller state undergoes an instantaneous jump. The resulting system is augmented with a set of timers triggering the arrival of new measurements and analyzed in a hybrid systems framework. Relying on Lyapunov tools for hybrid systems and techniques for control design under saturation, we propose sufficient conditions in the form of matrix inequalities to ensure regional exponential stability of a closed-set containing the origin of the plant, i.e., exponential stability with a guaranteed region of attraction. Specifically, explicit estimates of the basin of attraction are provided in the form of ellipsoidal sets. Leveraging those conditions, a design procedure based on semidefinite programming is proposed to design a stabilizing controller with maximized size of the basin attraction. The effectiveness of the proposed methodology is shown in an example. △ Less

Submitted 19 October, 2022; originally announced October 2022.

Comments: Extended version of the paper accepted for publication in Automatica

Robust Output Feedback Control Design in the Presence of Sporadic Measurements

Authors: Roberto Merco, Francesco Ferrante, Ricardo G. Sanfelice, Pierluigi Pisu

Abstract: Output feedback control design for linear time-invariant systems in the presence of sporadic measurements and exogenous perturbations is addressed. To cope with the sporadic availability of measurements of the output, a hybrid dynamic output feedback controller equipped with a holding device whose state is reset when a new measurement is available is designed. The closed-loop system, resulting fro… ▽ More Output feedback control design for linear time-invariant systems in the presence of sporadic measurements and exogenous perturbations is addressed. To cope with the sporadic availability of measurements of the output, a hybrid dynamic output feedback controller equipped with a holding device whose state is reset when a new measurement is available is designed. The closed-loop system, resulting from the interconnection of the controller and the plant, is augmented with a timer variable triggering the arrival of new measurements and its properties are analyzed using hybrid system tools. Building upon Lyapunov theory for hybrid systems, sufficient conditions for internal and L2 input-to-output stability are proposed. An LMI-based design methodology for the co-design of the gains of the controller and the parameters of the holding device is presented. The effectiveness of the proposed LMI-based design approach is showcased in a numerical example. △ Less

Submitted 19 October, 2022; v1 submitted 9 August, 2022; originally announced August 2022.

Comments: Extended version of the paper accepted for publication in the IEEE Transactions on Automatic Control

Journal ref: IEEE Transactions on Automatic Control 2022

Notions, Stability, Existence, and Robustness of Limit Cycles in Hybrid Dynamical Systems

Authors: Xuyang Lou, Yuchun Li, Ricardo G. Sanfelice

Abstract: This paper deals with existence and robust stability of hybrid limit cycles for a class of hybrid systems given by the combination of continuous dynamics on a flow set and discrete dynamics on a jump set. For this purpose, the notion of Zhukovskii stability, typically stated for continuous-time systems, is extended to the hybrid systems. Necessary conditions, particularly, a condition using a forw… ▽ More This paper deals with existence and robust stability of hybrid limit cycles for a class of hybrid systems given by the combination of continuous dynamics on a flow set and discrete dynamics on a jump set. For this purpose, the notion of Zhukovskii stability, typically stated for continuous-time systems, is extended to the hybrid systems. Necessary conditions, particularly, a condition using a forward invariance notion, for existence of hybrid limit cycles are first presented. In addition, a sufficient condition, related to Zhukovskii stability, for the existence of (or lack of) hybrid limit cycles is established. Furthermore, under mild assumptions, we show that asymptotic stability of such hybrid limit cycles is not only equivalent to asymptotic stability of a fixed point of the associated Poincaré map but also robust to perturbations. Specifically, robustness to generic perturbations, which capture state noise and unmodeled dynamics, and to inflations of the flow and jump sets are established in terms of $\mathcal{KL}$ bounds. Furthermore, results establishing relationships between the properties of a computed Poincaré map, which is necessarily affected by computational error, and the actual asymptotic stability properties of a hybrid limit cycle are proposed. In particular, it is shown that asymptotic stability of the exact Poincaré map is preserved when computed with enough precision. Several examples, including a congestion control system and spiking neurons, are presented to illustrate the notions and results throughout the paper. △ Less

Submitted 18 December, 2023; v1 submitted 4 August, 2022; originally announced August 2022.

Comments: 29 pages, 12 figures, 2 tables. This work has been accepted to IEEE Transactions on Automatic Control

Control Barrier Function based Attack-Recovery with Provable Guarantees

Authors: Kunal Garg, Ricardo G. Sanfelice, Alvaro A. Cardenas

Abstract: This paper studies provable security guarantees for cyber-physical systems (CPS) under actuator attacks. In particular, we consider CPS safety and propose a new attack detection mechanism based on zeroing control barrier function (ZCBF) conditions. In addition, we design an adaptive recovery mechanism based on how close the system is to violating safety. We show that under certain conditions, the… ▽ More This paper studies provable security guarantees for cyber-physical systems (CPS) under actuator attacks. In particular, we consider CPS safety and propose a new attack detection mechanism based on zeroing control barrier function (ZCBF) conditions. In addition, we design an adaptive recovery mechanism based on how close the system is to violating safety. We show that under certain conditions, the attack-detection mechanism is sound, i.e., there are no false negatives for adversarial attacks. We propose sufficient conditions for the initial conditions and input constraints so that the resulting CPS is secure by design. We also propose a novel hybrid control to account for attack detection delays and avoid Zeno behavior. Next, to efficiently compute the set of initial conditions, we propose a sampling-based method to verify whether a set is a viability domain. Specifically, we devise a method for checking a modified barrier function condition on a finite set of points to assess whether a set can be rendered forward invariant. Then, we propose an iterative algorithm to compute the set of initial conditions and input constraints set to limit the effect of an adversary if it compromises vulnerable inputs. Finally, we use a Quadratic Programming (QP) approach for online recovery (as well as nominal) control synthesis. We demonstrate the effectiveness of the proposed method in a simulation case study involving a quadrotor with an attack on its motors. △ Less

Submitted 19 February, 2025; v1 submitted 6 April, 2022; originally announced April 2022.

Comments: V1: Conference version (IEEE CDC'2022) V2: Journal version (submitted to IEEE Transactions on Automatic Control)

Hysteresis-Based RL: Robustifying Reinforcement Learning-based Control Policies via Hybrid Control

Authors: Jan de Priester, Ricardo G. Sanfelice, Nathan van de Wouw

Abstract: Reinforcement learning (RL) is a promising approach for deriving control policies for complex systems. As we show in two control problems, the derived policies from using the Proximal Policy Optimization (PPO) and Deep Q-Network (DQN) algorithms may lack robustness guarantees. Motivated by these issues, we propose a new hybrid algorithm, which we call Hysteresis-Based RL (HyRL), augmenting an exis… ▽ More Reinforcement learning (RL) is a promising approach for deriving control policies for complex systems. As we show in two control problems, the derived policies from using the Proximal Policy Optimization (PPO) and Deep Q-Network (DQN) algorithms may lack robustness guarantees. Motivated by these issues, we propose a new hybrid algorithm, which we call Hysteresis-Based RL (HyRL), augmenting an existing RL algorithm with hysteresis switching and two stages of learning. We illustrate its properties in two examples for which PPO and DQN fail. △ Less

Submitted 1 April, 2022; originally announced April 2022.

Comments: This paper has been accepted for publication at the 2022 American Control Conference (ACC)

Sampling based Computation of Viability Domain to Prevent Safety Violations by Attackers

Authors: Kunal Garg, Ricardo G. Sanfelice, Alvaro A. Cardenas

Abstract: This paper studies the security of cyber-physical systems under attacks. Our goal is to design system parameters, such as a set of initial conditions and input bounds so that it is secure by design. To this end, we propose new sufficient conditions to guarantee the safety of a system under adversarial actuator attacks. Using these conditions, we propose a computationally efficient sampling-based m… ▽ More This paper studies the security of cyber-physical systems under attacks. Our goal is to design system parameters, such as a set of initial conditions and input bounds so that it is secure by design. To this end, we propose new sufficient conditions to guarantee the safety of a system under adversarial actuator attacks. Using these conditions, we propose a computationally efficient sampling-based method to verify whether a set is a viability domain for a general class of nonlinear systems. In particular, we devise a method of checking a modified barrier function condition on a finite set of points to assess whether a set can be rendered forward invariant. Then, we propose an iterative algorithm to compute the set of initial conditions and input constraint set to limit what an adversary can do if it compromises the vulnerable inputs. Finally, we utilize a Quadratic Program approach for online control synthesis. △ Less

Submitted 16 October, 2021; originally announced October 2021.

Certifying the LTL Formula p Until q in Hybrid Systems

Authors: Hyejin Han, Mohamed Maghenem, Ricardo G. Sanfelice

Abstract: In this paper, we propose sufficient conditions to guarantee that a linear temporal logic (LTL) formula of the form p Until q, denoted by $p \mathcal{U} q$, is satisfied for a hybrid system. Roughly speaking, the formula $p \mathcal{U} q$ is satisfied means that the solutions, initially satisfying proposition p, keep satisfying this proposition until proposition q is satisfied. To certify such a f… ▽ More In this paper, we propose sufficient conditions to guarantee that a linear temporal logic (LTL) formula of the form p Until q, denoted by $p \mathcal{U} q$, is satisfied for a hybrid system. Roughly speaking, the formula $p \mathcal{U} q$ is satisfied means that the solutions, initially satisfying proposition p, keep satisfying this proposition until proposition q is satisfied. To certify such a formula, connections to invariance notions such as conditional invariance (CI) and eventual conditional invariance (ECI), as well as finite-time attractivity (FTA) are established. As a result, sufficient conditions involving the data of the hybrid system and an appropriate choice of Lyapunov-like functions, such as barrier functions, are derived. The considered hybrid system is given in terms of differential and difference inclusions, which capture the continuous and the discrete dynamics present in the same system, respectively. Examples illustrate the results throughout the paper. △ Less

Submitted 17 August, 2022; v1 submitted 11 June, 2021; originally announced June 2021.

Comments: 21 pages. The technical report accompanying "Certifying the LTL Formula p Until q in Hybrid Systems" submitted to IEEE Transactions on Automatic Control, 2021

Convergence of Nonlinear Observers on R^n with a Riemannian Metric (Part III)

Authors: Ricardo G. Sanfelice, Laurent Praly

Abstract: This paper is the third and final component of a three-part effort on observers contracting a Riemannian distance between the state of the system and its estimate. In Part I, we showed that such a contraction property holds if the system dynamics and the Riemannian metric satisfy two key conditions: a differential detectability property and a geodesic monotonicity property. With the former conditi… ▽ More This paper is the third and final component of a three-part effort on observers contracting a Riemannian distance between the state of the system and its estimate. In Part I, we showed that such a contraction property holds if the system dynamics and the Riemannian metric satisfy two key conditions: a differential detectability property and a geodesic monotonicity property. With the former condition being the focus of Part II, in this Part III, we study the latter condition in relationship to the nullity of the second fundamental form of the output function. We formulate sufficient and necessary conditions for it to hold. We establish a link between it and the infinite gain margin property, and we provide a systematic way for constructing a metric satisfying this condition. Finally, we illustrate cases where both conditions hold and propose ways to facilitate the satisfaction of these two conditions together. △ Less

Submitted 4 May, 2023; v1 submitted 16 February, 2021; originally announced February 2021.

Comments: 95 pages, Version submitted for review

A Hybrid Control Algorithm for Gradient-Free Optimization using Conjugate Directions

Authors: Alessandro Melis, Ricardo G. Sanfelice, Lorenzo Marconi

Abstract: The problem of steering a particular class of $n$-dimensional continuous-time dynamical systems towards the minima of a function without gradient information is considered. We propose an hybrid controller, implementing a discrete-time Direct Search algorithm based on conjugate directions, able to solve the optimization problem for the resulting closed loop system in an almost global sense. Further… ▽ More The problem of steering a particular class of $n$-dimensional continuous-time dynamical systems towards the minima of a function without gradient information is considered. We propose an hybrid controller, implementing a discrete-time Direct Search algorithm based on conjugate directions, able to solve the optimization problem for the resulting closed loop system in an almost global sense. Furthermore, we show that Direct Search algorithms based on asymptotic step size reduction are not robust to measurement noise, and, to achieve robustness, we propose a modified version by imposing a lower bound on the step size and able to achieve robust practical convergence to the optimum. In this context we show a bound relating the supremum norm of the noise signal to the step size by highlighting a trade-off between asymptotic convergence and robustness. △ Less

Submitted 4 December, 2019; v1 submitted 18 November, 2019; originally announced November 2019.

Robust Global Exponential Stabilization on the $n$-Dimensional Sphere with Applications to Trajectory Tracking for Quadrotors

Authors: Pedro Casau, Christopher G. Mayhew, Ricardo G. Sanfelice, Carlos Silvestre

Abstract: In this paper, we design a hybrid controller that globally exponentially stabilizes a system evolving on the n-dimensional sphere, denoted by Sn. This hybrid controller is induced by a synergistic collection of potential functions on Sn. We propose a particular construction of this class of functions that generates flows along geodesics of the sphere, providing convergence to the desired reference… ▽ More In this paper, we design a hybrid controller that globally exponentially stabilizes a system evolving on the n-dimensional sphere, denoted by Sn. This hybrid controller is induced by a synergistic collection of potential functions on Sn. We propose a particular construction of this class of functions that generates flows along geodesics of the sphere, providing convergence to the desired reference with minimal path length. We show that the proposed strategy is suitable to the exponential stabilization of a quadrotor vehicle. △ Less

Submitted 4 October, 2019; originally announced October 2019.

Journal ref: Automatica, Volume 110 (2019)

$\mathcal{L}_2$ State Estimation with Guaranteed Convergence Speed in the Presence of Sporadic Measurements

Authors: Francesco Ferrante, Frédéric Gouaisbaut, Ricardo G. Sanfelice, Sophie Tarbouriech

Abstract: This paper deals with the problem of estimating the state of a linear time-invariant system in the presence of sporadically available measurements and external perturbations. An observer with a continuous intersample injection term is proposed. Such an intersample injection is provided by a linear dynamical system, whose state is reset to the measured output estimation error at each sampling time.… ▽ More This paper deals with the problem of estimating the state of a linear time-invariant system in the presence of sporadically available measurements and external perturbations. An observer with a continuous intersample injection term is proposed. Such an intersample injection is provided by a linear dynamical system, whose state is reset to the measured output estimation error at each sampling time. The resulting system is augmented with a timer triggering the arrival of a new measurement and analyzed in a hybrid system framework. The design of the observer is performed to achieve global exponential stability with a given decay rate to a set wherein the estimation error is equal to zero. Robustness with respect to external perturbations and $\mathcal{L}_2$-external stability from the plant perturbation to a given performance output are considered. Moreover, computationally efficient algorithms based on the solution to linear matrix inequalities are proposed to design the observer. Finally, the effectiveness of the proposed methodology is shown in three examples. △ Less

Submitted 5 November, 2020; v1 submitted 4 November, 2018; originally announced November 2018.

Comments: Extended version of "$\mathcal{L}_2$ State Estimation with Guaranteed Convergence Speed in the Presence of Sporadic Measurements". This version contains fixes to some minor typos

Journal ref: IEEE Transactions on Automatic Control, Volume: 64, Issue: 8, Aug. 2019, 3362-3369

Linear Temporal Logic for Hybrid Dynamical Systems: Characterizations and Sufficient Conditions

Authors: Hyejin Han, Ricardo G. Sanfelice

Abstract: This paper introduces operators, semantics, characterizations, and solution-independent conditions to guarantee temporal logic specifications for hybrid dynamical systems. Hybrid dynamical systems are given in terms of differential inclusions -- capturing the continuous dynamics -- and difference inclusions -- capturing the discrete dynamics or events -- with constraints. State trajectories (or so… ▽ More This paper introduces operators, semantics, characterizations, and solution-independent conditions to guarantee temporal logic specifications for hybrid dynamical systems. Hybrid dynamical systems are given in terms of differential inclusions -- capturing the continuous dynamics -- and difference inclusions -- capturing the discrete dynamics or events -- with constraints. State trajectories (or solutions) to such systems are parameterized by a hybrid notion of time. For such broad class of solutions, the operators and semantics needed to reason about temporal logic are introduced. Characterizations of temporal logic formulas in terms of dynamical properties of hybrid systems are presented -- in particular, forward invariance and finite time attractivity. These characterizations are exploited to formulate sufficient conditions assuring the satisfaction of temporal logic formulas -- when possible, these conditions do not involve solution information. Combining the results for formulas with a single operator, ways to certify more complex formulas are pointed out, in particular, via a decomposition using a finite state automaton. Academic examples illustrate the results throughout the paper. △ Less

Submitted 15 June, 2020; v1 submitted 6 July, 2018; originally announced July 2018.

Comments: 35 pages. The technical report accompanying "Linear Temporal Logic for Hybrid Dynamical Systems: Characterizations and Sufficient Conditions" submitted to Nonlinear Analysis: Hybrid Systems, 2019

Convergence of Nonlinear Observers on R^n with a Riemannian Metric (Part II)

Authors: Ricardo G. Sanfelice, Laurent Praly

Abstract: In [1], it is established that a convergent observer with an infinite gain margin can be designed for a given nonlinear system when a Riemannian metric showing that the system is differentially detectable (i.e., the Lie derivative of the Riemannian metric along the system vector field is negative in the space tangent to the output function level sets) and the level sets of the output function are… ▽ More In [1], it is established that a convergent observer with an infinite gain margin can be designed for a given nonlinear system when a Riemannian metric showing that the system is differentially detectable (i.e., the Lie derivative of the Riemannian metric along the system vector field is negative in the space tangent to the output function level sets) and the level sets of the output function are geodesically convex is available. In this paper, we propose techniques for designing a Riemannian metric satisfying the first property in the case where the system is strongly infinitesimally observable (i.e., each time-varying linear system resulting from the linearization along a solution to the system satisfies a uniform observability property) or where it is strongly differentially observable (i.e. the mapping state to output derivatives is an injective immersion) or where it is Lagrangian. Also, we give results that are complementary to those in [1]. In particular, we provide a locally convergent observer and make a link to the existence of a reduced order observer. Examples illustrating the results are presented. △ Less

Submitted 19 June, 2016; originally announced June 2016.

Comments: 33 pages, Version published in IEEE Transactions in Automatic Control, 2016

Convergence of Nonlinear Observers on R^n with a Riemannian Metric (Part I)

Authors: Ricardo G. Sanfelice, Laurent Praly

Abstract: We study how convergence of an observer whose state lives in a copy of the given system's space can be established using a Riemannian metric. We show that the existence of an observer guaranteeing the property that a Riemannian distance between system and observer solutions is nonincreasing implies that the Lie derivative of the Riemannian metric along the system vector field is conditionally nega… ▽ More We study how convergence of an observer whose state lives in a copy of the given system's space can be established using a Riemannian metric. We show that the existence of an observer guaranteeing the property that a Riemannian distance between system and observer solutions is nonincreasing implies that the Lie derivative of the Riemannian metric along the system vector field is conditionally negative. Moreover, we establish that the existence of this metric is related to the observability of the system's linearization along its solutions. Moreover, if the observer has an infinite gain margin then the level sets of the output function are geodesically convex. Conversely, we establish that, if a complete Riemannian metric has a Lie derivative along the system vector field that is conditionally negative and is such that the output function has a monotonicity property, then there exists an observer with an infinite gain margin. △ Less

Submitted 14 July, 2015; v1 submitted 21 December, 2014; originally announced December 2014.

Comments: 30 pages, Version published in IEEE Transactions in Automatic Control, 2012

Dynamical Properties of a Two-gene Network with Hysteresis

Authors: Qin Shu, Ricardo G. Sanfelice

Abstract: A mathematical model for a two-gene regulatory network is derived and several of their properties analyzed. Due to the presence of mixed continuous/discrete dynamics and hysteresis, we employ a hybrid systems model to capture the dynamics of the system. The proposed model incorporates binary hysteresis with different thresholds capturing the interaction between the genes. We analyze properties of… ▽ More A mathematical model for a two-gene regulatory network is derived and several of their properties analyzed. Due to the presence of mixed continuous/discrete dynamics and hysteresis, we employ a hybrid systems model to capture the dynamics of the system. The proposed model incorporates binary hysteresis with different thresholds capturing the interaction between the genes. We analyze properties of the solutions and asymptotic stability of equilibria in the system as a function of its parameters. Our analysis reveals the presence of limit cycles for a certain range of parameters, behavior that is associated with hysteresis. The set of points defining the limit cycle is characterized and its asymptotic stability properties are studied. Furthermore, the stability property of the limit cycle is robust to small perturbations. Numerical simulations are presented to illustrate the results. △ Less

Submitted 1 February, 2014; originally announced February 2014.

Comments: 55 pages, 31 figures.Expanded version of paper in Special Issue on Hybrid Systems and Biology, Elsevier Information and Computation, 2014

Report number: HDC-2014-001

On Minimum-time Paths of Bounded Curvature with Position-dependent Constraints

Authors: Ricardo G. Sanfelice, Sze Zheng Yong, Emilio Frazzoli

Abstract: We consider the problem of a particle traveling from an initial configuration to a final configuration (given by a point in the plane along with a prescribed velocity vector) in minimum time with non-homogeneous velocity and with constraints on the minimum turning radius of the particle over multiple regions of the state space. Necessary conditions for optimality of these paths are derived to char… ▽ More We consider the problem of a particle traveling from an initial configuration to a final configuration (given by a point in the plane along with a prescribed velocity vector) in minimum time with non-homogeneous velocity and with constraints on the minimum turning radius of the particle over multiple regions of the state space. Necessary conditions for optimality of these paths are derived to characterize the nature of optimal paths, both when the particle is inside a region and when it crosses boundaries between neighboring regions. These conditions are used to characterize families of optimal and nonoptimal paths. Among the optimality conditions, we derive a "refraction" law at the boundary of the regions that generalizes the so-called Snell's law of refraction in optics to the case of paths with bounded curvature. Tools employed to deduce our results include recent principles of optimality for hybrid systems. The results are validated numerically. △ Less

Submitted 9 January, 2014; v1 submitted 9 October, 2013; originally announced October 2013.

Comments: Expanded version of paper in Automatica

A Hybrid Model of a Genetic Regulatory Network in Mammalian Sclera

Authors: Qin Shu, Diana Catalina Ardila, Ricardo G. Sanfelice, Jonathan P. Vande Geest

Abstract: Myopia in human and animals is caused by the axial elongation of the eye and is closely linked to the thinning of the sclera which supports the eye tissue. This thinning has been correlated with the overproduction of matrix metalloproteinase (MMP-2), an enzyme that degrades the collagen structure of the sclera. In this short paper, we propose a descriptive model of a regulatory network with hyster… ▽ More Myopia in human and animals is caused by the axial elongation of the eye and is closely linked to the thinning of the sclera which supports the eye tissue. This thinning has been correlated with the overproduction of matrix metalloproteinase (MMP-2), an enzyme that degrades the collagen structure of the sclera. In this short paper, we propose a descriptive model of a regulatory network with hysteresis, which seems necessary for creating oscillatory behavior in the hybrid model between MMP-2, MT1-MMP and TIMP-2. Numerical results provide insight on the type of equilibria present in the system. △ Less

Submitted 3 September, 2013; originally announced September 2013.

Comments: In Proceedings HSB 2013, arXiv:1308.5724

Journal ref: EPTCS 125, 2013, pp. 99-105

Robust Supervisory Control for Uniting Two Output-Feedback Hybrid Controllers with Different Objectives

Authors: Ricardo G. Sanfelice, Christophe Prieur

Abstract: The problem of robustly, asymptotically stabilizing a point (or a set) with two output-feedback hybrid controllers is considered. These control laws may have different objectives, e.g., the closed-loop systems resulting with each controller may have different attractors. We provide a control algorithm that combines the two hybrid controllers to accomplish the stabilization task. The algorithm cons… ▽ More The problem of robustly, asymptotically stabilizing a point (or a set) with two output-feedback hybrid controllers is considered. These control laws may have different objectives, e.g., the closed-loop systems resulting with each controller may have different attractors. We provide a control algorithm that combines the two hybrid controllers to accomplish the stabilization task. The algorithm consists of a hybrid supervisor that, based on the values of plant's outputs and (norm) state estimates, selects the hybrid controller that should be applied to the plant. The accomplishment of the stabilization task relies on an output-to-state stability property induced by the controllers, which enables the construction of an estimator for the norm of the plant's state. The algorithm is motivated by and applied to robust, semi-global stabilization problems uniting two controllers. △ Less

Submitted 18 August, 2013; originally announced August 2013.

Comments: Version published in Automatica, 21 pages, 5 figures

Journal ref: Automatica, 2013, 49, 1958-1969