-
Integral Control Barrier Functions for Dynamically Defined Control Laws
Authors:
Aaron D. Ames,
Gennaro Notomista,
Yorai Wardi,
Magnus Egerstedt
Abstract:
This paper introduces integral control barrier functions (I-CBFs) as a means to enable the safety-critical integral control of nonlinear systems. Importantly, I-CBFs allow for the holistic encoding of both state constraints and input bounds in a single framework. We demonstrate this by applying them to a dynamically defined tracking controller, thereby enforcing safety in state and input through a…
▽ More
This paper introduces integral control barrier functions (I-CBFs) as a means to enable the safety-critical integral control of nonlinear systems. Importantly, I-CBFs allow for the holistic encoding of both state constraints and input bounds in a single framework. We demonstrate this by applying them to a dynamically defined tracking controller, thereby enforcing safety in state and input through a minimally invasive I-CBF controller framed as a quadratic program.
△ Less
Submitted 7 July, 2020; v1 submitted 30 June, 2020;
originally announced June 2020.
-
Tracking Control by the Newton-Raphson Method with Output Prediction and Controller Speedup
Authors:
Yorai Wardi,
Carla Seatzu,
Jorge Cortes,
Magnus Egerstedt,
Shashwat Shivam,
Ian Buckley
Abstract:
This paper presents a control technique for output tracking of reference signals in continuous-time dynamical systems. The technique is comprised of the following three elements: (i) output prediction which has to track the reference signal, (ii) a controller based on an integrator with variable gain, and (iii) a speedup of the control action for enhancing the tracker's accuracy and, in some cases…
▽ More
This paper presents a control technique for output tracking of reference signals in continuous-time dynamical systems. The technique is comprised of the following three elements: (i) output prediction which has to track the reference signal, (ii) a controller based on an integrator with variable gain, and (iii) a speedup of the control action for enhancing the tracker's accuracy and, in some cases, guaranteeing stability of the closed-loop system. The technique is suitable for linear and nonlinear systems, implementable by simple algorithms, can track reference points as well as time-dependent reference signals, and may have large, even global domains of attraction. The derived theoretical results include convergence of the tracking controller and error analysis, and are supported by illustrative simulation and laboratory experiments.
△ Less
Submitted 1 October, 2019;
originally announced October 2019.
-
Power Regulation in High Performance Multicore Processors
Authors:
X. Chen,
Y. Wardi,
S. Yalamanchili
Abstract:
This paper presents, implements, and evaluates a power-regulation technique for multicore processors, based on an integral controller with adjustable gain. The gain is designed for wide stability margins, and computed in real time as part of the control law. The tracking performance of the control system is robust with respect to modeling uncertainties and computational errors in the loop. The mai…
▽ More
This paper presents, implements, and evaluates a power-regulation technique for multicore processors, based on an integral controller with adjustable gain. The gain is designed for wide stability margins, and computed in real time as part of the control law. The tracking performance of the control system is robust with respect to modeling uncertainties and computational errors in the loop. The main challenge of designing such a controller is that the power dissipation of program-workloads varies widely and often cannot be measured accurately; hence extant controllers are either ad hoc or based on a-priori modeling characterizations of the processor and workloads. Our approach is different. Leveraging the aforementioned robustness it uses a simple textbook modeling framework, and adjusts its parameters in real time by a system-identification module. In this it trades modeling precision for fast computations in the loop making it suitable for on-line implementation in commodity data-center processors. Consequently, the proposed controller is agnostic in the sense that it does not require any a-priori system characterizations. We present an implementation of the controller on Intel's fourth-generation microarchitecture, Haswell, and test it on a number of industry benchmark programs which are used in scientific computing and datacenter applications. Results of these experiments are presented in detail exposing the practical challenges of implementing provably-convergent power regulation solutions in commodity multicore processors.
△ Less
Submitted 14 September, 2017;
originally announced September 2017.
-
Performance Regulation and Tracking via Lookahead Simulation: Preliminary Results and Validation
Authors:
Y. Wardi,
C. Seatzu,
M. Egerstedt,
I. Buckley
Abstract:
This paper presents an approach to target tracking that is based on a variable-gain integrator and the Newton-Raphson method for finding zeros of a function. Its underscoring idea is the determination of the feedback law by measurements of the system's output and estimation of its future state via lookahead simulation. The resulting feedback law is generally nonlinear. We first apply the proposed…
▽ More
This paper presents an approach to target tracking that is based on a variable-gain integrator and the Newton-Raphson method for finding zeros of a function. Its underscoring idea is the determination of the feedback law by measurements of the system's output and estimation of its future state via lookahead simulation. The resulting feedback law is generally nonlinear. We first apply the proposed approach to tracking a constant reference by the output of nonlinear memoryless plants. Then we extend it in a number of directions, including the tracking of time-varying reference signals by dynamic, possibly unstable systems. The approach is new hence its analysis is preliminary, and theoretical results are derived for nonlinear memoryless plants and linear dynamic plants. However, the setting for the controller does not require the plant-system to be either linear or stable, and this is verified by simulation of an inverted pendulum tracking a time-varying signal. We also demonstrate results of laboratory experiments of controlling a platoon of mobile robots.
△ Less
Submitted 14 August, 2017;
originally announced August 2017.
-
Hamiltonian-based Algorithm for Relaxed Optimal Control
Authors:
Yorai Wardi,
Magnus Egerstedt,
Muhammad Umer Qureshi
Abstract:
This paper concerns a first-order algorithmic technique for a class of optimal control problems defined on switched-mode hybrid systems. The salient feature of the algorithm is that it avoids the computation of Fréchet or Gâteaux derivatives of the cost functional, which can be time consuming, but rather moves in a projected-gradient direction that is easily computable (for a class of problems) an…
▽ More
This paper concerns a first-order algorithmic technique for a class of optimal control problems defined on switched-mode hybrid systems. The salient feature of the algorithm is that it avoids the computation of Fréchet or Gâteaux derivatives of the cost functional, which can be time consuming, but rather moves in a projected-gradient direction that is easily computable (for a class of problems) and does not require any explicit derivatives. The algorithm is applicable to a class of problems where a pointwise minimizer of the Hamiltonian is computable by a simple formula, and this includes many problems that arise in theory and applications. The natural setting for the algorithm is the space of continuous-time relaxed controls, whose special structure renders the analysis simpler than the setting of ordinary controls. While the space of relaxed controls has theoretical advantages, its elements are abstract entities that may not be amenable to computation. Therefore, a key feature of the algorithm is that it computes adequate approximations to relaxed controls without loosing its theoretical convergence properties. Simulation results, including cpu times, support the theoretical developments.
△ Less
Submitted 11 September, 2016;
originally announced September 2016.
-
IPA in the Loop: Control Design for Throughput Regulation in Computer Processors
Authors:
Xinwei Chen,
Yorai Wardi,
Sudhakar Yalamanchili
Abstract:
A new technique for performance regulation in event-driven systems, recently proposed by the authors, consists of an adaptive-gain integral control. The gain is adjusted in the control loop by a real-time estimation of the derivative of the plant-function with respect to the control input. This estimation is carried out by Infinitesimal Perturbation Analysis (IPA). The main motivation comes from a…
▽ More
A new technique for performance regulation in event-driven systems, recently proposed by the authors, consists of an adaptive-gain integral control. The gain is adjusted in the control loop by a real-time estimation of the derivative of the plant-function with respect to the control input. This estimation is carried out by Infinitesimal Perturbation Analysis (IPA). The main motivation comes from applications to throughput regulation in computer processors, where to-date, testing and assessment of the proposed control technique has been assessed by simulation. The purpose of this paper is to report on its implementation on a machine, namely an Intel Haswell microprocessor, and compare its performance to that obtained from cycle-level, full system simulation environment. The intrinsic contribution of the paper to the Workshop on Discrete Event System is in describing the process of taking an IPA-based design and simulation to a concrete implementation, thereby providing a bridge between theory and applications.
△ Less
Submitted 10 April, 2016;
originally announced April 2016.
-
Hamiltonian-Based Algorithm for Optimal Control
Authors:
M. T. Hale,
Y. Wardi,
H. Jaleel,
M. Egerstedt
Abstract:
This paper proposes an algorithmic technique for a class of optimal control problems where it is easy to compute a pointwise minimizer of the Hamiltonian associated with every applied control. The algorithm operates in the space of relaxed controls and projects the final result into the space of ordinary controls. It is based on the descent direction from a given relaxed control towards a pointwis…
▽ More
This paper proposes an algorithmic technique for a class of optimal control problems where it is easy to compute a pointwise minimizer of the Hamiltonian associated with every applied control. The algorithm operates in the space of relaxed controls and projects the final result into the space of ordinary controls. It is based on the descent direction from a given relaxed control towards a pointwise minimizer of the Hamiltonian. This direction comprises a form of gradient projection and for some systems, is argued to have computational advantages over direct gradient directions. The algorithm is shown to be applicable to a class of hybrid optimal control problems. The theoretical results, concerning convergence of the algorithm, are corroborated by simulation examples on switched-mode hybrid systems as well as on a problem of balancing transmission- and motion energy in a mobile robotic system.
△ Less
Submitted 8 March, 2016;
originally announced March 2016.
-
Motion and Communication Co-optimization with Path Planning and Online Channel Estimation
Authors:
Usman Ali,
Hong Cai,
Yasamin Mostofi,
Yorai Wardi
Abstract:
This paper considers the problem of optimally balancing motion energy and communication transmission energy of a mobile robot tasked with transmitting a given number of data bits to a remote station, while navigating to a prespecified destination in a given amount of time. The problem is cast in the setting of optimal control, where the robot has to choose its path, acceleration, and transmission…
▽ More
This paper considers the problem of optimally balancing motion energy and communication transmission energy of a mobile robot tasked with transmitting a given number of data bits to a remote station, while navigating to a prespecified destination in a given amount of time. The problem is cast in the setting of optimal control, where the robot has to choose its path, acceleration, and transmission rate along the path so as to minimize its energy required for transmission and motion, while satisfying various power and communication constraints. We use realistic models for the robot's channel estimation, motion dynamics, and power and energy costs. The main contribution of the paper is to show how to co-optimize robot's path along with other communication and motion variables. Two versions of the problem are solved: the first is defined offline by assuming that all the channel measurements are taken before the robots starts moving, while in the second the channel estimation is updated while the robot is in motion, and hence it is solved online. In both cases we utilize an in-house algorithm that computes near-optimal solutions in little time, which enables its use in the online setting. The optimization strategy is described in detail and validated by simulation of realistic scenarios.
△ Less
Submitted 4 March, 2016;
originally announced March 2016.
-
Performance Regulation of Event-Driven Dynamical Systems Using Infinitesimal Perturbation Analysis
Authors:
Yorai Wardi,
Carla Seatzu,
Xinwei Chen,
Sudhakar Yalamanchili
Abstract:
This paper presents a performance-regulation method for a class of stochastic timed event-driven systems aimed at output tracking of a given reference setpoint. The systems are either Discrete Event Dynamic Systems (DEDS) such as queueing networks or Petri nets, or Hybrid Systems (HS) with time-driven dynamics and event-driven dynamics, like fluid queues and hybrid Petri nets. The regulator, desig…
▽ More
This paper presents a performance-regulation method for a class of stochastic timed event-driven systems aimed at output tracking of a given reference setpoint. The systems are either Discrete Event Dynamic Systems (DEDS) such as queueing networks or Petri nets, or Hybrid Systems (HS) with time-driven dynamics and event-driven dynamics, like fluid queues and hybrid Petri nets. The regulator, designed for simplicity and speed of computation, is comprised of a single integrator having a variable gain to ensure effective tracking under time-varying plants. The gain's computation is based on the Infinitesimal Perturbation Analysis (IPA) gradient of the plant function with respect to the control variable, and the resultant tracking can be quite robust with respect to modeling inaccuracies and gradient-estimation errors. The proposed technique is tested on examples taken from various application areas and modeled with different formalisms, including queueing models, Petri-net model of a production-inventory control system, and a stochastic DEDS model of a multicore chip control. Simulation results are presented in support of the proposed approach.
△ Less
Submitted 14 January, 2016;
originally announced January 2016.
-
Congestion management in traffic-light intersections via Infinitesimal Perturbation Analysis
Authors:
Carla Seatzu,
Yorai Wardi
Abstract:
We present a flow-control technique in traffic-light intersections, aiming at regulating queue lengths to given reference setpoints. The technique is based on multivariable integrators with adaptive gains, computed at each control cycle by assessing the IPA gradients of the plant functions. Moreover, the IPA gradients are computable on-line despite the absence of detailed models of the traffic flo…
▽ More
We present a flow-control technique in traffic-light intersections, aiming at regulating queue lengths to given reference setpoints. The technique is based on multivariable integrators with adaptive gains, computed at each control cycle by assessing the IPA gradients of the plant functions. Moreover, the IPA gradients are computable on-line despite the absence of detailed models of the traffic flows. The technique is applied to a two-intersection system where it exhibits robustness with respect to modeling uncertainties and computing errors, thereby permitting us to simplify the on-line computations perhaps at the expense of accuracy while achieving the desired tracking. We compare, by simulation, the performance of a centralized, joint two-intersection control with distributed control of each intersection separately, and show similar performance of the two control schemes for a range of parameters.
△ Less
Submitted 28 July, 2015;
originally announced July 2015.
-
Temperature Regulation in Multicore Processors Using Adjustable-Gain Integral Controllers
Authors:
Karthik Rao,
William Song,
Sudhakar Yalamanchili,
Yorai Wardi
Abstract:
This paper considers the problem of temperature regulation in multicore processors by dynamic voltage-frequency scaling. We propose a feedback law that is based on an integral controller with adjustable gain, designed for fast tracking convergence in the face of model uncertainties, time-varying plants, and tight computing-timing constraints. Moreover, unlike prior works we consider a nonlinear, t…
▽ More
This paper considers the problem of temperature regulation in multicore processors by dynamic voltage-frequency scaling. We propose a feedback law that is based on an integral controller with adjustable gain, designed for fast tracking convergence in the face of model uncertainties, time-varying plants, and tight computing-timing constraints. Moreover, unlike prior works we consider a nonlinear, time-varying plant model that trades off precision for simple and efficient on-line computations. Cycle-level, full system simulator implementation and evaluation illustrates fast and accurate tracking of given temperature reference values, and compares favorably with fixed-gain controllers.
△ Less
Submitted 22 July, 2015;
originally announced July 2015.
-
Infinitesimal Perturbation Analysis of Stochastic Hybrid Systems: Application to Congestion Management in Traffic-Light Intersections
Authors:
Yorai Wardi,
Carla Seatzu
Abstract:
This paper presents a new approach to congestion management at traffic-light intersections. The approach is based on controlling the relative lengths of red/green cycles in order to have the congestion level track a given reference. It uses an integral control with adaptive gains, designed to provide fast tracking and wide stability margins. The gains are inverse-proportional to the derivative of…
▽ More
This paper presents a new approach to congestion management at traffic-light intersections. The approach is based on controlling the relative lengths of red/green cycles in order to have the congestion level track a given reference. It uses an integral control with adaptive gains, designed to provide fast tracking and wide stability margins. The gains are inverse-proportional to the derivative of the plant-function with respect to the control parameter, and are computed by infinitesimal perturbation analysis. Convergence of this technique is shown to be robust with respect to modeling uncertainties, computing errors, and other random effects. The framework is presented in the setting of stochastic hybrid systems, and applied to a particular traffic-light model. This is but an initial study and hence the latter model is simple, but it captures some of the salient features of traffic-light processes. The paper concludes with comments on possible extensions of the proposed approach to traffic-light grids with realistic flow models.
△ Less
Submitted 27 July, 2014;
originally announced July 2014.
-
Approximate IPA: Trading Unbiasedness for Simplicity
Authors:
Yorai Wardi,
Christos G. Cassandras
Abstract:
When Perturbation Analysis (PA) yields unbiased sensitivity estimators for expected-value performance functions in discrete event dynamic systems, it can be used for performance optimization of those functions. However, when PA is known to be unbiased, the complexity of its estimators often does not scale with the system's size. The purpose of this paper is to suggest an alternative approach to op…
▽ More
When Perturbation Analysis (PA) yields unbiased sensitivity estimators for expected-value performance functions in discrete event dynamic systems, it can be used for performance optimization of those functions. However, when PA is known to be unbiased, the complexity of its estimators often does not scale with the system's size. The purpose of this paper is to suggest an alternative approach to optimization which balances precision with computing efforts by trading off complicated, unbiased PA estimators for simple, biased approximate estimators. Furthermore, we provide guidelines for developing such estimators, that are largely based on the Stochastic Flow Modeling framework. We suggest that if the relative error (or bias) is not too large, then optimization algorithms such as stochastic approximation converge to a (local) minimum just like in the case where no approximation is used. We apply this approach to an example of balancing loss with buffer-cost in a finite-buffer queue, and prove a crucial upper bound on the relative error. This paper presents the initial study of the proposed approach, and we believe that if the idea gains traction then it may lead to a significant expansion of the scope of PA in optimization of discrete event systems.
△ Less
Submitted 3 August, 2013;
originally announced August 2013.
-
Algorithm for Optimal Mode Scheduling in Switched Systems
Authors:
Yorai Wardi,
Magnus Egerstedt
Abstract:
This paper considers the problem of computing the schedule of modes in a switched dynamical system, that minimizes a cost functional defined on the trajectory of the system's continuous state variable. A recent approach to such optimal control problems consists of algorithms that alternate between computing the optimal switching times between modes in a given sequence, and updating the mode-sequen…
▽ More
This paper considers the problem of computing the schedule of modes in a switched dynamical system, that minimizes a cost functional defined on the trajectory of the system's continuous state variable. A recent approach to such optimal control problems consists of algorithms that alternate between computing the optimal switching times between modes in a given sequence, and updating the mode-sequence by inserting to it a finite number of new modes.
These algorithms have an inherent inefficiency due to their sparse update of the mode-sequences, while spending most of the computing times on optimizing with respect to the switching times for a given mode-sequence. This paper proposes an algorithm that operates directly in the schedule space without resorting to the timing optimization problem. It is based on the Armijo step size along certain Gateaux derivatives of the performance functional, thereby avoiding some of the computational difficulties associated with discrete scheduling parameters. Its convergence to local minima as well as its rate of convergence are proved, and a simulation example on a nonlinear system exhibits quite a fast convergence.
△ Less
Submitted 15 July, 2011;
originally announced July 2011.
