Showing 1–36 of 36 results for author: Margellos, K

Distributed equilibrium seeking in aggregative games: linear convergence under singular perturbations lens

Authors: Guido Carnevale, Filippo Fabiani, Filiberto Fele, Kostas Margellos, Giuseppe Notarstefano

Abstract: We present a fully-distributed algorithm for Nash equilibrium seeking in aggregative games over networks. The proposed scheme endows each agent with a gradient-based scheme equipped with a tracking mechanism to locally reconstruct the aggregative variable, which is not available to the agents. We show that our method falls into the framework of singularly perturbed systems, as it involves the inte… ▽ More We present a fully-distributed algorithm for Nash equilibrium seeking in aggregative games over networks. The proposed scheme endows each agent with a gradient-based scheme equipped with a tracking mechanism to locally reconstruct the aggregative variable, which is not available to the agents. We show that our method falls into the framework of singularly perturbed systems, as it involves the interconnection between a fast subsystem - the global information reconstruction dynamics - with a slow one concerning the optimization of the local strategies. This perspective plays a key role in analyzing the scheme with a constant stepsize, and in proving its linear convergence to the Nash equilibrium in strongly monotone games with local constraints. By exploiting the flexibility of our aggregative variable definition (not necessarily the arithmetic average of the agents' strategy), we show the efficacy of our algorithm on a realistic voltage support case study for the smart grid. △ Less

Submitted 27 May, 2025; originally announced May 2025.

Comments: Presented at the 2024 IEEE 63rd Conference on Decision and Control (CDC), Milan, Italy. Accepted manuscript version, 7 pages. arXiv admin note: text overlap with arXiv:2210.14547

Journal ref: 2024 IEEE 63rd Conference on Decision and Control (CDC), Milan, Italy, 2024, pp. 3918-3923

Bridging conformal prediction and scenario optimization

Authors: Niall O'Sullivan, Licio Romao, Kostas Margellos

Abstract: Conformal prediction and scenario optimization constitute two important classes of statistical learning frameworks to certify decisions made using data. They have found numerous applications in control theory, machine learning and robotics. Despite intense research in both areas, and apparently similar results, a clear connection between these two frameworks has not been established. By focusing o… ▽ More Conformal prediction and scenario optimization constitute two important classes of statistical learning frameworks to certify decisions made using data. They have found numerous applications in control theory, machine learning and robotics. Despite intense research in both areas, and apparently similar results, a clear connection between these two frameworks has not been established. By focusing on the so-called vanilla conformal prediction, we show rigorously how to choose appropriate score functions and set predictor map to recover well-known bounds on the probability of constraint violation associated with scenario programs. We also show how to treat ranking of nonconformity scores as a one-dimensional scenario program with discarded constraints, and use such connection to recover vanilla conformal prediction guarantees on the validity of the set predictor. We also capitalize on the main developments of the scenario approach, and show how we could analyze calibration conditional conformal prediction under this lens. Our results establish a theoretical bridge between conformal prediction and scenario optimization. △ Less

Submitted 1 April, 2025; v1 submitted 30 March, 2025; originally announced March 2025.

Constraint Horizon in Model Predictive Control

Authors: Allan Andre Do Nascimento, Han Wang, Antonis Papachristodoulou, Kostas Margellos

Abstract: In this work, we propose a Model Predictive Control (MPC) formulation incorporating two distinct horizons: a prediction horizon and a constraint horizon. This approach enables a deeper understanding of how constraints influence key system properties such as suboptimality, without compromising recursive feasibility and constraint satisfaction. In this direction, our contributions are twofold. First… ▽ More In this work, we propose a Model Predictive Control (MPC) formulation incorporating two distinct horizons: a prediction horizon and a constraint horizon. This approach enables a deeper understanding of how constraints influence key system properties such as suboptimality, without compromising recursive feasibility and constraint satisfaction. In this direction, our contributions are twofold. First, we provide a framework to estimate closed-loop optimality as a function of the number of enforced constraints. This is a generalization of existing results by considering partial constraint enforcement over the prediction horizon. Second, when adopting this general framework under the lens of safety-critical applications, our method improves conventional Control Barrier Function (CBF) based approaches. It mitigates myopic behaviour in Quadratic Programming (QP)-CBF schemes, and resolves compatibility issues between Control Lyapunov Function (CLF) and CBF constraints via the prediction horizon used in the optimization. We show the efficacy of the method via numerical simulations for a safety critical application. △ Less

Submitted 24 March, 2025; originally announced March 2025.

Comments: submitted to L-CSS

Continuous-time Data-driven Barrier Certificate Synthesis

Authors: Luke Rickard, Alessandro Abate, Kostas Margellos

Abstract: We consider the problem of verifying safety for continuous-time dynamical systems. Developing upon recent advancements in data-driven verification, we use only a finite number of sampled trajectories to learn a barrier certificate, namely a function which verifies safety. We train a safety-informed neural network to act as this certificate, with an appropriately designed loss function to encompass… ▽ More We consider the problem of verifying safety for continuous-time dynamical systems. Developing upon recent advancements in data-driven verification, we use only a finite number of sampled trajectories to learn a barrier certificate, namely a function which verifies safety. We train a safety-informed neural network to act as this certificate, with an appropriately designed loss function to encompass the safety conditions. In addition, we provide probabilistic generalisation guarantees from discrete samples of continuous trajectories, to unseen continuous ones. Numerical investigations demonstrate the efficacy of our approach and contrast it with related results in the literature. △ Less

Submitted 17 March, 2025; originally announced March 2025.

Comments: Submitted to L-CSS and CDC. arXiv admin note: text overlap with arXiv:2502.05510

Data-Driven Neural Certificate Synthesis

Authors: Luke Rickard, Alessandro Abate, Kostas Margellos

Abstract: We investigate the problem of verifying different properties of discrete time dynamical systems, namely, reachability, safety and reach-while-avoid. To achieve this, we adopt a data driven perspective and using past systems' trajectories as data, we aim at learning a specific function termed \emph{certificate} for each property we wish to verify. The certificate construction problem is treated as… ▽ More We investigate the problem of verifying different properties of discrete time dynamical systems, namely, reachability, safety and reach-while-avoid. To achieve this, we adopt a data driven perspective and using past systems' trajectories as data, we aim at learning a specific function termed \emph{certificate} for each property we wish to verify. The certificate construction problem is treated as a safety informed neural network training process, where we use a neural network to learn the parameterization of each certificate, while the loss function we seek to minimize is designed to encompass conditions on the certificate to be learned that encode the satisfaction of the associated property. Besides learning a certificate, we quantify probabilistically its generalization properties, namely, how likely it is for a certificate to be valid (and hence for the associated property to be satisfied) when it comes to a new system trajectory not included in the training data set. We view this problem under the realm of probably approximately correct (PAC) learning under the notion of compression, and use recent advancements of the so-called scenario approach to obtain scalable generalization bounds on the learned certificates. To achieve this, we design a novel algorithm that minimizes the loss function and hence constructs a certificate, and at the same time determines a quantity termed compression, which is instrumental in obtaining meaningful probabilistic guarantees. This process is novel per se and provides a constructive mechanism for compression set calculation, thus opening the road for its use to more general non-convex optimization problems. We verify the efficacy of our methodology on several numerical case studies, and compare it (both theoretically and numerically) with closely related results on data-driven property verification. △ Less

Submitted 3 April, 2025; v1 submitted 8 February, 2025; originally announced February 2025.

Comments: 18 pages, submitted to Automatica

Probabilistically safe controllers based on control barrier functions and scenario model predictive control

Authors: Allan Andre do Nascimento, Antonis Papachristodoulou, Kostas Margellos

Abstract: Control barrier functions (CBFs) offer an efficient framework for designing real-time safe controllers. However, CBF-based controllers can be short-sighted, resulting in poor performance, a behaviour which is aggravated in uncertain conditions. This motivated research on safety filters based on model predictive control (MPC) and its stochastic variant. MPC deals with safety constraints in a direct… ▽ More Control barrier functions (CBFs) offer an efficient framework for designing real-time safe controllers. However, CBF-based controllers can be short-sighted, resulting in poor performance, a behaviour which is aggravated in uncertain conditions. This motivated research on safety filters based on model predictive control (MPC) and its stochastic variant. MPC deals with safety constraints in a direct manner, however, its computational demands grow with the prediction horizon length. We propose a safety formulation that solves a finite horizon optimization problem at each time instance like MPC, but rather than explicitly imposing constraints along the prediction horizon, we enforce probabilistic safety constraints by means of CBFs only at the first step of the horizon. The probabilistic CBF constraints are transformed in a finite number of deterministic CBF constraints via the scenario based methodology. Capitalizing on results on scenario based MPC, we provide distribution-free, \emph{a priori} guarantees on the system's closed loop expected safety violation frequency. We demonstrate our results through a case study on unmanned aerial vehicle collision-free position swapping, and provide a numerical comparison with recent stochastic CBF formulations. △ Less

Submitted 12 September, 2024; v1 submitted 10 September, 2024; originally announced September 2024.

Comments: To be published in: The 63rd IEEE Conference on Decision and Control (CDC-2024 Milano, Italy)

Safe and Stable Filter Design Using a Relaxed Compatibitlity Control Barrier -- Lyapunov Condition

Authors: Han Wang, Kostas Margellos, Antonis Papachristodoulou

Abstract: In this paper, we propose a quadratic programming-based filter for safe and stable controller design, via a Control Barrier Function (CBF) and a Control Lyapunov Function (CLF). Our method guarantees safety and local asymptotic stability without the need for an asymptotically stabilizing control law. Feasibility of the proposed program is ensured under a mild regularity condition, termed relaxed c… ▽ More In this paper, we propose a quadratic programming-based filter for safe and stable controller design, via a Control Barrier Function (CBF) and a Control Lyapunov Function (CLF). Our method guarantees safety and local asymptotic stability without the need for an asymptotically stabilizing control law. Feasibility of the proposed program is ensured under a mild regularity condition, termed relaxed compatibility between the CLF and CBF. The resulting optimal control law is guaranteed to be locally Lipschitz continuous. We also analyze the closed-loop behaviour by characterizing the equilibrium points, and verifying that there are no equilibrium points in the interior of the control invariant set except at the origin. For a polynomial system and a semi-algebraic safe set, we provide a sum-of-squares program to design a relaxed compatible pair of CLF and CBF. The proposed approach is compared with other methods in the literature using numerical examples, exhibits superior filter performance and guarantees safety and local stability. △ Less

Submitted 29 June, 2024; originally announced July 2024.

Robust optimization for adversarial learning with finite sample complexity guarantees

Authors: André Bertolace, Konstatinos Gatsis, Kostas Margellos

Abstract: Decision making and learning in the presence of uncertainty has attracted significant attention in view of the increasing need to achieve robust and reliable operations. In the case where uncertainty stems from the presence of adversarial attacks this need is becoming more prominent. In this paper we focus on linear and nonlinear classification problems and propose a novel adversarial training met… ▽ More Decision making and learning in the presence of uncertainty has attracted significant attention in view of the increasing need to achieve robust and reliable operations. In the case where uncertainty stems from the presence of adversarial attacks this need is becoming more prominent. In this paper we focus on linear and nonlinear classification problems and propose a novel adversarial training method for robust classifiers, inspired by Support Vector Machine (SVM) margins. We view robustness under a data driven lens, and derive finite sample complexity bounds for both linear and non-linear classifiers in binary and multi-class scenarios. Notably, our bounds match natural classifiers' complexity. Our algorithm minimizes a worst-case surrogate loss using Linear Programming (LP) and Second Order Cone Programming (SOCP) for linear and non-linear models. Numerical experiments on the benchmark MNIST and CIFAR10 datasets show our approach's comparable performance to state-of-the-art methods, without needing adversarial examples during training. Our work offers a comprehensive framework for enhancing binary linear and non-linear classifier robustness, embedding robustness in learning under the presence of adversaries. △ Less

Submitted 22 March, 2024; originally announced March 2024.

Convex Co-Design of Control Barrier Function and Safe Feedback Controller Under Input Constraints

Authors: Han Wang, Kostas Margellos, Antonis Papachristodoulou, Claudio De Persis

Abstract: We study the problem of co-designing control barrier functions (CBF) and linear state feedback controllers for continuous-time linear systems. We achieve this by means of a single semi-definite optimization program. Our formulation can handle mixed-relative degree problems without requiring an explicit safe controller. Different L-norm based input limitations can be introduced as convex constraint… ▽ More We study the problem of co-designing control barrier functions (CBF) and linear state feedback controllers for continuous-time linear systems. We achieve this by means of a single semi-definite optimization program. Our formulation can handle mixed-relative degree problems without requiring an explicit safe controller. Different L-norm based input limitations can be introduced as convex constraints in the proposed program. We demonstrate our results on an omni-directional car numerical example. △ Less

Submitted 18 March, 2024; originally announced March 2024.

Comments: manuscript submitted to TAC

Probably approximately correct stability of allocations in uncertain coalitional games with private sampling

Authors: George Pantazis, Filiberto Fele, Filippo Fabiani, Sergio Grammatico, Kostas Margellos

Abstract: We study coalitional games with exogenous uncertainty in the coalition value, in which each agent is allowed to have private samples of the uncertainty. As a consequence, the agents may have a different perception of stability of the grand coalition. In this context, we propose a novel methodology to study the out-of-sample coalitional rationality of allocations in the set of stable allocations (i… ▽ More We study coalitional games with exogenous uncertainty in the coalition value, in which each agent is allowed to have private samples of the uncertainty. As a consequence, the agents may have a different perception of stability of the grand coalition. In this context, we propose a novel methodology to study the out-of-sample coalitional rationality of allocations in the set of stable allocations (i.e., the core). Our analysis builds on the framework of probably approximately correct learning. Initially, we state a priori and a posteriori guarantees for the entire core. Furthermore, we provide a distributed algorithm to compute a compression set that determines the generalization properties of the a posteriori statements. We then refine our probabilistic robustness bounds by specialising the analysis to a single payoff allocation, taking, also in this case, both a priori and a posteriori approaches. Finally, we consider a relaxed $ζ$-core to include nearby allocations and also address the case of empty core. For this case, probabilistic statements are given on the eventual stability of allocations in the $ζ$-core. △ Less

Submitted 13 December, 2023; originally announced December 2023.

Learning Robust Policies for Uncertain Parametric Markov Decision Processes

Authors: Luke Rickard, Alessandro Abate, Kostas Margellos

Abstract: Synthesising verifiably correct controllers for dynamical systems is crucial for safety-critical problems. To achieve this, it is important to account for uncertainty in a robust manner, while at the same time it is often of interest to avoid being overly conservative with the view of achieving a better cost. We propose a method for verifiably safe policy synthesis for a class of finite state mode… ▽ More Synthesising verifiably correct controllers for dynamical systems is crucial for safety-critical problems. To achieve this, it is important to account for uncertainty in a robust manner, while at the same time it is often of interest to avoid being overly conservative with the view of achieving a better cost. We propose a method for verifiably safe policy synthesis for a class of finite state models, under the presence of structural uncertainty. In particular, we consider uncertain parametric Markov decision processes (upMDPs), a special class of Markov decision processes, with parameterised transition functions, where such parameters are drawn from a (potentially) unknown distribution. Our framework leverages recent advancements in the so-called scenario approach theory, where we represent the uncertainty by means of scenarios, and provide guarantees on synthesised policies satisfying probabilistic computation tree logic (PCTL) formulae. We consider several common benchmarks/problems and compare our work to recent developments for verifying upMDPs. △ Less

Submitted 15 May, 2024; v1 submitted 11 December, 2023; originally announced December 2023.

Comments: 10 pages, accepted for oral presentation at L4DC

Homomorphically encrypted gradient descent algorithms for quadratic programming

Authors: André Bertolace, Konstantinos Gatsis, Kostas Margellos

Abstract: In this paper, we evaluate the different fully homomorphic encryption schemes, propose an implementation, and numerically analyze the applicability of gradient descent algorithms to solve quadratic programming in a homomorphic encryption setup. The limit on the multiplication depth of homomorphic encryption circuits is a major challenge for iterative procedures such as gradient descent algorithms.… ▽ More In this paper, we evaluate the different fully homomorphic encryption schemes, propose an implementation, and numerically analyze the applicability of gradient descent algorithms to solve quadratic programming in a homomorphic encryption setup. The limit on the multiplication depth of homomorphic encryption circuits is a major challenge for iterative procedures such as gradient descent algorithms. Our analysis not only quantifies these limitations on prototype examples, thus serving as a benchmark for future investigations, but also highlights additional trade-offs like the ones pertaining the choice of gradient descent or accelerated gradient descent methods, opening the road for the use of homomorphic encryption techniques in iterative procedures widely used in optimization based control. In addition, we argue that, among the available homomorphic encryption schemes, the one adopted in this work, namely CKKS, is the only suitable scheme for implementing gradient descent algorithms. The choice of the appropriate step size is crucial to the convergence of the procedure. The paper shows firsthand the feasibility of homomorphically encrypted gradient descent algorithms. △ Less

Submitted 4 September, 2023; originally announced September 2023.

Distributionally robust stability of payoff allocations in stochastic coalitional games

Authors: George Pantazis, Barbara Franci, Sergio Grammatico, Kostas Margellos

Abstract: We consider multi-agent coalitional games with uncertainty in the coalitional values. We provide a novel methodology to study the stability of the grand coalition in the case where each coalition constructs ambiguity sets for the (possibly) unknown probability distribution of the uncertainty. As a less conservative solution concept compared to worst-case approaches for coalitional stability, we co… ▽ More We consider multi-agent coalitional games with uncertainty in the coalitional values. We provide a novel methodology to study the stability of the grand coalition in the case where each coalition constructs ambiguity sets for the (possibly) unknown probability distribution of the uncertainty. As a less conservative solution concept compared to worst-case approaches for coalitional stability, we consider a stochastic version of the so-called core set, i.e., the expected value core. Unfortunately, without exact knowledge of the probability distribution, the evaluation of the expected value core is an extremely challenging task. Hence, we propose the concept of distributionaly robust (DR) core. Leveraging tools from data-driven DR optimization under the Wasserstein distance, we provide finite-sample guarantees that any allocation which lies in the DR core is also stable with respect to the true probability distribution. Furthermore, we show that as the number of samples grows unbounded, the DR core converges almost surely to the true expected value core. We dedicate the last section to the computational tractability of finding an allocation in the DR core. △ Less

Submitted 2 September, 2023; v1 submitted 4 April, 2023; originally announced April 2023.

Comments: Accepted for publication at the IEEE Conference on Decision and Control 2023

Distributed Safe Control Design and Probabilistic Safety Verification for Multi-Agent Systems

Authors: Han Wang, Antonis Papachristodoulou, Kostas Margellos

Abstract: We propose distributed iterative algorithms for safe control design and safety verification for networked multi-agent systems. These algorithms rely on distributing a control barrier function (CBF) related quadratic programming (QP) problem assuming the existence of CBFs. The proposed distributed algorithm addresses infeasibility issues of existing schemes via a cooperation mechanism between agent… ▽ More We propose distributed iterative algorithms for safe control design and safety verification for networked multi-agent systems. These algorithms rely on distributing a control barrier function (CBF) related quadratic programming (QP) problem assuming the existence of CBFs. The proposed distributed algorithm addresses infeasibility issues of existing schemes via a cooperation mechanism between agents. The resulting control input is guaranteed to be optimal, and satisfies CBF constraints of all agents. Furthermore, a truncated algorithm is proposed to facilitate computational implementation. The performance of the truncated algorithm is evaluated using a distributed safety verification algorithm. The algorithm quantifies safety for multi-agent systems probabilistically by means of CBFs. Both upper and lower bounds on the probability of safety are obtained using the so called scenario approach. Both the scenario sampling and safety verification procedures are fully distributed. The efficacy of our algorithms is demonstrated by an example on multi-robot collision avoidance. △ Less

Submitted 24 March, 2025; v1 submitted 22 March, 2023; originally announced March 2023.

Comments: manuscript accepted by Automatica

State Aggregation for Distributed Value Iteration in Dynamic Programming

Authors: Nikolaus Vertovec, Kostas Margellos

Abstract: We propose a distributed algorithm to solve a dynamic programming problem with multiple agents, where each agent has only partial knowledge of the state transition probabilities and costs. We provide consensus proofs for the presented algorithm and derive error bounds of the obtained value function with respect to what is considered as the "true solution" obtained from conventional value iteration… ▽ More We propose a distributed algorithm to solve a dynamic programming problem with multiple agents, where each agent has only partial knowledge of the state transition probabilities and costs. We provide consensus proofs for the presented algorithm and derive error bounds of the obtained value function with respect to what is considered as the "true solution" obtained from conventional value iteration. To minimize communication overhead between agents, state costs are aggregated and shared between agents only when the updated costs are expected to influence the solution of other agents significantly. We demonstrate the efficacy of the proposed distributed aggregation method to a large-scale urban traffic routing problem. Individual agents compute the fastest route to a common access point and share local congestion information with other agents allowing for fully distributed routing with minimal communication between agents. △ Less

Submitted 15 June, 2023; v1 submitted 19 March, 2023; originally announced March 2023.

Comments: 6 pages, 4 figures

Multi-objective low-thrust spacecraft trajectory design using reachability analysis

Authors: Nikolaus Vertovec, Sina Ober-Blöbaum, Kostas Margellos

Abstract: One of the fundamental problems in spacecraft trajectory design is finding the optimal transfer trajectory that minimizes the propellant consumption and transfer time simultaneously. We formulate this as a multi-objective optimal control (MOC) problem that involves optimizing over the initial or final state, subject to state constraints. Drawing on recent developments in reachability analysis subj… ▽ More One of the fundamental problems in spacecraft trajectory design is finding the optimal transfer trajectory that minimizes the propellant consumption and transfer time simultaneously. We formulate this as a multi-objective optimal control (MOC) problem that involves optimizing over the initial or final state, subject to state constraints. Drawing on recent developments in reachability analysis subject to state constraints, we show that the proposed MOC problem can be stated as an optimization problem subject to a constraint that involves the sub-level set of the viscosity solution of a quasi-variational inequality. We then generalize this approach to account for more general optimal control problems in Bolza form. We relate these problems to the Pareto front of the developed multi-objective programs. The proposed approach is demonstrated on two low-thrust orbital transfer problems around a rotating asteroid. △ Less

Submitted 14 December, 2022; originally announced December 2022.

Comments: Paper published in European Journal of Control, 28 pages, 7 figures

Safety-Aware Hybrid Control of Airborne Wind Energy Systems

Authors: Nikolaus Vertovec, Sina Ober-Blöbaum, Kostas Margellos

Abstract: A fundamental concern in progressing Airborne Wind Energy (AWE) operations towards commercial success, is guaranteeing that safety requirements placed on the systems are met. Due to the high dimensional complexity of AWE systems, however, formal mathematical robustness guarantees become difficult to compute. We draw on research from Hamilton-Jacobi (HJ) reachability analysis to compute the optimal… ▽ More A fundamental concern in progressing Airborne Wind Energy (AWE) operations towards commercial success, is guaranteeing that safety requirements placed on the systems are met. Due to the high dimensional complexity of AWE systems, however, formal mathematical robustness guarantees become difficult to compute. We draw on research from Hamilton-Jacobi (HJ) reachability analysis to compute the optimal control policy for tracking a flight path, while enforcing safety constraints on the system. In addition, the zero-sublevel set of the computed value function inherent in HJ reachability analysis indicates the backward reachable set, the set of states from which it is possible to safely drive the system into a target set within a given time without entering undesirable states. Furthermore, we derive a switching law, such that the safety controller can be used in conjunction with arbitrary least restrictive controllers to provide a safe hybrid control law. In such a setup, the safety controller is only activated when the system approaches the boundary of its maneuverability envelope. Such a hybrid control law is a notable improvement over existing robust control approaches that deteriorate performance by assuming the worst-case environmental and system behavior at all times. We illustrate our results via extensive simulation-based studies. △ Less

Submitted 14 December, 2022; originally announced December 2022.

Comments: 30 pages, 15 figures

Tracking-based distributed equilibrium seeking for aggregative games

Authors: Guido Carnevale, Filippo Fabiani, Filiberto Fele, Kostas Margellos, Giuseppe Notarstefano

Abstract: We propose fully-distributed algorithms for Nash equilibrium seeking in aggregative games over networks. We first consider the case where local constraints are present and we design an algorithm combining, for each agent, (i) the projected pseudo-gradient descent and (ii) a tracking mechanism to locally reconstruct the aggregative variable. To handle coupling constraints arising in generalized set… ▽ More We propose fully-distributed algorithms for Nash equilibrium seeking in aggregative games over networks. We first consider the case where local constraints are present and we design an algorithm combining, for each agent, (i) the projected pseudo-gradient descent and (ii) a tracking mechanism to locally reconstruct the aggregative variable. To handle coupling constraints arising in generalized settings, we propose another distributed algorithm based on (i) a recently emerged augmented primal-dual scheme and (ii) two tracking mechanisms to reconstruct, for each agent, both the aggregative variable and the coupling constraint satisfaction. Leveraging tools from singular perturbations analysis, we prove linear convergence to the Nash equilibrium for both schemes. Finally, we run extensive numerical simulations to confirm the effectiveness of our methods and compare them with state-of-the-art distributed equilibrium-seeking algorithms. △ Less

Submitted 12 February, 2024; v1 submitted 26 October, 2022; originally announced October 2022.

Safe Controlled Invariance for Linear Systems Using Sum-of-Squares Programming

Authors: Han Wang, Kostas Margellos, Antonis Papachristodoulou

Abstract: Safety is closely related to set invariance for dynamical systems. However, synthesizing a safe invariant set and at the same time synthesizing the associated safe controller still remains challenging. In this note we introduce a simple invariance-based method for linear systems with safety guarantee. The proposed method uses sum-of-squares programming. Safety is closely related to set invariance for dynamical systems. However, synthesizing a safe invariant set and at the same time synthesizing the associated safe controller still remains challenging. In this note we introduce a simple invariance-based method for linear systems with safety guarantee. The proposed method uses sum-of-squares programming. △ Less

Submitted 4 July, 2022; v1 submitted 1 July, 2022; originally announced July 2022.

Comments: submitted to POEMA as an extended abstract

Safety-Aware Optimal Control for Motion Planning with Low Computing Complexity

Authors: Xuda Ding, Han Wang, Jianping He, Cailian Chen, Kostas Margellos, Antonis Papachristodoulou

Abstract: The existence of multiple irregular obstacles in the environment introduces nonconvex constraints into the optimization for motion planning, which makes the optimal control problem hard to handle. One efficient approach to address this issue is Successive Convex Approximation (SCA), where the nonconvex problem is convexified and solved successively. However, this approach still faces two main chal… ▽ More The existence of multiple irregular obstacles in the environment introduces nonconvex constraints into the optimization for motion planning, which makes the optimal control problem hard to handle. One efficient approach to address this issue is Successive Convex Approximation (SCA), where the nonconvex problem is convexified and solved successively. However, this approach still faces two main challenges: I) infeasibility, caused by linearisation about infeasible reference points; ii) high computational complexity incurred by multiple constraints, when solving the optimal control problem with a long planning horizon and multiple obstacles. To overcome these challanges, this paper proposes an energy efficient safetyaware control method for motion planning with low computing complexity and address these challenges. Specifically, a control barrier function-based linear quadratic regulator is formulated for the motion planning to guarantee safety and energy efficiency. Then, to avoid infeasibility, Backward Receding SCA (BRSCA) approach with a dynamic constraints-selection rule is proposed. Dynamic programming with primal-dual iteration is designed to decrease computational complexity. It is found that BRSCA is applicable to time-varying control limits. Numerical simulations and hardware experiments vevify the efficiency of BRSCA. Simulations demonstrates that BRSCA has a higher probability of finding feasible solutions, reduces the computation time by about 17.4% and the energy cost by about four times compared to other methods in the literature. △ Less

Submitted 9 November, 2022; v1 submitted 28 April, 2022; originally announced April 2022.

A Time-Triggered Dimension Reduction Algorithm for the Task Assignment Problem

Authors: Han Wang, Kostas Margellos, Antonis Papachristodoulou

Abstract: The task assignment problem is fundamental in combinatorial optimisation, aiming at allocating one or more tasks to a number of agents while minimizing the total cost or maximizing the overall assignment benefit. This problem is known to be computationally hard since it is usually formulated as a mixed-integer programming problem. In this paper, we consider a novel time-triggered dimension reducti… ▽ More The task assignment problem is fundamental in combinatorial optimisation, aiming at allocating one or more tasks to a number of agents while minimizing the total cost or maximizing the overall assignment benefit. This problem is known to be computationally hard since it is usually formulated as a mixed-integer programming problem. In this paper, we consider a novel time-triggered dimension reduction algorithm (TTDRA). We propose convexification approaches to convexify both the constraints and the cost function for the general non-convex assignment problem. The computational speed is accelerated via our time-triggered dimension reduction scheme, where the triggering condition is designed based on the optimality tolerance and the convexity of the cost function. Optimality and computational efficiency are verified via numerical simulations on benchmark examples. △ Less

Submitted 25 April, 2022; originally announced April 2022.

Safety Verification and Controller Synthesis for Systems with Input Constraints

Authors: Han Wang, Kostas Margellos, Antonis Papachristodoulou

Abstract: In this paper we consider the safety verification and safe controller synthesis problems for nonlinear control systems. The Control Barrier Certificates (CBC) approach is proposed as an extension to the Barrier certificates approach. Our approach can be used to characterize the control invariance of a given set in terms of safety of a general nonlinear control system subject to input constraints.… ▽ More In this paper we consider the safety verification and safe controller synthesis problems for nonlinear control systems. The Control Barrier Certificates (CBC) approach is proposed as an extension to the Barrier certificates approach. Our approach can be used to characterize the control invariance of a given set in terms of safety of a general nonlinear control system subject to input constraints. From the point of view of controller design, the proposed method provides an approach to synthesize a safe control law that guarantees that the trajectories of the system starting from a given initial set do not enter an unsafe set. Unlike the related control Barrier functions approach, our formulation only considers the vector field within the tangent cone of the zero level set defined by the certificates, and is shown to be less conservative by means of numerical evidence. For polynomial systems with semi-algebraic initial and safe sets, CBCs and safe control laws can be synthesized using sum-of-squares decomposition and semi-definite programming. Examples demonstrate our method. △ Less

Submitted 21 April, 2022; v1 submitted 20 April, 2022; originally announced April 2022.

Explicit Solutions for Safety Problems Using Control Barrier Functions

Authors: Han Wang, Kostas Margellos, Antonis Papachristodoulou

Abstract: The control Barrier function approach has been widely used for safe controller synthesis. By solving an online convex quadratic programming problem, an optimal safe controller can be synthesized implicitly in state-space. Since the solution is unique, the mapping from state-space to control inputs is injective, thus enabling us to evaluate the underlying relationship. In this paper we aim at expli… ▽ More The control Barrier function approach has been widely used for safe controller synthesis. By solving an online convex quadratic programming problem, an optimal safe controller can be synthesized implicitly in state-space. Since the solution is unique, the mapping from state-space to control inputs is injective, thus enabling us to evaluate the underlying relationship. In this paper we aim at explicitly synthesizing a safe control law as a function of the state for nonlinear control-affine systems with limited control ability. We propose to transform the online quadratic programming problem into an offline parameterized optimisation problem which considers states as parameters. The obtained explicit safe controller is shown to be a piece-wise Lipschitz continuous function over the partitioned state space if the program is feasible. We address the infeasible cases by solving a parameterized adaptive control Barrier function-based quadratic programming problem. Extensive simulation results show the state-space partition and the controller properties. △ Less

Submitted 21 April, 2022; v1 submitted 20 April, 2022; originally announced April 2022.

Verification of safety critical control policies using kernel methods

Authors: Nikolaus Vertovec, Sina Ober-Blöbaum, Kostas Margellos

Abstract: Hamilton-Jacobi reachability methods for safety-critical control have been well studied, but the safety guarantees derived rely on the accuracy of the numerical computation. Thus, it is crucial to understand and account for any inaccuracies that occur due to uncertainty in the underlying dynamics and environment as well as the induced numerical errors. To this end, we propose a framework for model… ▽ More Hamilton-Jacobi reachability methods for safety-critical control have been well studied, but the safety guarantees derived rely on the accuracy of the numerical computation. Thus, it is crucial to understand and account for any inaccuracies that occur due to uncertainty in the underlying dynamics and environment as well as the induced numerical errors. To this end, we propose a framework for modeling the error of the value function inherent in Hamilton-Jacobi reachability using a Gaussian process. The derived safety controller can be used in conjuncture with arbitrary controllers to provide a safe hybrid control law. The marginal likelihood of the Gaussian process then provides a confidence metric used to determine switches between a least restrictive controller and a safety controller. We test both the prediction as well as the correction capabilities of the presented method in a classical pursuit-evasion example. △ Less

Submitted 23 March, 2022; originally announced March 2022.

Comments: Paper published in 2022 European Control Conference (ECC), 6 pages, 4 figures

Probabilistically robust stabilizing allocations in uncertain coalitional games

Authors: George Pantazis, Filippo Fabiani, Filiberto Fele, Kostas Margellos

Abstract: In this paper we consider multi-agent coalitional games with uncertain value functions for which we establish distribution-free guarantees on the probability of allocation stability, i.e., agents do not have incentives to defect from the grand coalition to form subcoalitions for unseen realizations of the uncertain parameter. In case the set of stable allocations, the so called core of the game, i… ▽ More In this paper we consider multi-agent coalitional games with uncertain value functions for which we establish distribution-free guarantees on the probability of allocation stability, i.e., agents do not have incentives to defect from the grand coalition to form subcoalitions for unseen realizations of the uncertain parameter. In case the set of stable allocations, the so called core of the game, is empty, we propose a randomized relaxation of the core. We then show that those allocations that belong to this relaxed set can be accompanied by stability guarantees in a probably approximately correct fashion. Finally, numerical experiments corroborate our theoretical findings. △ Less

Submitted 23 June, 2022; v1 submitted 21 March, 2022; originally announced March 2022.

On the sensitivity of linear resource sharing problems to the arrival of new agents

Authors: Alessandro Falsone, Kostas Margellos, Jacopo Zizzo, Maria Prandini, Simone Garatti

Abstract: We consider a multi-agent optimal resource sharing problem that is represented by a linear program. The amount of resource to be shared is fixed, and agents belong to a population that is characterized probabilistically so as to allow heterogeneity among the agents. In this paper, we provide a characterization of the probability that the arrival of a new agent affects the resource share of other a… ▽ More We consider a multi-agent optimal resource sharing problem that is represented by a linear program. The amount of resource to be shared is fixed, and agents belong to a population that is characterized probabilistically so as to allow heterogeneity among the agents. In this paper, we provide a characterization of the probability that the arrival of a new agent affects the resource share of other agents, which means that accommodating the new agent request at the detriment of the other agents allocation provides some payoff. This probability represents a sensitivity index for the optimal solution of a linear programming resource sharing problem when a new agent shows up, and it is of fundamental importance for a correct and profitable operation of the multi-agent system. Our developments build on the equivalence between the resource sharing problem and certain dual reformulations which can be interpreted as scenario programs with the number of scenarios corresponding to the number of agents in the primal problem. The recent "wait-and-judge" scenario approach is then used to obtain the sought sensitivity index. Our theoretical findings are demonstrated through a numerical example on optimal cargo aircraft loading. △ Less

Submitted 28 September, 2021; originally announced September 2021.

Comments: 14 pages, 3 figures

Multi-objective minimum time optimal control for low-thrust trajectory design

Authors: Nikolaus Vertovec, Sina Ober-Blöbaum, Kostas Margellos

Abstract: We propose a reachability approach for infinite and finite horizon multi-objective optimization problems for low-thrust spacecraft trajectory design. The main advantage of the proposed method is that the Pareto front can be efficiently constructed from the zero level set of the solution to a Hamilton-Jacobi-Bellman equation. We demonstrate the proposed method by applying it to a low-thrust spacecr… ▽ More We propose a reachability approach for infinite and finite horizon multi-objective optimization problems for low-thrust spacecraft trajectory design. The main advantage of the proposed method is that the Pareto front can be efficiently constructed from the zero level set of the solution to a Hamilton-Jacobi-Bellman equation. We demonstrate the proposed method by applying it to a low-thrust spacecraft trajectory design problem. By deriving the analytic expression for the Hamiltonian and the optimal control policy, we are able to efficiently compute the backward reachable set and reconstruct the optimal trajectories. Furthermore, we show that any reconstructed trajectory will be guaranteed to be weakly Pareto optimal. The proposed method can be used as a benchmark for future research of applying reachability analysis to low-thrust spacecraft trajectory design. △ Less

Submitted 17 February, 2022; v1 submitted 15 March, 2021; originally announced March 2021.

Comments: Extended version of the paper published in 2021 European Control Conference (ECC), 9 pages, 2 figures

Probabilistic stabilizability certificates for a class of black-box linear systems

Authors: Filippo Fabiani, Kostas Margellos, Paul J. Goulart

Abstract: We provide out-of-sample certificates on the controlled invariance property of a given set with respect to a class of black-box linear systems. Specifically, we consider linear time-invariant models whose state space matrices are known only to belong to a certain family due to a possibly inexact quantification of some parameters. By exploiting a set of realizations of those undetermined parameters… ▽ More We provide out-of-sample certificates on the controlled invariance property of a given set with respect to a class of black-box linear systems. Specifically, we consider linear time-invariant models whose state space matrices are known only to belong to a certain family due to a possibly inexact quantification of some parameters. By exploiting a set of realizations of those undetermined parameters, verifying the controlled invariance property of the given set amounts to a linear program, whose feasibility allows us to establish an a-posteriori probabilistic certificate on the controlled invariance property of such a set with respect to the nominal linear time-invariant dynamics. The proposed framework is applied to the control of a networked multi-agent system with unknown weighted graph. △ Less

Submitted 4 March, 2021; originally announced March 2021.

On the probabilistic feasibility of solutions in multi-agent optimization problems under uncertainty

Authors: George Pantazis, Filiberto Fele, Kostas Margellos

Abstract: We investigate the probabilistic feasibility of randomized solutions to two distinct classes of uncertain multi-agent optimization programs. We first assume that only the constraints of the program are affected by uncertainty, while the cost function is arbitrary. Leveraging recent a posteriori developments of the scenario approach, we provide probabilistic guarantees for all feasible solutions of… ▽ More We investigate the probabilistic feasibility of randomized solutions to two distinct classes of uncertain multi-agent optimization programs. We first assume that only the constraints of the program are affected by uncertainty, while the cost function is arbitrary. Leveraging recent a posteriori developments of the scenario approach, we provide probabilistic guarantees for all feasible solutions of the program under study. This result is particularly useful in cases where numerical difficulties related to the convergence of the solution-seeking algorithm hinder the exact quantification of the optimal solution. Furthermore, it can be applied to cases where the agents' incentives lead to a suboptimal solution, e.g., under a non-cooperative setting. We then focus on optimization programs where the cost function admits an aggregate representation and depends on uncertainty while constraints are deterministic. By exploiting the structure of the program under study and leveraging the so called support rank notion, we provide agent-independent robustness certificates for the optimal solution, i.e., the constructed bound on the probability of constraint violation does not depend on the number of agents, but only on the dimension of the agents' decision. This substantially reduces the number of samples required to achieve a certain level of probabilistic robustness as the number of agents increases. All robustness certificates provided in this paper are distribution-free and can be used alongside any optimization algorithm. Our theoretical results are accompanied by a numerical case study involving a charging control problem of a fleet of electric vehicles. △ Less

Submitted 28 September, 2020; v1 submitted 6 September, 2020; originally announced September 2020.

Probabilistic feasibility guarantees for solution sets to uncertain variational inequalities

Authors: Filippo Fabiani, Kostas Margellos, Paul J. Goulart

Abstract: We develop a data-driven approach to the computation of a-posteriori feasibility certificates to the solution sets of variational inequalities affected by uncertainty. Specifically, we focus on instances of variational inequalities with a deterministic mapping and an uncertain feasibility set, and represent uncertainty by means of scenarios. Building upon recent advances in the scenario approach l… ▽ More We develop a data-driven approach to the computation of a-posteriori feasibility certificates to the solution sets of variational inequalities affected by uncertainty. Specifically, we focus on instances of variational inequalities with a deterministic mapping and an uncertain feasibility set, and represent uncertainty by means of scenarios. Building upon recent advances in the scenario approach literature, we quantify the robustness properties of the entire set of solutions of a variational inequality, with feasibility set constructed using the scenario approach, against a new unseen realization of the uncertainty. Our results extend existing results that typically impose an assumption that the solution set is a singleton and require certain non-degeneracy properties, and thereby offer probabilistic feasibility guarantees to any feasible solution. We show that assessing the violation probability of an entire set of solutions, rather than of a singleton, requires enumeration of the support constraints that "shape" this set. Additionally, we propose a general procedure to enumerate the support constraints that does not require a closed form description of the solution set, which is unlikely to be available. We show that robust game theory problems can be modelling via uncertain variational inequalities, and illustrate our theoretical results through extensive numerical simulations on a case study involving an electric vehicle charging coordination problem. △ Less

Submitted 4 November, 2020; v1 submitted 19 May, 2020; originally announced May 2020.

On the robustness of equilibria in generalized aggregative games

Authors: Filippo Fabiani, Kostas Margellos, Paul J. Goulart

Abstract: We address the problem of assessing the robustness of the equilibria in uncertain, multi-agent games. Specifically, we focus on generalized Nash equilibrium problems in aggregative form subject to linear coupling constraints affected by uncertainty with a possibly unknown probability distribution. Within a data-driven context, we apply the scenario approach paradigm to provide a-posteriori feasibi… ▽ More We address the problem of assessing the robustness of the equilibria in uncertain, multi-agent games. Specifically, we focus on generalized Nash equilibrium problems in aggregative form subject to linear coupling constraints affected by uncertainty with a possibly unknown probability distribution. Within a data-driven context, we apply the scenario approach paradigm to provide a-posteriori feasibility certificates for the entire set of generalized Nash equilibria of the game. Then, we show that assessing the violation probability of such set merely requires to enumerate the constraints that ``shape'' it. For the class of aggregative games, this results in solving a feasibility problem on each active facet of the feasibility region, for which we propose a semi-decentralized algorithm. We demonstrate our theoretical results by means of an academic example. △ Less

Submitted 19 May, 2020; originally announced May 2020.

An incremental scenario approach for building energy management with uncertain occupancy

Authors: Arman Karshenas, Kostas Margellos, Simone Garatti

Abstract: We deal with the problem of energy management in buildings subject to uncertain occupancy. To this end, we formulate this as a finite horizon optimization program and optimize with respect to the windows' blinds position, radiator and cooling flux. Aiming at a schedule which is robust with respect to uncertain occupancy levels while avoiding imposing arbitrary assumptions on the underlying probabi… ▽ More We deal with the problem of energy management in buildings subject to uncertain occupancy. To this end, we formulate this as a finite horizon optimization program and optimize with respect to the windows' blinds position, radiator and cooling flux. Aiming at a schedule which is robust with respect to uncertain occupancy levels while avoiding imposing arbitrary assumptions on the underlying probability distribution of the uncertainty, we follow a data driven paradigm. In particular, we apply an incremental scenario approach methodology that has been recently proposed in the literature to our energy management formulation. To demonstrate the efficacy of the proposed implementation we provide a detailed numerical analysis on a stylized building and compare it with respect to a deterministic design and the standard scenario approach typically encountered in the literature. We show that our schedule is not agnostic with respect to uncertainty as deterministic approaches, while it requires fewer scenarios with respect to the standard scenario approach, thus resulting in a less conservative performance. △ Less

Submitted 15 November, 2019; originally announced November 2019.

Probably Approximately Correct Nash Equilibrium Learning

Authors: Filiberto Fele, Kostas Margellos

Abstract: We consider a multi-agent noncooperative game with agents' objective functions being affected by uncertainty. Following a data driven paradigm, we represent uncertainty by means of scenarios and seek a robust Nash equilibrium solution. We treat the Nash equilibrium computation problem within the realm of probably approximately correct (PAC) learning. Building upon recent developments in scenario-b… ▽ More We consider a multi-agent noncooperative game with agents' objective functions being affected by uncertainty. Following a data driven paradigm, we represent uncertainty by means of scenarios and seek a robust Nash equilibrium solution. We treat the Nash equilibrium computation problem within the realm of probably approximately correct (PAC) learning. Building upon recent developments in scenario-based optimization, we accompany the computed Nash equilibrium with a priori and a posteriori probabilistic robustness certificates, providing confidence that the computed equilibrium remains unaffected (in probabilistic terms) when a new uncertainty realization is encountered. For a wide class of games, we also show that the computation of the so called compression set - a key concept in scenario-based optimization - can be directly obtained as a byproduct of the proposed solution methodology. Finally, we illustrate how to overcome differentiability issues, arising due to the introduction of scenarios, and compute a Nash equilibrium solution in a decentralized manner. We demonstrate the efficacy of the proposed approach on an electric vehicle charging control problem. △ Less

Submitted 24 April, 2020; v1 submitted 25 March, 2019; originally announced March 2019.

Comments: Preprint submitted to IEEE Transactions on Automatic Control

Journal ref: IEEE Transactions on Automatic Control, 2020

On the computational complexity and generalization properties of multi-stage and recursive scenario programs

Authors: Nikolaos Kariotoglou, Kostas Margellos, John Lygeros

Abstract: We discuss the computational complexity and feasibility properties of scenario based techniques for uncertain optimization programs. We consider different solution alternatives ranging from the standard scenario approach to recursive variants, and compare feasibility as a function of the total computation burden. We identify trade-offs between the different methods depending on the problem structu… ▽ More We discuss the computational complexity and feasibility properties of scenario based techniques for uncertain optimization programs. We consider different solution alternatives ranging from the standard scenario approach to recursive variants, and compare feasibility as a function of the total computation burden. We identify trade-offs between the different methods depending on the problem structure and the desired probability of constraint satisfaction. Our motivation for this work stems from the applicability and complexity reduction when making decisions by means of recursive algorithms. We illustrate our results on an example from the area of approximate dynamic programming △ Less

Submitted 13 December, 2014; originally announced December 2014.

On the connection between compression learning and scenario based optimization

Authors: Kostas Margellos, Maria Prandini, John Lygeros

Abstract: We investigate the connections between compression learning and scenario based optimization. We first show how to strengthen, or relax the consistency assumption at the basis of compression learning and study the learning and generalization properties of the algorithm involved. We then consider different constrained optimization problems affected by uncertainty represented by means of scenarios. W… ▽ More We investigate the connections between compression learning and scenario based optimization. We first show how to strengthen, or relax the consistency assumption at the basis of compression learning and study the learning and generalization properties of the algorithm involved. We then consider different constrained optimization problems affected by uncertainty represented by means of scenarios. We show that the issue of providing guarantees on the probability of constraint violation reduces to a learning problem for an appropriately chosen algorithm that enjoys compression learning properties. The compression learning perspective provides a unifying framework for scenario based optimization and allows us to revisit the scenario approach and the probabilistically robust design, a recently developed technique based on a mixture of randomized and robust optimization, and to extend the guarantees on the probability of constraint violation to cascading optimization problems. △ Less

Submitted 6 March, 2014; v1 submitted 4 March, 2014; originally announced March 2014.

Comments: 29 pages, shorter version submitted to the IEEE Transactions on Automatic Control

A scenario approach for non-convex control design

Authors: Sergio Grammatico, Xiaojing Zhang, Kostas Margellos, Paul Goulart, John Lygeros

Abstract: Randomized optimization is an established tool for control design with modulated robustness. While for uncertain convex programs there exist randomized approaches with efficient sampling, this is not the case for non-convex problems. Approaches based on statistical learning theory are applicable to non-convex problems, but they usually are conservative in terms of performance and require high samp… ▽ More Randomized optimization is an established tool for control design with modulated robustness. While for uncertain convex programs there exist randomized approaches with efficient sampling, this is not the case for non-convex problems. Approaches based on statistical learning theory are applicable to non-convex problems, but they usually are conservative in terms of performance and require high sample complexity to achieve the desired probabilistic guarantees. In this paper, we derive a novel scenario approach for a wide class of random non-convex programs, with a sample complexity similar to that of uncertain convex programs and with probabilistic guarantees that hold not only for the optimal solution of the scenario program, but for all feasible solutions inside a set of a-priori chosen complexity. We also address measure-theoretic issues for uncertain convex and non-convex programs. Among the family of non-convex control- design problems that can be addressed via randomization, we apply our scenario approach to randomized Model Predictive Control for chance-constrained nonlinear control-affine systems. △ Less

Submitted 9 January, 2014; originally announced January 2014.

Comments: Submitted to IEEE Transactions on Automatic Control