-
Stability of singularly perturbed hybrid systems with restricted systems evolving on boundary layer manifolds
Authors:
Suad Krilašević,
Sergio Grammatico
Abstract:
We present a singular perturbation theory applicable to systems with hybrid boundary layer systems and hybrid reduced systems {with} jumps from the boundary layer manifold. First, we prove practical attractivity of an adequate attractor set for small enough tuning parameters and sufficiently long time between almost all jumps. Second, under mild conditions on the jump mapping, we prove semi-global…
▽ More
We present a singular perturbation theory applicable to systems with hybrid boundary layer systems and hybrid reduced systems {with} jumps from the boundary layer manifold. First, we prove practical attractivity of an adequate attractor set for small enough tuning parameters and sufficiently long time between almost all jumps. Second, under mild conditions on the jump mapping, we prove semi-global practical asymptotic stability of a restricted attractor set. Finally, for certain classes of dynamics, we prove semi-global practical asymptotic stability of the restricted attractor set for small enough tuning parameters and sufficiently long period between almost all jumps of the slow states only.
△ Less
Submitted 31 March, 2023;
originally announced March 2023.
-
A discrete-time averaging theorem and its application to zeroth-order Nash equilibrium seeking
Authors:
Suad Krilašević,
Sergio Grammatico
Abstract:
In this paper we present an averaging technique applicable to the design of zeroth-order Nash equilibrium seeking algorithms. First, we propose a multi-timescale discrete-time averaging theorem that requires only that the equilibrium is semi-globally practically stabilized by the averaged system, while also allowing the averaged system to depend on ``fast" states. Furthermore, sequential applicati…
▽ More
In this paper we present an averaging technique applicable to the design of zeroth-order Nash equilibrium seeking algorithms. First, we propose a multi-timescale discrete-time averaging theorem that requires only that the equilibrium is semi-globally practically stabilized by the averaged system, while also allowing the averaged system to depend on ``fast" states. Furthermore, sequential application of the theorem is possible, which enables its use for multi-layer algorithm design. Second, we apply the aforementioned averaging theorem to prove semi-global practical convergence of the zeroth-order information variant of the discrete-time projected pseudogradient descent algorithm, in the context of strongly monotone, constrained Nash equilibrium problems. Third, we use the averaging theory to prove the semi-global practical convergence of the asynchronous pseudogradient descent algorithm to solve strongly monotone unconstrained Nash equilibrium problems. Lastly, we apply the proposed asynchronous algorithm to the connectivity control problem in multi-agent systems.
△ Less
Submitted 9 February, 2023;
originally announced February 2023.
-
Learning generalized Nash equilibria in monotone games: A hybrid adaptive extremum seeking control approach
Authors:
Suad Krilašević,
Sergio Grammatico
Abstract:
In this paper, we solve the problem of learning a generalized Nash equilibrium (GNE) in merely monotone games. First, we propose a novel continuous semi-decentralized solution algorithm without projections that uses first-order information to compute a GNE with a central coordinator. As the second main contribution, we design a gain adaptation scheme for the previous algorithm in order to alleviat…
▽ More
In this paper, we solve the problem of learning a generalized Nash equilibrium (GNE) in merely monotone games. First, we propose a novel continuous semi-decentralized solution algorithm without projections that uses first-order information to compute a GNE with a central coordinator. As the second main contribution, we design a gain adaptation scheme for the previous algorithm in order to alleviate the problem of improper scaling of the cost functions versus the constraints. Third, we propose a data-driven variant of the former algorithm, where each agent estimates their individual pseudogradient via zeroth-order information, namely, measurements of their individual cost function values. Finally, we apply our method to a perturbation amplitude optimization problem in oil extraction engineering.
△ Less
Submitted 6 October, 2021; v1 submitted 30 September, 2021;
originally announced September 2021.
-
An extremum seeking algorithm for monotone Nash equilibrium problems
Authors:
Suad Krilašević,
Sergio Grammatico
Abstract:
In this paper we consider the problem of finding a Nash equilibrium (NE) via zeroth-order feedback information in games with merely monotone pseudogradient mapping. Based on hybrid system theory, we propose a novel extremum seeking algorithm which converges to the set of Nash equilibria in a semi-global practical sense. Finally, we present two simulation examples. The first shows that the standard…
▽ More
In this paper we consider the problem of finding a Nash equilibrium (NE) via zeroth-order feedback information in games with merely monotone pseudogradient mapping. Based on hybrid system theory, we propose a novel extremum seeking algorithm which converges to the set of Nash equilibria in a semi-global practical sense. Finally, we present two simulation examples. The first shows that the standard extremum seeking algorithm fails, while ours succeeds in reaching NE. In the second, we simulate an allocation problem with fixed demand.
△ Less
Submitted 16 September, 2021;
originally announced September 2021.
-
Learning generalized Nash equilibria in multi-agent dynamical systems via extremum seeking control
Authors:
Suad Krilašević,
Sergio Grammatico
Abstract:
In this paper, we consider the problem of learning a generalized Nash equilibrium (GNE) in strongly monotone games. First, we propose a novel continuous-time solution algorithm that uses regular projections and first-order information. As second main contribution, we design a data-driven variant of the former algorithm where each agent estimates their individual pseudo-gradient via zero-order info…
▽ More
In this paper, we consider the problem of learning a generalized Nash equilibrium (GNE) in strongly monotone games. First, we propose a novel continuous-time solution algorithm that uses regular projections and first-order information. As second main contribution, we design a data-driven variant of the former algorithm where each agent estimates their individual pseudo-gradient via zero-order information, namely, measurements of their individual cost function values, as typical of extremum seeking control. Third, we generalize our setup and results for multi-agent systems with nonlinear dynamics. Finally, we apply our algorithms to connectivity control in robotic sensor networks and distributed wind farm optimization.
△ Less
Submitted 21 July, 2020;
originally announced July 2020.
-
An integral Nash equilibrium control scheme for a class of multi-agent linear systems
Authors:
Suad Krilašević,
Sergio Grammatico
Abstract:
We propose an integral Nash equilibrium seeking control (I-NESC) law which steers the multi-agent system composed of a special class of linear agents to the neighborhood of the Nash equilibrium in noncooperative strongly monotone games. First, we prove that there exist parameters of the integral controller such that the system converges to the Nash equilibrium in the full-information case, in othe…
▽ More
We propose an integral Nash equilibrium seeking control (I-NESC) law which steers the multi-agent system composed of a special class of linear agents to the neighborhood of the Nash equilibrium in noncooperative strongly monotone games. First, we prove that there exist parameters of the integral controller such that the system converges to the Nash equilibrium in the full-information case, in other words, without the parameter estimation scheme used in extremum seeking algorithms. Then we prove that there exist parameters of the I-NESC such that the system converges to the neighborhood of the Nash equilibrium in the limited information case where parameter estimation is used. We provide a simulation example that demonstrates that smaller perturbation frequencies and amplitudes are needed to attain similar convergence speed as the existing state-of-the-art algorithm.
△ Less
Submitted 21 November, 2019;
originally announced November 2019.