Showing 1–10 of 10 results for author: Shamma, J S

Competition-Based Resilience in Distributed Quadratic Optimization

Authors: Luca Ballotta, Giacomo Como, Jeff S. Shamma, Luca Schenato

Abstract: This paper proposes a novel approach to resilient distributed optimization with quadratic costs in a networked control system (e.g., wireless sensor network, power grid, robotic team) prone to external attacks (e.g., hacking, power outage) that cause agents to misbehave. Departing from classical filtering strategies proposed in literature, we draw inspiration from a game-theoretic formulation of t… ▽ More This paper proposes a novel approach to resilient distributed optimization with quadratic costs in a networked control system (e.g., wireless sensor network, power grid, robotic team) prone to external attacks (e.g., hacking, power outage) that cause agents to misbehave. Departing from classical filtering strategies proposed in literature, we draw inspiration from a game-theoretic formulation of the consensus problem and argue that adding competition to the mix can enhance resilience in the presence of malicious agents. Our intuition is corroborated by analytical and numerical results showing that i) our strategy highlights the presence of a nontrivial tradeoff between blind collaboration and full competition, and ii) such competition-based approach can outperform state-of-the-art algorithms based on Mean Subsequence Reduced. △ Less

Submitted 10 January, 2024; v1 submitted 26 March, 2022; originally announced March 2022.

Comments: 7 pages, 8 figures; accepted for CDC 2022

MSC Class: 93B70 (Primary) 68M18; 93D09; 93D50 (Secondary) ACM Class: I.2.11

Journal ref: Proceedings of the IEEE Conference on Decision and Control, pp. 6454-6459, 2022

Network Effects on Robustness of Dynamic Systems

Authors: Ketan Savla, Jeff S. Shamma, Munther A. Dahleh

Abstract: We review selected results related to robustness of networked systems in finite and asymptotically large size regimes, under static and dynamical settings. In the static setting, within the framework of flow over finite networks, we discuss the effect of physical constraints on robustness to loss in link capacities. In the dynamical setting, we review several settings in which small gain type anal… ▽ More We review selected results related to robustness of networked systems in finite and asymptotically large size regimes, under static and dynamical settings. In the static setting, within the framework of flow over finite networks, we discuss the effect of physical constraints on robustness to loss in link capacities. In the dynamical setting, we review several settings in which small gain type analysis provides tight robustness guarantees for linear dynamics over finite networks towards worst-case and stochastic disturbances. We also discuss network flow dynamic settings where nonlinear techniques facilitate in understanding the effect on robustness of constraints on capacity and information, substituting information with control action, and cascading failure. We also contrast the latter with a representative contagion model. For asymptotically large networks, we discuss the role of network properties in connecting microscopic shocks to emergent macroscopic fluctuations under linear dynamics as well as for economic networks at equilibrium. Through the review of these results, the paper aims to achieve two objectives. First, to highlight selected settings in which the role of interconnectivity structure of a network on its robustness is well-understood. Second, to highlight a few additional settings in which existing system theoretic tools give tight robustness guarantees, and which are also appropriate avenues for future network-theoretic investigations. △ Less

Submitted 13 September, 2019; originally announced September 2019.

Comments: To appear in Annual Review of Control, Robotics, and Autonomous Systems

Payoff Dynamics Model and Evolutionary Dynamics Model: Feedback and Convergence to Equilibria

Authors: Shinkyu Park, Nuno C. Martins, Jeff S. Shamma

Abstract: This tutorial article puts forth a framework to analyze the noncooperative strategic interactions among the members of a large population of bounded rationality agents. Our approach hinges on, unifies and generalizes existing methods and models predicated in evolutionary and population games. It does so by adopting a system-theoretic formalism that is well-suited for a broad engineering audience f… ▽ More This tutorial article puts forth a framework to analyze the noncooperative strategic interactions among the members of a large population of bounded rationality agents. Our approach hinges on, unifies and generalizes existing methods and models predicated in evolutionary and population games. It does so by adopting a system-theoretic formalism that is well-suited for a broad engineering audience familiar with the basic tenets of nonlinear dynamical systems, Lyapunov stability, storage functions, and passivity. The framework is pertinent for engineering applications in which a large number of agents have the authority to select and repeatedly revise their strategies. A mechanism that is inherent to the problem at hand or is designed and implemented by a coordinator ascribes a payoff to each possible strategy. Typically, the agents will prioritize switching to strategies whose payoff is either higher than the current one or exceeds the population average. The article puts forth a systematic methodology to characterize the stability of the dynamical system that results from the feedback interaction between the payoff mechanism and the revision process. This is important because the set of stable equilibria is an accurate predictor of the population's long-term behavior. The article includes rigorous proofs and examples of application of the stability results, which also extend the state of the art because, unlike previously published work, they allow for a rather general class of dynamical payoff mechanisms. The new results and concepts proposed here are thoroughly compared to previous work, methods and applications of evolutionary and population games. △ Less

Submitted 14 July, 2020; v1 submitted 5 March, 2019; originally announced March 2019.

Passivity and Evolutionary Game Dynamics

Authors: Shinkyu Park, Jeff S. Shamma, Nuno C. Martins

Abstract: This paper investigates an energy conservation and dissipation -- passivity -- aspect of dynamic models in evolutionary game theory. We define a notion of passivity using the state-space representation of the models, and we devise systematic methods to examine passivity and to identify properties of passive dynamic models. Based on the methods, we describe how passivity is connected to stability i… ▽ More This paper investigates an energy conservation and dissipation -- passivity -- aspect of dynamic models in evolutionary game theory. We define a notion of passivity using the state-space representation of the models, and we devise systematic methods to examine passivity and to identify properties of passive dynamic models. Based on the methods, we describe how passivity is connected to stability in population games and illustrate stability of passive dynamic models using numerical simulations. △ Less

Submitted 21 March, 2018; originally announced March 2018.

Energy Aware Architecture for Coordinated Mobility: An Approximate Dynamic Programming Approach

Authors: Hassan Jaleel, Jeff S. Shamma

Abstract: Our goal is to design distributed coordination strategies that enable agents to achieve global performance guarantees while minimizing the energy cost of their actions with an emphasis on feasibility for real-time implementation. As a motivating scenario that illustrates the importance of introducing energy awareness at the agent level, we consider a team of mobile nodes that are assigned the task… ▽ More Our goal is to design distributed coordination strategies that enable agents to achieve global performance guarantees while minimizing the energy cost of their actions with an emphasis on feasibility for real-time implementation. As a motivating scenario that illustrates the importance of introducing energy awareness at the agent level, we consider a team of mobile nodes that are assigned the task of establishing a communication link between two base stations with minimum energy consumption. We formulate this problem as a dynamic program in which the total cost of each agent is the sum of both mobility and communication costs. To ensure that the solution is distributed and real time implementable, we propose multiple suboptimal policies based on the concepts of approximate dynamic programming. To provide performance guarantees, we compute upper bounds on the performance gap between the proposed suboptimal policies and the global optimal policy. Finally, we discuss merits and demerits of the proposed policies and compare their performance using simulations. △ Less

Submitted 25 July, 2016; originally announced July 2016.

Comments: 25 pages

Global Games with Noisy Information Sharing

Authors: Hessam Mahdavifar, Ahmad Beirami, Behrouz Touri, Jeff S. Shamma

Abstract: Global games form a subclass of games with incomplete information where a set of agents decide actions against a regime with an underlying fundamental $θ$ representing its power. Each agent has access to an independent noisy observation of $θ$. In order to capture the behavior of agents in a social network of information exchange we assume that agents share their observation in a noisy environment… ▽ More Global games form a subclass of games with incomplete information where a set of agents decide actions against a regime with an underlying fundamental $θ$ representing its power. Each agent has access to an independent noisy observation of $θ$. In order to capture the behavior of agents in a social network of information exchange we assume that agents share their observation in a noisy environment prior to making their decision. We show that global games with noisy sharing of information do not admit an intuitive type of threshold policy which only depends on agents' belief about the underlying $θ$. This is in contrast to the existing results on the threshold policy for the conventional set-up of global games. Motivated by this result, we investigate the existence of equilibrium strategies in a more general collection of threshold-type policies and show that such equilibrium strategies exist and are unique if the sharing of information happens over a sufficiently noisy environment. △ Less

Submitted 28 October, 2017; v1 submitted 28 October, 2015; originally announced October 2015.

Comments: Accepted to IEEE Transactions on Signal and Information Processing over Networks

Communication-Free Distributed Coverage for Networked Systems

Authors: A. Yasin Yazicioglu, Magnus Egerstedt, Jeff S. Shamma

Abstract: In this paper, we present a communication-free algorithm for distributed coverage of an arbitrary network by a group of mobile agents with local sensing capabilities. The network is represented as a graph, and the agents are arbitrarily deployed on some nodes of the graph. Any node of the graph is covered if it is within the sensing range of at least one agent. The agents are mobile devices that a… ▽ More In this paper, we present a communication-free algorithm for distributed coverage of an arbitrary network by a group of mobile agents with local sensing capabilities. The network is represented as a graph, and the agents are arbitrarily deployed on some nodes of the graph. Any node of the graph is covered if it is within the sensing range of at least one agent. The agents are mobile devices that aim to explore the graph and to optimize their locations in a decentralized fashion by relying only on their sensory inputs. We formulate this problem in a game theoretic setting and propose a communication-free learning algorithm for maximizing the coverage. △ Less

Submitted 23 May, 2015; originally announced May 2015.

Formation of Robust Multi-Agent Networks Through Self-Organizing Random Regular Graphs

Authors: A. Yasin Yazicioglu, Magnus Egerstedt, Jeff S. Shamma

Abstract: Multi-agent networks are often modeled as interaction graphs, where the nodes represent the agents and the edges denote some direct interactions. The robustness of a multi-agent network to perturbations such as failures, noise, or malicious attacks largely depends on the corresponding graph. In many applications, networks are desired to have well-connected interaction graphs with relatively small… ▽ More Multi-agent networks are often modeled as interaction graphs, where the nodes represent the agents and the edges denote some direct interactions. The robustness of a multi-agent network to perturbations such as failures, noise, or malicious attacks largely depends on the corresponding graph. In many applications, networks are desired to have well-connected interaction graphs with relatively small number of links. One family of such graphs is the random regular graphs. In this paper, we present a decentralized scheme for transforming any connected interaction graph with a possibly non-integer average degree of k into a connected random m-regular graph for some m in [k, k + 2]. Accordingly, the agents improve the robustness of the network with a minimal change in the overall sparsity by optimizing the graph connectivity through the proposed local operations. △ Less

Submitted 27 March, 2015; originally announced March 2015.

Dynamics in atomic signaling games

Authors: Michael J. Fox, Behrouz Touri, Jeff S. Shamma

Abstract: We study an atomic signaling game under stochastic evolutionary dynamics. There is a finite number of players who repeatedly update from a finite number of available languages/signaling strategies. Players imitate the most fit agents with high probability or mutate with low probability. We analyze the long-run distribution of states and show that, for sufficiently small mutation probability, its s… ▽ More We study an atomic signaling game under stochastic evolutionary dynamics. There is a finite number of players who repeatedly update from a finite number of available languages/signaling strategies. Players imitate the most fit agents with high probability or mutate with low probability. We analyze the long-run distribution of states and show that, for sufficiently small mutation probability, its support is limited to efficient communication systems. We find that this behavior is insensitive to the particular choice of evolutionary dynamic, a property that is due to the game having a potential structure with a potential function corresponding to average fitness. Consequently, the model supports conclusions similar to those found in the literature on language competition. That is, we show that efficient languages eventually predominate the society while reproducing the empirical phenomenon of linguistic drift. The emergence of efficiency in the atomic case can be contrasted with results for non-atomic signaling games that establish the non-negligible possibility of convergence, under replicator dynamics, to states of unbounded efficiency loss. △ Less

Submitted 20 December, 2013; originally announced December 2013.

Multiple-Model Adaptive Control With Set-Valued Observers

Authors: Paulo Rosa, Carlos Silvestre, Jeff S. Shamma, Michael Athans

Abstract: This paper proposes a multiple-model adaptive control methodology, using set-valued observers (MMAC-SVO) for the identification subsystem, that is able to provide robust stability and performance guarantees for the closed-loop, when the plant, which can be open-loop stable or unstable, has significant parametric uncertainty. We illustrate, with an example, how set-valued observers (SVOs) can be… ▽ More This paper proposes a multiple-model adaptive control methodology, using set-valued observers (MMAC-SVO) for the identification subsystem, that is able to provide robust stability and performance guarantees for the closed-loop, when the plant, which can be open-loop stable or unstable, has significant parametric uncertainty. We illustrate, with an example, how set-valued observers (SVOs) can be used to select regions of uncertainty for the parameters of the plant. We also discuss some of the most problematic computational shortcomings and numerical issues that arise from the use of this kind of robust estimation methods. The behavior of the proposed control algorithm is demonstrated in simulation. △ Less

Submitted 2 October, 2009; v1 submitted 7 September, 2009; originally announced September 2009.

Comments: Combined 48th IEEE Conference on Decision and Control and 28th Chinese Control Conference, 2009