Showing 1–3 of 3 results for author: Plumb, E

Simultaneous Best-Response Dynamics in Random Potential Games

Authors: Galit Ashkenazi-Golan, Domenico Mergoni Cecchelli, Edward Plumb

Abstract: This paper examines the convergence behaviour of simultaneous best-response dynamics in random potential games. We provide a theoretical result showing that, for two-player games with sufficiently many actions, the dynamics converge quickly to a cycle of length two. This cycle lies within the intersection of the neighbourhoods of two distinct Nash equilibria. For three players or more, simulations… ▽ More This paper examines the convergence behaviour of simultaneous best-response dynamics in random potential games. We provide a theoretical result showing that, for two-player games with sufficiently many actions, the dynamics converge quickly to a cycle of length two. This cycle lies within the intersection of the neighbourhoods of two distinct Nash equilibria. For three players or more, simulations show that the dynamics converge quickly to a Nash equilibrium with high probability. Furthermore, we show that all these results are robust, in the sense that they hold in non-potential games, provided the players' payoffs are sufficiently correlated. We also compare these dynamics to gradient-based learning methods in near-potential games with three players or more, and observe that simultaneous best-response dynamics converge to a Nash equilibrium of comparable payoff substantially faster. △ Less

Submitted 16 May, 2025; v1 submitted 15 May, 2025; originally announced May 2025.

Comments: 18 pages, 8 figures

Reinforcement Learning, Collusion, and the Folk Theorem

Authors: Galit Askenazi-Golan, Domenico Mergoni Cecchelli, Edward Plumb

Abstract: We explore the behaviour emerging from learning agents repeatedly interacting strategically for a wide range of learning dynamics that includes projected gradient, replicator and log-barrier dynamics. Going beyond the better-understood classes of potential games and zero-sum games, we consider the setting of a general repeated game with finite recall, for different forms of monitoring. We obtain a… ▽ More We explore the behaviour emerging from learning agents repeatedly interacting strategically for a wide range of learning dynamics that includes projected gradient, replicator and log-barrier dynamics. Going beyond the better-understood classes of potential games and zero-sum games, we consider the setting of a general repeated game with finite recall, for different forms of monitoring. We obtain a Folk Theorem-like result and characterise the set of payoff vectors that can be obtained by these dynamics, discovering a wide range of possibilities for the emergence of algorithmic collusion. △ Less

Submitted 19 November, 2024; originally announced November 2024.

Comments: arXiv admin note: text overlap with arXiv:2210.08857 by other authors

A Case Study of Agent-Based Models for Evolutionary Game Theory

Authors: Jacobus Smit, Ed Plumb

Abstract: Evolutionary game theory is a mathematical toolkit to analyse the interactions that an individual agent has in a population and how the composition of strategies in this population evolves over time. While it can provide neat solutions to simple problems, in more complicated situations where assumptions such as infinite population size may be relaxed, deriving analytic solutions can be intractable… ▽ More Evolutionary game theory is a mathematical toolkit to analyse the interactions that an individual agent has in a population and how the composition of strategies in this population evolves over time. While it can provide neat solutions to simple problems, in more complicated situations where assumptions such as infinite population size may be relaxed, deriving analytic solutions can be intractable. In this short paper, we present a game with complex interactions and examine how an agent-based model may be used as a heuristic technique to find evolutionarily stable states. △ Less

Submitted 4 September, 2021; originally announced September 2021.

Comments: 6 pages, 1 figure, accepted to Conference of Social Simulation 2021