Showing 1–12 of 12 results for author: Vainstein, M

Dilution, Diffusion and Symbiosis in Spatial Prisoner's Dilemma with Reinforcement Learning

Authors: Gustavo C. Mangold, Heitor C. M. Fernandes, Mendeli H. Vainstein

Abstract: Recent studies in the spatial prisoner's dilemma games with reinforcement learning have shown that static agents can learn to cooperate through a diverse sort of mechanisms, including noise injection, different types of learning algorithms and neighbours' payoff knowledge. In this work, using an independent multi-agent Q-learning algorithm, we study the effects of dilution and mobility in the spat… ▽ More Recent studies in the spatial prisoner's dilemma games with reinforcement learning have shown that static agents can learn to cooperate through a diverse sort of mechanisms, including noise injection, different types of learning algorithms and neighbours' payoff knowledge. In this work, using an independent multi-agent Q-learning algorithm, we study the effects of dilution and mobility in the spatial version of the prisoner's dilemma. Within this setting, different possible actions for the algorithm are defined, connecting with previous results on the classical, non-reinforcement learning spatial prisoner's dilemma, showcasing the versatility of the algorithm in modeling different game-theoretical scenarios and the benchmarking potential of this approach. As a result, a range of effects is observed, including evidence that games with fixed update rules can be qualitatively equivalent to those with learned ones, as well as the emergence of a symbiotic mutualistic effect between populations that forms when multiple actions are defined. △ Less

Submitted 4 July, 2025; v1 submitted 2 July, 2025; originally announced July 2025.

Comments: Re-submitted to fix typos

Anomalous behavior of Replicator dynamics for the Prisoner's Dilemma on diluted lattices

Authors: Fernanda R. Leivas, Heitor C. M. Fernandes, Mendeli H. Vainstein

Abstract: In diluted lattices, cooperation is often enhanced at specific densities, particularly near the percolation threshold for stochastic updating rules. However, the Replicator rule, despite being probabilistic, does not follow this trend. We find that this anomalous behavior is caused by structures formed by holes and defectors, which prevent some agents from experiencing fluctuations, thereby restri… ▽ More In diluted lattices, cooperation is often enhanced at specific densities, particularly near the percolation threshold for stochastic updating rules. However, the Replicator rule, despite being probabilistic, does not follow this trend. We find that this anomalous behavior is caused by structures formed by holes and defectors, which prevent some agents from experiencing fluctuations, thereby restricting the free flow of information across the network. As a result, the system becomes trapped in a frozen state, though this can be disrupted by introducing perturbations. Finally, we provide a more quantitative analysis of the relationship between the percolation threshold and cooperation, tracking its development within clusters of varying sizes and demonstrating how the percolation threshold shapes the fundamental structures of the lattice. △ Less

Submitted 18 September, 2024; originally announced September 2024.

Heterogeneous contributions can jeopardize cooperation in the Public Goods Game

Authors: Lucas S. Flores, Mendeli H. Vainstein, Heitor C. M. Fernandes, Marco A. Amaral

Abstract: When studying social dilemma games, a crucial question arises regarding the impact of general heterogeneity on cooperation, which has been shown to have positive effects in numerous studies. Here, we demonstrate that heterogeneity in the contribution value for the focal Public Goods Game can jeopardize cooperation. We show that there is an optimal contribution value in the homogeneous case that mo… ▽ More When studying social dilemma games, a crucial question arises regarding the impact of general heterogeneity on cooperation, which has been shown to have positive effects in numerous studies. Here, we demonstrate that heterogeneity in the contribution value for the focal Public Goods Game can jeopardize cooperation. We show that there is an optimal contribution value in the homogeneous case that most benefits cooperation depending on the lattice. In a heterogeneous scenario, where strategy and contribution coevolve, cooperators making contributions higher than the optimal value end up harming those who contribute lower. This effect is notably detrimental to cooperation in the square lattice with von Neumann neighborhood, while it can have no impact in others lattices. Furthermore, in parameter regions where a higher-contributing cooperator cannot normally survive alone, the exploitation of lower value contribution cooperators allows their survival, resembling a parasitic behavior. To obtain these results, we employed various distributions for the contribution values in the initial condition and conducted Monte Carlo simulations. △ Less

Submitted 22 May, 2023; v1 submitted 18 May, 2023; originally announced May 2023.

Cooperation in regular lattices

Authors: Lucas S. Flores, Marco A. Amaral, Mendeli H. Vainstein, Heitor C. M. Fernandes

Abstract: In the context of Evolutionary Game Theory, one of the most noteworthy mechanisms to support cooperation is spatial reciprocity, usually accomplished by distributing players in a spatial structure allowing cooperators to cluster together and avoid exploitation. This raises an important question: how is the survival of cooperation affected by different topologies? Here, to address this question, we… ▽ More In the context of Evolutionary Game Theory, one of the most noteworthy mechanisms to support cooperation is spatial reciprocity, usually accomplished by distributing players in a spatial structure allowing cooperators to cluster together and avoid exploitation. This raises an important question: how is the survival of cooperation affected by different topologies? Here, to address this question, we explore the Focal Public Goods (FPGG) and classic Public Goods Games (PGG), and the Prisoner's Dilemma (PD) on several regular lattices: honeycomb, square (with von Neumann and Moore neighborhoods), kagome, triangular, cubic, and 4D hypercubic lattices using both analytical methods and agent-based Monte Carlo simulations. We found that for both Public Goods Games, a consistent trend appears on all two-dimensional lattices: as the number of first neighbors increases, cooperation is enhanced. However, this is only visible by analysing the results in terms of the payoff's synergistic factor normalized by the number of connections. Besides this, clustered topologies, i.e., those that allow two connected players to share neighbors, are the most beneficial to cooperation for the FPGG. The same is not always true for the classic PGG, where having shared neighbors between connected players may or may not benefit cooperation. We also provide a reinterpretation of the classic PGG as a focal game by representing the lattice structure of this category of games as a single interaction game with longer-ranged, weighted neighborhoods, an approach valid for any regular lattice topology. Finally, we show that depending on the payoff parametrization of the PD, there can be an equivalency between the PD and the FPGG; when the mapping between the two games is imperfect, the definition of an effective synergy parameter can still be useful to show their similarities. △ Less

Submitted 5 July, 2022; originally announced July 2022.

Symbiotic behaviour in the Public Goods game with altruistic punishment

Authors: Lucas S. Flores, Heitor C. M. Fernandes, Marco A. Amaral, Mendeli H. Vainstein

Abstract: Finding ways to overcome the temptation to exploit one another is still a challenge in behavioural sciences. In the framework of evolutionary game theory, punishing strategies are frequently used to promote cooperation in competitive environments. Here, we introduce altruistic punishers in the spatial public goods game. This strategy acts as a cooperator in the absence of defectors, otherwise it w… ▽ More Finding ways to overcome the temptation to exploit one another is still a challenge in behavioural sciences. In the framework of evolutionary game theory, punishing strategies are frequently used to promote cooperation in competitive environments. Here, we introduce altruistic punishers in the spatial public goods game. This strategy acts as a cooperator in the absence of defectors, otherwise it will punish all defectors in their vicinity while bearing a cost to do so. We observe three distinct behaviours in our model: i) in the absence of punishers, cooperators (who don't punish defectors) are driven to extinction by defectors for most parameter values; ii) clusters of punishers thrive by sharing the punishment costs when these are low iii) for higher punishment costs, punishers, when alone, are subject to exploitation but in the presence of cooperators can form a symbiotic spatial structure that benefits both. This last observation is our main finding since neither cooperation nor punishment alone can survive the defector strategy in this parameter region and the specificity of the symbiotic spatial configuration shows that lattice topology plays a central role in sustaining cooperation. Results were obtained by means of Monte Carlo simulations on a square lattice and subsequently confirmed by a pairwise comparison of different strategies' payoffs in diverse group compositions, leading to a phase diagram of the possible states. △ Less

Submitted 13 April, 2021; v1 submitted 17 December, 2020; originally announced December 2020.

Exact solution for the Anisotropic Ornstein-Uhlenbeck Process

Authors: Rita M. C. de Almeida, Guilherme S. Y. Giardini, Mendeli Vainstein, James A. Glazier, Gilberto L. Thomas

Abstract: Active Matter models commonly consider particles with overdamped dynamics subject to a force (speed) with constant modulus and random direction. Some models include also random noise in particle displacement (Wiener process) resulting in a diffusive motion at short time scales. On the other hand, Ornstein-Uhlenbeck processes consider Langevin dynamics for the particle velocity and predict a motion… ▽ More Active Matter models commonly consider particles with overdamped dynamics subject to a force (speed) with constant modulus and random direction. Some models include also random noise in particle displacement (Wiener process) resulting in a diffusive motion at short time scales. On the other hand, Ornstein-Uhlenbeck processes consider Langevin dynamics for the particle velocity and predict a motion that is not diffusive at short time scales. However, experiments show that migrating cells may present a varying speed as well as a short-time diffusive behavior. While Ornstein-Uhlenbeck processes can describe the varying speed, Active Mater models can explain the short-time diffusive behavior. Isotropic models cannot explain both: short-time diffusion renders instantaneous velocity ill-defined, hence impeding dynamical equations that consider velocity time-derivatives. On the other hand, both models apply for migrating biological cells and must, in some limit, yield the same observable predictions. Here we propose and analytically solve an Anisotropic Ornstein-Uhlenbeck process that considers polarized particles, with a Langevin dynamics for the particle movement in the polarization direction while following a Wiener process for displacement in the orthogonal direction. Our characterization provides a theoretically robust way to compare movement in dimensionless simulations to movement in dimensionful experiments, besides proposing a procedure to deal with inevitable finite precision effects in experiments or simulations. △ Less

Submitted 21 April, 2021; v1 submitted 31 January, 2020; originally announced February 2020.

Spatial social dilemmas: dilution, mobility and grouping effects with imitation dynamics

Authors: Mendeli H. Vainstein, Jeferson J. Arenzon

Abstract: We present an extensive, systematic study of the Prisoner's Dilemma and Snowdrift games on a square lattice under a synchronous, noiseless imitation dynamics. We show that for both the occupancy of the network and the (random) mobility of the agents there are intermediate values that may increase the amount of cooperators in the system and new phases appear. We analytically determine the transitio… ▽ More We present an extensive, systematic study of the Prisoner's Dilemma and Snowdrift games on a square lattice under a synchronous, noiseless imitation dynamics. We show that for both the occupancy of the network and the (random) mobility of the agents there are intermediate values that may increase the amount of cooperators in the system and new phases appear. We analytically determine the transition lines between these phases and compare with the mean field prediction and the observed behavior on a square lattice. We point out which are the more relevant microscopic processes that entitle cooperators to invade a population of defectors in the presence of mobility and discuss the universality of these results. △ Less

Submitted 24 November, 2015; originally announced November 2015.

Comments: 13 pages, 13 figures

Journal ref: Physica A, v. 394, 145 (2014)

On the Modeling of Droplet Evaporation on Superhydrophobic Surfaces

Authors: Heitor C. M. Fernandes, Mendeli H. Vainstein, Carolina Brito

Abstract: When a drop of water is placed on a rough surface, there are two possible extreme regimes of wetting: the one called Cassie-Baxter (CB) with air pockets trapped underneath the droplet and the one characterized by the homogeneous wetting of the surface, called the Wenzel (W) state. A way to investigate the transition between these two states is by means of evaporation experiments, in which the drop… ▽ More When a drop of water is placed on a rough surface, there are two possible extreme regimes of wetting: the one called Cassie-Baxter (CB) with air pockets trapped underneath the droplet and the one characterized by the homogeneous wetting of the surface, called the Wenzel (W) state. A way to investigate the transition between these two states is by means of evaporation experiments, in which the droplet starts in a CB state and, as its volume decreases, penetrates the surface's grooves, reaching a W state. Here we present a theoretical model based on the global interfacial energies for CB and W states that allows us to predict the thermodynamic wetting state of the droplet for a given volume and surface texture. We first analyze the influence of the surface geometric parameters on the droplet's final wetting state with constant volume, and show that it depends strongly on the surface texture. We then vary the volume of the droplet keeping fixed the geometric surface parameters to mimic evaporation and show that the drop experiences a transition from the CB to the W state when its volume reduces, as observed in experiments. To investigate the dependency of the wetting state on the initial state of the droplet, we implement a cellular Potts model in three dimensions. Simulations show a very good agreement with theory when the initial state is W, but it disagrees when the droplet is initialized in a CB state, in accordance with previous observations which show that the CB state is metastable in many cases. Both simulations and theoretical model can be modified to study other types of surface. △ Less

Submitted 14 October, 2015; originally announced October 2015.

Comments: 23 pages, 7 figures

Journal ref: Langmuir, 2015, 31 (27), p 7652

Percolation and cooperation with mobile agents: Geometric and strategy clusters

Authors: Mendeli H. Vainstein, Carolina Brito, Jeferson J. Arenzon

Abstract: We study the conditions for persistent cooperation in an off-lattice model of mobile agents playing the Prisoner's Dilemma game with pure, unconditional strategies. Each agent has an exclusion radius rP, which accounts for the population viscosity, and an interaction radius rint, which defines the instantaneous contact network for the game dynamics. We show that, differently from the rP=0 case, th… ▽ More We study the conditions for persistent cooperation in an off-lattice model of mobile agents playing the Prisoner's Dilemma game with pure, unconditional strategies. Each agent has an exclusion radius rP, which accounts for the population viscosity, and an interaction radius rint, which defines the instantaneous contact network for the game dynamics. We show that, differently from the rP=0 case, the model with finite-sized agents presents a coexistence phase with both cooperators and defectors, besides the two absorbing phases, in which either cooperators or defectors dominate. We provide, in addition, a geometric interpretation of the transitions between phases. In analogy with lattice models, the geometric percolation of the contact network (i.e., irrespective of the strategy) enhances cooperation. More importantly, we show that the percolation of defectors is an essential condition for their survival. Differently from compact clusters of cooperators, isolated groups of defectors will eventually become extinct if not percolating, independently of their size. △ Less

Submitted 26 August, 2014; originally announced August 2014.

Journal ref: Phys. Rev. E 90, 022132 (2014)

A Simple Non-Markovian Computational Model of the Statistics of Soccer Leagues: Emergence and Scaling effects

Authors: Roberto da Silva, Mendeli Vainstein, Luis Lamb, Sandra Prado

Abstract: We propose a novel algorithm that outputs the final standings of a soccer league, based on a simple dynamics that mimics a soccer tournament. In our model, a team is created with a defined potential(ability) which is updated during the tournament according to the results of previous games. The updated potential modifies a teams' future winning/losing probabilities. We show that this evolutionary g… ▽ More We propose a novel algorithm that outputs the final standings of a soccer league, based on a simple dynamics that mimics a soccer tournament. In our model, a team is created with a defined potential(ability) which is updated during the tournament according to the results of previous games. The updated potential modifies a teams' future winning/losing probabilities. We show that this evolutionary game is able to reproduce the statistical properties of final standings of actual editions of the Brazilian tournament (Brasileirão). However, other leagues such as the Italian and the Spanish tournaments have notoriously non-Gaussian traces and cannot be straightforwardly reproduced by this evolutionary non-Markovian model. A complete understanding of these phenomena deserves much more attention, but we suggest a simple explanation based on data collected in Brazil: Here several teams were crowned champion in previous editions corroborating that the champion typically emerges from random fluctuations that partly preserves the gaussian traces during the tournament. On the other hand, in the Italian and Spanish leagues only a few teams in recent history have won their league tournaments. These leagues are based on more robust and hierarchical structures established even before the beginning of the tournament. For the sake of completeness, we also elaborate a totally Gaussian model (which equalizes the winning, drawing, and losing probabilities) and we show that the scores of the "Brasileirão" cannot be reproduced. Such aspects stress that evolutionary aspects are not superfluous in our modeling. Finally, we analyse the distortions of our model in situations where a large number of teams is considered, showing the existence of a transition from a single to a double peaked histogram of the final classification scores. An interesting scaling is presented for different sized tournaments. △ Less

Submitted 8 July, 2012; originally announced July 2012.

Comments: 18 pages, 9 figures

Random mobility and spatial structure often enhance cooperation

Authors: Estrella A. Sicardi, Hugo Fort, Mendeli H. Vainstein, Jeferson J. Arenzon

Abstract: The effects of an unconditional move rule in the spatial Prisoner's Dilemma, Snowdrift and Stag Hunt games are studied. Spatial structure by itself is known to modify the outcome of many games when compared with a randomly mixed population, sometimes promoting, sometimes inhibiting cooperation. Here we show that random dilution and mobility may suppress the inhibiting factors of the spatial stru… ▽ More The effects of an unconditional move rule in the spatial Prisoner's Dilemma, Snowdrift and Stag Hunt games are studied. Spatial structure by itself is known to modify the outcome of many games when compared with a randomly mixed population, sometimes promoting, sometimes inhibiting cooperation. Here we show that random dilution and mobility may suppress the inhibiting factors of the spatial structure in the Snowdrift game, while enhancing the already larger cooperation found in the Prisoner's dilemma and Stag Hunt games. △ Less

Submitted 9 September, 2008; originally announced September 2008.

Comments: Submitted to J. Theor. Biol

Journal ref: J. Theor. Biol. 256 (2009) 240

Does mobility decrease cooperation?

Authors: Mendeli H. Vainstein, Ana Tereza Costa Silva, Jeferson J. Arenzon

Abstract: We explore the minimal conditions for sustainable cooperation on a spatially distributed population of memoryless, unconditional strategies (cooperators and defectors) in presence of unbiased, non contingent mobility in the context of the Prisoner's Dilemma game. We find that cooperative behavior is not only possible but may even be enhanced by such an ``always-move'' rule, when compared with th… ▽ More We explore the minimal conditions for sustainable cooperation on a spatially distributed population of memoryless, unconditional strategies (cooperators and defectors) in presence of unbiased, non contingent mobility in the context of the Prisoner's Dilemma game. We find that cooperative behavior is not only possible but may even be enhanced by such an ``always-move'' rule, when compared with the strongly viscous (``never-move'') case. In addition, mobility also increases the capability of cooperation to emerge and invade a population of defectors, what may have a fundamental role in the problem of the onset of cooperation. △ Less

Submitted 12 September, 2006; v1 submitted 3 August, 2006; originally announced August 2006.

Comments: 8 pages, 6 figures, Extended discussion of results and clarification of some points, new refs. added, version to appear in J. Theor. Biol

Journal ref: Journal of Theoretical Biology, 2007, Vol 244/4 pp 722-728