-
The co-evolution of direct, indirect and generalized reciprocity
Authors:
Saptarshi Pal,
Christian Hilbe,
Nikoleta E Glynatsi
Abstract:
People often engage in costly cooperation, especially in repeated interactions. When deciding whether to cooperate, individuals typically take into account how others have acted in the past. For instance, when one person is deciding whether to cooperate with another, they may consider how they were treated by the other party (direct reciprocity), how the other party treated others (indirect recipr…
▽ More
People often engage in costly cooperation, especially in repeated interactions. When deciding whether to cooperate, individuals typically take into account how others have acted in the past. For instance, when one person is deciding whether to cooperate with another, they may consider how they were treated by the other party (direct reciprocity), how the other party treated others (indirect reciprocity), or how they themselves were treated by others in general (generalized reciprocity). Given these different approaches, it is unclear which strategy, or more specifically which mode of reciprocity, individuals will prefer. This study introduces a model where individuals decide how much weight to give each type of information when choosing to cooperate. Through equilibrium analysis, we find that all three modes of reciprocity can be sustained when individuals have sufficiently frequent interactions. However, the existence of such equilibria does not guarantee that individuals will learn to use them. Simulations show that when individuals mainly imitate others, generalized reciprocity often hinders cooperation, leading to defection even under conditions favorable to cooperation. In contrast, when individuals explore new strategies during learning, stable cooperation emerges through direct reciprocity. This study highlights the importance of studying all forms of reciprocity in unison.
△ Less
Submitted 5 November, 2024;
originally announced November 2024.
-
Indirect reciprocity under opinion synchronization
Authors:
Yohsuke Murase,
Christian Hilbe
Abstract:
Indirect reciprocity is a key explanation for the exceptional magnitude of cooperation among humans. This literature suggests that a large proportion of human cooperation is driven by social norms and individuals' incentives to maintain a good reputation. This intuition has been formalized with two types of models. In public assessment models, all community members are assumed to agree on each oth…
▽ More
Indirect reciprocity is a key explanation for the exceptional magnitude of cooperation among humans. This literature suggests that a large proportion of human cooperation is driven by social norms and individuals' incentives to maintain a good reputation. This intuition has been formalized with two types of models. In public assessment models, all community members are assumed to agree on each others' reputations; in private assessment models, people may have disagreements. Both types of models aim to understand the interplay of social norms and cooperation. Yet their results can be vastly different. Public assessment models argue that cooperation can evolve easily, and that the most effective norms tend to be stern. Private assessment models often find cooperation to be unstable, and successful norms show some leniency. Here, we propose a model that can organize these differing results within a single framework. We show that the stability of cooperation depends on a single quantity: the extent to which individual opinions turn out to be correlated. This correlation is determined by a group's norms and the structure of social interactions. In particular, we prove that no cooperative norm is evolutionarily stable when individual opinions are statistically independent. These results have important implications for our understanding of cooperation, conformity, and polarization.
△ Less
Submitted 15 October, 2024; v1 submitted 9 September, 2024;
originally announced September 2024.
-
Mutation enhances cooperation in direct reciprocity
Authors:
Josef Tkadlec,
Christian Hilbe,
Martin A. Nowak
Abstract:
Direct reciprocity is a powerful mechanism for evolution of cooperation based on repeated interactions between the same individuals. But high levels of cooperation evolve only if the benefit-to-cost ratio exceeds a certain threshold that depends on memory length. For the best-explored case of one-round memory, that threshold is two. Here we report that intermediate mutation rates lead to high leve…
▽ More
Direct reciprocity is a powerful mechanism for evolution of cooperation based on repeated interactions between the same individuals. But high levels of cooperation evolve only if the benefit-to-cost ratio exceeds a certain threshold that depends on memory length. For the best-explored case of one-round memory, that threshold is two. Here we report that intermediate mutation rates lead to high levels of cooperation, even if the benefit-to-cost ratio is only marginally above one, and even if individuals only use a minimum of past information. This surprising observation is caused by two effects. First, mutation generates diversity which undermines the evolutionary stability of defectors. Second, mutation leads to diverse communities of cooperators that are more resilient than homogeneous ones. This finding is relevant because many real world opportunities for cooperation have small benefit-to-cost ratios, which are between one and two, and we describe how direct reciprocity can attain cooperation in such settings. Our result can be interpreted as showing that diversity, rather than uniformity, promotes evolution of cooperation.
△ Less
Submitted 12 April, 2023;
originally announced April 2023.
-
Indirect reciprocity with stochastic rules
Authors:
Yohsuke Murase,
Christian Hilbe
Abstract:
Cooperation is a crucial aspect of social life, yet understanding the nature of cooperation and how it can be promoted is an ongoing challenge. One mechanism for cooperation is indirect reciprocity. According to this mechanism, individuals cooperate to maintain a good reputation. This idea is embodied in a set of social norms called the ``leading eight''. When all information is publicly available…
▽ More
Cooperation is a crucial aspect of social life, yet understanding the nature of cooperation and how it can be promoted is an ongoing challenge. One mechanism for cooperation is indirect reciprocity. According to this mechanism, individuals cooperate to maintain a good reputation. This idea is embodied in a set of social norms called the ``leading eight''. When all information is publicly available, these norms have two major properties. Populations that employ these norms are fully cooperative, and they are stable against invasion by alternative norms. In this paper, we extend the framework of the leading eight in two directions. First, we allow social norms to be stochastic. Such norms allow individuals to evaluate others with certain probabilities. Second, we consider norms in which also the reputations of passive recipients can be updated. Using this framework, we characterize all evolutionarily stable norms that lead to full cooperation in the public information regime. When only the donor's reputation is updated, and all updates are deterministic, we recover the conventional model. In that case, we find two classes of stable norms: the leading eight and the `secondary sixteen'. Stochasticity can further help to stabilize cooperation when the benefit of cooperation is comparably small. Moreover, updating the recipients' reputations can help populations to recover more quickly from errors. Overall, our study highlights a remarkable trade-off between the evolutionary stability of a norm and its robustness with respect to errors. Norms that correct errors quickly require higher benefits of cooperation to be stable.
△ Less
Submitted 2 March, 2023;
originally announced March 2023.
-
Evolution of direct reciprocity in group-structured populations
Authors:
Yohsuke Murase,
Christian Hilbe,
Seung Ki Baek
Abstract:
People tend to have their social interactions with members of their own community. Such group-structured interactions can have a profound impact on the behaviors that evolve. Group structure affects the way people cooperate, and how they reciprocate each other's cooperative actions. Past work has shown that population structure and reciprocity can both promote the evolution of cooperation. Yet the…
▽ More
People tend to have their social interactions with members of their own community. Such group-structured interactions can have a profound impact on the behaviors that evolve. Group structure affects the way people cooperate, and how they reciprocate each other's cooperative actions. Past work has shown that population structure and reciprocity can both promote the evolution of cooperation. Yet the impact of these mechanisms has been typically studied in isolation. In this work, we study how the two mechanisms interact. Using a game-theoretic model, we explore how people engage in reciprocal cooperation in group-structured populations, compared to well-mixed populations of equal size. To derive analytical results, we focus on two scenarios. In the first scenario, we assume a complete separation of time scales. Mutations are rare compared to between-group comparisons, which themselves are rare compared to within-group comparisons. In the second scenario, there is a partial separation of time scales, where mutations and between-group comparisons occur at a comparable rate. In both scenarios, we find that the effect of population structure depends on the benefit of cooperation. When this benefit is small, group-structured populations are more cooperative. But when the benefit is large, well-mixed populations result in more cooperation. Overall, our results reveal how group structure can sometimes enhance and sometimes suppress the evolution of cooperation.
△ Less
Submitted 28 July, 2022;
originally announced July 2022.
-
Evolutionary instability of selfish learning in repeated games
Authors:
Alex McAvoy,
Julian Kates-Harbeck,
Krishnendu Chatterjee,
Christian Hilbe
Abstract:
Across many domains of interaction, both natural and artificial, individuals use past experience to shape future behaviors. The results of such learning processes depend on what individuals wish to maximize. A natural objective is one's own success. However, when two such "selfish" learners interact with each other, the outcome can be detrimental to both, especially when there are conflicts of int…
▽ More
Across many domains of interaction, both natural and artificial, individuals use past experience to shape future behaviors. The results of such learning processes depend on what individuals wish to maximize. A natural objective is one's own success. However, when two such "selfish" learners interact with each other, the outcome can be detrimental to both, especially when there are conflicts of interest. Here, we explore how a learner can align incentives with a selfish opponent. Moreover, we consider the dynamics that arise when learning rules themselves are subject to evolutionary pressure. By combining extensive simulations and analytical techniques, we demonstrate that selfish learning is unstable in most classical two-player repeated games. If evolution operates on the level of long-run payoffs, selection instead favors learning rules that incorporate social (other-regarding) preferences. To further corroborate these results, we analyze data from a repeated prisoner's dilemma experiment. We find that selfish learning is insufficient to explain human behavior when there is a trade-off between payoff maximization and fairness.
△ Less
Submitted 31 August, 2022; v1 submitted 13 May, 2021;
originally announced May 2021.
-
Comparing reactive and memory-one strategies of direct reciprocity
Authors:
Seung Ki Baek,
Hyeong-Chai Jeong,
Christian Hilbe,
Martin A. Nowak
Abstract:
Direct reciprocity is a mechanism for the evolution of cooperation based on repeated interactions. When individuals meet repeatedly, they can use conditional strategies to enforce cooperative outcomes that would not be feasible in one-shot social dilemmas. Direct reciprocity requires that individuals keep track of their past interactions and find the right response. However, there are natural boun…
▽ More
Direct reciprocity is a mechanism for the evolution of cooperation based on repeated interactions. When individuals meet repeatedly, they can use conditional strategies to enforce cooperative outcomes that would not be feasible in one-shot social dilemmas. Direct reciprocity requires that individuals keep track of their past interactions and find the right response. However, there are natural bounds on strategic complexity: Humans find it difficult to remember past interactions accurately, especially over long timespans. Given these limitations, it is natural to ask how complex strategies need to be for cooperation to evolve. Here, we study stochastic evolutionary game dynamics in finite populations to systematically compare the evolutionary performance of reactive strategies, which only respond to the co-player's previous move, and memory-one strategies, which take into account the own and the co-player's previous move. In both cases, we compare deterministic strategy and stochastic strategy spaces. For reactive strategies and small costs, we find that stochasticity benefits cooperation, because it allows for generous-tit-for-tat. For memory one strategies and small costs, we find that stochasticity does not increase the propensity for cooperation, because the deterministic rule of win-stay, lose-shift works best. For memory one strategies and large costs, however, stochasticity can augment cooperation.
△ Less
Submitted 23 May, 2016; v1 submitted 28 January, 2016;
originally announced January 2016.
-
Zero-determinant alliances in multiplayer social dilemmas
Authors:
Christian Hilbe,
Arne Traulsen,
Bin Wu,
Martin A. Nowak
Abstract:
Direct reciprocity and conditional cooperation are important mechanisms to prevent free riding in social dilemmas. But in large groups these mechanisms may become ineffective, because they require single individuals to have a substantial influence on their peers. However, the recent discovery of the powerful class of zero-determinant strategies in the iterated prisoner's dilemma suggests that we m…
▽ More
Direct reciprocity and conditional cooperation are important mechanisms to prevent free riding in social dilemmas. But in large groups these mechanisms may become ineffective, because they require single individuals to have a substantial influence on their peers. However, the recent discovery of the powerful class of zero-determinant strategies in the iterated prisoner's dilemma suggests that we may have underestimated the degree of control that a single player can exert. Here, we develop a theory for zero-determinant strategies for multiplayer social dilemmas, with any number of involved players. We distinguish several particularly interesting subclasses of strategies: fair strategies ensure that the own payoff matches the average payoff of the group; extortionate strategies allow a player to perform above average; and generous strategies let a player perform below average. We use this theory to explore how individuals can enhance their strategic options by forming alliances. The effects of an alliance depend on the size of the alliance, the type of the social dilemma, and on the strategy of the allies: fair alliances reduce the inequality within their group; extortionate alliances outperform the remaining group members; but generous alliances increase welfare. Our results highlight the critical interplay of individual control and alliance formation to succeed in large groups.
△ Less
Submitted 10 April, 2014;
originally announced April 2014.
-
The Evolution of Extortion in Iterated Prisoner's Dilemma Games
Authors:
Christian Hilbe,
Martin A. Nowak,
Karl Sigmund
Abstract:
Iterated games are a fundamental component of economic and evolutionary game theory. They describe situations where two players interact repeatedly and have the possibility to use conditional strategies that depend on the outcome of previous interactions. In the context of evolution of cooperation, repeated games represent the mechanism of reciprocation. Recently a new class of strategies has been…
▽ More
Iterated games are a fundamental component of economic and evolutionary game theory. They describe situations where two players interact repeatedly and have the possibility to use conditional strategies that depend on the outcome of previous interactions. In the context of evolution of cooperation, repeated games represent the mechanism of reciprocation. Recently a new class of strategies has been proposed, so called 'zero determinant strategies'. These strategies enforce a fixed linear relationship between one's own payoff and that of the other player. A subset of those strategies are 'extortioners' which ensure that any increase in the own payoff exceeds that of the other player by a fixed percentage. Here we analyze the evolutionary performance of this new class of strategies. We show that in reasonably large populations they can act as catalysts for the evolution of cooperation, similar to tit-for-tat, but they are not the stable outcome of natural selection. In very small populations, however, relative payoff differences between two players in a contest matter, and extortioners hold their ground. Extortion strategies do particularly well in co-evolutionary arms races between two distinct populations: significantly, they benefit the population which evolves at the slower rate - an instance of the so-called Red King effect. This may affect the evolution of interactions between host species and their endosymbionts.
△ Less
Submitted 5 December, 2012;
originally announced December 2012.
