-
Response of social norms to individual differences in error-proneness
Authors:
Quang Anh Le,
Seung Ki Baek
Abstract:
Indirect reciprocity explains the evolution of cooperation by considering how our cooperative behavior toward someone is reciprocated by someone else who has observed us. A cohesive society has a shared norm that prescribes how to assess observed behavior as well as how to behave toward others based on the assessments, and the eight social norms that are evolutionarily stable against the invasion…
▽ More
Indirect reciprocity explains the evolution of cooperation by considering how our cooperative behavior toward someone is reciprocated by someone else who has observed us. A cohesive society has a shared norm that prescribes how to assess observed behavior as well as how to behave toward others based on the assessments, and the eight social norms that are evolutionarily stable against the invasion of mutants with different behavioral rules are referred to as the leading eight, whose member norms are called L1 to L8, respectively. Among the leading eight, L8 (also known as `Judging') has been deemed mostly irrelevant due to its poor performance in maintaining cooperation when each person may have a different opinion about someone instead of forming a public consensus. In this work, we propose that L8 can nevertheless be best protected from assessment errors among the leading eight if we take into account the intrinsic heterogeneity of error proneness among individuals because this norm heavily punishes those who are prone to errors in following its assessment rule. This finding suggests that individual differences should be explicitly taken into account as quenched randomness to obtain a thorough understanding of a social norm working in a heterogeneous environment.
△ Less
Submitted 28 February, 2025;
originally announced February 2025.
-
Making public reputation out of private assessments
Authors:
Youngsuk Mun,
Quang Anh Le,
Seung Ki Baek
Abstract:
Reputation is not just a simple opinion that an individual has about another but a social construct that emerges through communication. Despite the huge importance in coordinating human behavior, such a communicative aspect has remained relatively unexplored in the field of indirect reciprocity. In this work, we bridge the gap between private assessment and public reputation: We begin by clarifyin…
▽ More
Reputation is not just a simple opinion that an individual has about another but a social construct that emerges through communication. Despite the huge importance in coordinating human behavior, such a communicative aspect has remained relatively unexplored in the field of indirect reciprocity. In this work, we bridge the gap between private assessment and public reputation: We begin by clarifying what we mean by reputation and argue that the formation of reputation can be modeled by a bi-stochastic matrix, provided that both assessment and behavior are regarded as continuous variables. By choosing bi-stochastic matrices that represent averaging processes, we show that only four norms among the leading eight, which judge a good person's cooperation toward a bad one as good, will keep cooperation asymptotically or neutrally stable against assessment error in a homogeneous society where every member has adopted the same norm. However, when one of those four norms is used by the resident population, the opinion averaging process allows neutral invasion of mutant norms with small differences in the assessment rule. Our approach provides a theoretical framework for describing the formation of reputation in mathematical terms.
△ Less
Submitted 9 October, 2024;
originally announced October 2024.
-
CRADLE-VAE: Enhancing Single-Cell Gene Perturbation Modeling with Counterfactual Reasoning-based Artifact Disentanglement
Authors:
Seungheun Baek,
Soyon Park,
Yan Ting Chok,
Junhyun Lee,
Jueon Park,
Mogan Gim,
Jaewoo Kang
Abstract:
Predicting cellular responses to various perturbations is a critical focus in drug discovery and personalized therapeutics, with deep learning models playing a significant role in this endeavor. Single-cell datasets contain technical artifacts that may hinder the predictability of such models, which poses quality control issues highly regarded in this area. To address this, we propose CRADLE-VAE,…
▽ More
Predicting cellular responses to various perturbations is a critical focus in drug discovery and personalized therapeutics, with deep learning models playing a significant role in this endeavor. Single-cell datasets contain technical artifacts that may hinder the predictability of such models, which poses quality control issues highly regarded in this area. To address this, we propose CRADLE-VAE, a causal generative framework tailored for single-cell gene perturbation modeling, enhanced with counterfactual reasoning-based artifact disentanglement. Throughout training, CRADLE-VAE models the underlying latent distribution of technical artifacts and perturbation effects present in single-cell datasets. It employs counterfactual reasoning to effectively disentangle such artifacts by modulating the latent basal spaces and learns robust features for generating cellular response data with improved quality. Experimental results demonstrate that this approach improves not only treatment effect estimation performance but also generative quality as well. The CRADLE-VAE codebase is publicly available at https://github.com/dmis-lab/CRADLE-VAE.
△ Less
Submitted 9 September, 2024; v1 submitted 9 September, 2024;
originally announced September 2024.
-
Clinical Characteristics and Laboratory Biomarkers in ICU-admitted Septic Patients with and without Bacteremia
Authors:
Sangwon Baek,
Seung Jun Lee
Abstract:
Few studies have investigated the diagnostic utilities of biomarkers for predicting bacteremia among septic patients admitted to intensive care units (ICU). Therefore, this study evaluated the prediction power of laboratory biomarkers to utilize those markers with high performance to optimize the predictive model for bacteremia. This retrospective cross-sectional study was conducted at the ICU dep…
▽ More
Few studies have investigated the diagnostic utilities of biomarkers for predicting bacteremia among septic patients admitted to intensive care units (ICU). Therefore, this study evaluated the prediction power of laboratory biomarkers to utilize those markers with high performance to optimize the predictive model for bacteremia. This retrospective cross-sectional study was conducted at the ICU department of Gyeongsang National University Changwon Hospital in 2019. Adult patients qualifying SEPSIS-3 (increase in sequential organ failure score greater than or equal to 2) criteria with at least two sets of blood culture were selected. Collected data was initially analyzed independently to identify the significant predictors, which was then used to build the multivariable logistic regression (MLR) model. A total of 218 patients with 48 cases of true bacteremia were analyzed in this research. Both CRP and PCT showed a substantial area under the curve (AUC) value for discriminating bacteremia among septic patients (0.757 and 0.845, respectively). To further enhance the predictive accuracy, we combined PCT, bilirubin, neutrophil lymphocyte ratio (NLR), platelets, lactic acid, erythrocyte sedimentation rate (ESR), and Glasgow Coma Scale (GCS) score to build the predictive model with an AUC of 0.907 (95% CI, 0.843 to 0.956). In addition, a high association between bacteremia and mortality rate was discovered through the survival analysis (0.004). While PCT is certainly a useful index for distinguishing patients with and without bacteremia by itself, our MLR model indicates that the accuracy of bacteremia prediction substantially improves by the combined use of PCT, bilirubin, NLR, platelets, lactic acid, ESR, and GCS score.
△ Less
Submitted 16 November, 2023; v1 submitted 14 November, 2023;
originally announced November 2023.
-
Grouping promotes both partnership and rivalry with long memory in direct reciprocity
Authors:
Yohsuke Murase,
Seung Ki Baek
Abstract:
Biological and social scientists have long been interested in understanding how to reconcile individual and collective interests in iterated Prisoner's Dilemma. Many effective strategies have been proposed, and they are often categorized into one of two classes, `partners' and `rivals.' More recently, another class, `friendly rivals,' has been identified in longer-memory strategy spaces. Friendly…
▽ More
Biological and social scientists have long been interested in understanding how to reconcile individual and collective interests in iterated Prisoner's Dilemma. Many effective strategies have been proposed, and they are often categorized into one of two classes, `partners' and `rivals.' More recently, another class, `friendly rivals,' has been identified in longer-memory strategy spaces. Friendly rivals qualify as both partners and rivals: They fully cooperate with themselves, like partners, but never allow their co-players to earn higher payoffs, like rivals. Although they have appealing theoretical properties, it is unclear whether they would emerge in evolving population because most previous works focus on memory-one strategy space, where no friendly rival strategy exists. To investigate this issue, we have conducted large-scale evolutionary simulations in well-mixed and group-structured populations and compared the evolutionary dynamics between memory-one and memory-three strategy spaces. In a well-mixed population, the memory length does not make a major difference, and the key factors are the population size and the benefit of cooperation. Friendly rivals play a minor role because being a partner or a rival is often good enough in a given environment. It is in a group-structured population that memory length makes a stark difference: When memory-three strategies are available, friendly rivals become dominant, and the cooperation level nearly reaches a maximum, even when the benefit of cooperation is so low that cooperation would not be achieved in a well-mixed population. This result highlights the important interaction between group structure and memory lengths that drive the evolution of cooperation.
△ Less
Submitted 16 January, 2023;
originally announced January 2023.
-
Evolution of direct reciprocity in group-structured populations
Authors:
Yohsuke Murase,
Christian Hilbe,
Seung Ki Baek
Abstract:
People tend to have their social interactions with members of their own community. Such group-structured interactions can have a profound impact on the behaviors that evolve. Group structure affects the way people cooperate, and how they reciprocate each other's cooperative actions. Past work has shown that population structure and reciprocity can both promote the evolution of cooperation. Yet the…
▽ More
People tend to have their social interactions with members of their own community. Such group-structured interactions can have a profound impact on the behaviors that evolve. Group structure affects the way people cooperate, and how they reciprocate each other's cooperative actions. Past work has shown that population structure and reciprocity can both promote the evolution of cooperation. Yet the impact of these mechanisms has been typically studied in isolation. In this work, we study how the two mechanisms interact. Using a game-theoretic model, we explore how people engage in reciprocal cooperation in group-structured populations, compared to well-mixed populations of equal size. To derive analytical results, we focus on two scenarios. In the first scenario, we assume a complete separation of time scales. Mutations are rare compared to between-group comparisons, which themselves are rare compared to within-group comparisons. In the second scenario, there is a partial separation of time scales, where mutations and between-group comparisons occur at a comparable rate. In both scenarios, we find that the effect of population structure depends on the benefit of cooperation. When this benefit is small, group-structured populations are more cooperative. But when the benefit is large, well-mixed populations result in more cooperation. Overall, our results reveal how group structure can sometimes enhance and sometimes suppress the evolution of cooperation.
△ Less
Submitted 28 July, 2022;
originally announced July 2022.
-
A second-order stability analysis for the continuous model of indirect reciprocity
Authors:
Sanghun Lee,
Yohsuke Murase,
Seung Ki Baek
Abstract:
Reputation is one of key mechanisms to maintain human cooperation, but its analysis gets complicated if we consider the possibility that reputation does not reach consensus because of erroneous assessment. The difficulty is alleviated if we assume that reputation and cooperation do not take binary values but have continuous spectra so that disagreement over reputation can be analysed in a perturba…
▽ More
Reputation is one of key mechanisms to maintain human cooperation, but its analysis gets complicated if we consider the possibility that reputation does not reach consensus because of erroneous assessment. The difficulty is alleviated if we assume that reputation and cooperation do not take binary values but have continuous spectra so that disagreement over reputation can be analysed in a perturbative way. In this work, we carry out the analysis by expanding the dynamics of reputation to the second order of perturbation under the assumption that everyone initially cooperates with good reputation. The second-order theory clarifies the difference between Image Scoring and Simple Standing in that punishment for defection against a well-reputed player should be regarded as good for maintaining cooperation. Moreover, comparison among the leading eight shows that the stabilizing effect of justified punishment weakens if cooperation between two ill-reputed players is regarded as bad. Our analysis thus explains how Simple Standing achieves a high level of stability by permitting justified punishment and also by disregarding irrelevant information in assessing cooperation. This observation suggests which factors affect the stability of a social norm when reputation can be perturbed by noise.
△ Less
Submitted 11 July, 2022; v1 submitted 8 March, 2022;
originally announced March 2022.
-
Social norms in indirect reciprocity with ternary reputations
Authors:
Yohsuke Murase,
Minjae Kim,
Seung Ki Baek
Abstract:
Indirect reciprocity is a key mechanism that promotes cooperation in social dilemmas by means of reputation. Although it has been a common practice to represent reputations by binary values, either `good' or `bad', such a dichotomy is a crude approximation considering the complexity of reality. In this work, we studied norms with three different reputations, i.e., `good', `neutral', and `bad'. Thr…
▽ More
Indirect reciprocity is a key mechanism that promotes cooperation in social dilemmas by means of reputation. Although it has been a common practice to represent reputations by binary values, either `good' or `bad', such a dichotomy is a crude approximation considering the complexity of reality. In this work, we studied norms with three different reputations, i.e., `good', `neutral', and `bad'. Through massive supercomputing for handling more than thirty billion possibilities, we fully identified which norms achieve cooperation and possess evolutionary stability against behavioural mutants. By systematically categorizing all these norms according to their behaviours, we found similarities and dissimilarities to their binary-reputation counterpart, the leading eight. We obtained four rules that should be satisfied by the successful norms, and the behaviour of the leading eight can be understood as a special case of these rules. A couple of norms that show counter-intuitive behaviours are also presented. We believe the findings are also useful for designing successful norms with more general reputation systems.
△ Less
Submitted 13 January, 2022; v1 submitted 20 September, 2021;
originally announced September 2021.
-
Local stability of cooperation in a continuous model of indirect reciprocity
Authors:
Sanghun Lee,
Yohsuke Murase,
Seung Ki Baek
Abstract:
Reputation is a powerful mechanism to enforce cooperation among unrelated individuals through indirect reciprocity, but it suffers from disagreement originating from private assessment, noise, and incomplete information. In this work, we investigate stability of cooperation in the donation game by regarding each player's reputation and behaviour as continuous variables. Through perturbative calcul…
▽ More
Reputation is a powerful mechanism to enforce cooperation among unrelated individuals through indirect reciprocity, but it suffers from disagreement originating from private assessment, noise, and incomplete information. In this work, we investigate stability of cooperation in the donation game by regarding each player's reputation and behaviour as continuous variables. Through perturbative calculation, we derive a condition that a social norm should satisfy to give penalties to its close variants, provided that everyone initially cooperates with a good reputation, and this result is supported by numerical simulation. A crucial factor of the condition is whether a well-reputed player's donation to an ill-reputed co-player is appreciated by other members of the society, and the condition can be reduced to a threshold for the benefit-cost ratio of cooperation which depends on the reputational sensitivity to a donor's behaviour as well as on the behavioural sensitivity to a recipient's reputation. Our continuum formulation suggests how indirect reciprocity can work beyond the dichotomy between good and bad even in the presence of inhomogeneity, noise, and incomplete information.
△ Less
Submitted 9 July, 2021; v1 submitted 6 April, 2021;
originally announced April 2021.
-
Assortative clustering in a one-dimensional population with replication strategies
Authors:
Sunhee Chae,
Nahyeon Lee,
Seung Ki Baek,
Hyeong-Chai Jeong
Abstract:
In a geographically distributed population, assortative clustering plays an important role in evolution by modifying local environments. To examine its effects in a linear habitat, we consider a one-dimensional grid of cells, where each cell is either empty or occupied by an organism whose replication strategy is genetically inherited to offspring. The strategy determines whether to have offspring…
▽ More
In a geographically distributed population, assortative clustering plays an important role in evolution by modifying local environments. To examine its effects in a linear habitat, we consider a one-dimensional grid of cells, where each cell is either empty or occupied by an organism whose replication strategy is genetically inherited to offspring. The strategy determines whether to have offspring in surrounding cells, as a function of the neighborhood configuration. If more than one offspring compete for a cell, then they can be all exterminated due to the cost of conflict depending on environmental conditions. We find that the system is more densely populated in an unfavorable environment than in a favorable one because only the latter has to pay the cost of conflict. This observation agrees reasonably well with a mean-field analysis which takes assortative clustering of strategies into consideration. Our finding suggests a possibility of intrinsic nonlinearity between environmental conditions and population density when an evolutionary process is involved.
△ Less
Submitted 14 March, 2021;
originally announced March 2021.
-
Win-Stay-Lose-Shift as a self-confirming equilibrium in the iterated Prisoner's Dilemma
Authors:
Minjae Kim,
Jung-Kyoo Choi,
Seung Ki Baek
Abstract:
Evolutionary game theory assumes that players replicate a highly scored player's strategy through genetic inheritance. However, when learning occurs culturally, it is often difficult to recognize someone's strategy just by observing the behaviour. In this work, we consider players with memory-one stochastic strategies in the iterated prisoner's dilemma, with an assumption that they cannot directly…
▽ More
Evolutionary game theory assumes that players replicate a highly scored player's strategy through genetic inheritance. However, when learning occurs culturally, it is often difficult to recognize someone's strategy just by observing the behaviour. In this work, we consider players with memory-one stochastic strategies in the iterated prisoner's dilemma, with an assumption that they cannot directly access each other's strategy but only observe the actual moves for a certain number of rounds. Based on the observation, the observer has to infer the resident strategy in a Bayesian way and chooses his or her own strategy accordingly. By examining the best-response relations, we argue that players can escape from full defection into a cooperative equilibrium supported by Win-Stay-Lose-Shift in a self-confirming manner, provided that the cost of cooperation is low and the observational learning supplies sufficiently large uncertainty.
△ Less
Submitted 30 June, 2021; v1 submitted 10 January, 2021;
originally announced January 2021.
-
Friendly-rivalry solution to the iterated $n$-person public-goods game
Authors:
Yohsuke Murase,
Seung Ki Baek
Abstract:
Repeated interaction promotes cooperation among rational individuals under the shadow of future, but it is hard to maintain cooperation when a large number of error-prone individuals are involved. One way to construct a cooperative Nash equilibrium is to find a `friendly-rivalry' strategy, which aims at full cooperation but never allows the co-players to be better off. Recently it has been shown t…
▽ More
Repeated interaction promotes cooperation among rational individuals under the shadow of future, but it is hard to maintain cooperation when a large number of error-prone individuals are involved. One way to construct a cooperative Nash equilibrium is to find a `friendly-rivalry' strategy, which aims at full cooperation but never allows the co-players to be better off. Recently it has been shown that for the iterated Prisoner's Dilemma in the presence of error, a friendly rival can be designed with the following five rules: Cooperate if everyone did, accept punishment for your own mistake, punish defection, recover cooperation if you find a chance, and defect in all the other circumstances. In this work, we construct such a friendly-rivalry strategy for the iterated $n$-person public-goods game by generalizing those five rules. The resulting strategy makes a decision with referring to the previous $m=2n-1$ rounds. A friendly-rivalry strategy for $n=2$ inherently has evolutionary robustness in the sense that no mutant strategy has higher fixation probability in this population than that of a neutral mutant. Our evolutionary simulation indeed shows excellent performance of the proposed strategy in a broad range of environmental conditions when $n= 2$ and $3$.
△ Less
Submitted 22 January, 2021; v1 submitted 1 August, 2020;
originally announced August 2020.
-
Five rules for friendly rivalry in direct reciprocity
Authors:
Yohsuke Murase,
Seung Ki Baek
Abstract:
Direct reciprocity is one of the key mechanisms accounting for cooperation in our social life. According to recent understanding, most of classical strategies for direct reciprocity fall into one of two classes, `partners' or `rivals'. A `partner' is a generous strategy achieving mutual cooperation, and a `rival' never lets the co-player become better off. They have different working conditions: F…
▽ More
Direct reciprocity is one of the key mechanisms accounting for cooperation in our social life. According to recent understanding, most of classical strategies for direct reciprocity fall into one of two classes, `partners' or `rivals'. A `partner' is a generous strategy achieving mutual cooperation, and a `rival' never lets the co-player become better off. They have different working conditions: For example, partners show good performance in a large population, whereas rivals do in head-to-head matches. By means of exhaustive enumeration, we demonstrate the existence of strategies that act as both partners and rivals. Among them, we focus on a human-interpretable strategy, named `CAPRI' after its five characteristic ingredients, i.e., cooperate, accept, punish, recover, and defect otherwise. Our evolutionary simulation shows excellent performance of CAPRI in a broad range of environmental conditions.
△ Less
Submitted 9 October, 2020; v1 submitted 1 April, 2020;
originally announced April 2020.
-
A Real-Time Retinomorphic Simulator Using a Conductance-Based Discrete Neuronal Network
Authors:
Jason K. Eshraghian,
Seungbum Baek,
Wesley Thio,
Yulia Sandamirskaya,
Herbert H. C. Iu,
Wei D. Lu
Abstract:
We present an optimized conductance-based retina microcircuit simulator which transforms light stimuli into a series of graded and spiking action potentials through photo transduction. We use discrete retinal neuron blocks based on a collation of single-compartment models and morphologically realistic formulations, and successfully achieve a biologically real-time simulator. This is done by optimi…
▽ More
We present an optimized conductance-based retina microcircuit simulator which transforms light stimuli into a series of graded and spiking action potentials through photo transduction. We use discrete retinal neuron blocks based on a collation of single-compartment models and morphologically realistic formulations, and successfully achieve a biologically real-time simulator. This is done by optimizing the numerical methods employed to solve the system of over 270 nonlinear ordinary differential equations and parameters. Our simulator includes some of the most recent advances in compartmental modeling to include five intrinsic ion currents of each cell whilst ensuring real-time performance, in attaining the ion-current and membrane responses of the photoreceptor rod and cone cells, the bipolar and amacrine cells, their laterally connected electrical and chemical synapses, and the output ganglion cell. It exhibits dynamical retinal behavior such as spike-frequency adaptation, rebound activation, fast-spiking, and subthreshold responsivity. Light stimuli incident at the photoreceptor rod and cone cells is modulated through the system of differential equations, enabling the user to probe the neuronal response at any point in the network. This is in contrast to many other retina encoding schemes which prefer to `black-box' the preceding stages to the spike train output. Our simulator is made available open source, with the hope that it will benefit neuroscientists and machine learning practitioners in better understanding the retina sub-circuitries, how retina cells optimize the representation of visual information, and in generating large datasets of biologically accurate graded and spiking responses.
△ Less
Submitted 26 December, 2019;
originally announced January 2020.
-
Automata representation of successful strategies for social dilemmas
Authors:
Yohsuke Murase,
Seung Ki Baek
Abstract:
In a social dilemma, cooperation is collectively optimal, yet individually each group member prefers to defect. A class of successful strategies of direct reciprocity were recently found for the iterated prisoner's dilemma and for the iterated three-person public-goods game: By a successful strategy, we mean that it constitutes a cooperative Nash equilibrium under implementation error, with assuri…
▽ More
In a social dilemma, cooperation is collectively optimal, yet individually each group member prefers to defect. A class of successful strategies of direct reciprocity were recently found for the iterated prisoner's dilemma and for the iterated three-person public-goods game: By a successful strategy, we mean that it constitutes a cooperative Nash equilibrium under implementation error, with assuring that the long-term payoff never becomes less than the co-players' regardless of their strategies, when the error rate is small. Although we have a list of actions prescribed by each successful strategy, the rationale behind them has not been fully understood for the iterated public-goods game because the list has hundreds of entries to deal with every relevant history of previous interactions. In this paper, we propose a method to convert such history-based representation into an automaton with a minimal number of states. Our main finding is that a successful strategy for the iterated three-person public-goods game can be represented as a $10$-state automaton by this method. In this automaton, each state can be interpreted as the player's internal judgement of the situation, such as trustworthiness of the co-players and the need to redeem oneself after defection. This result thus suggests a comprehensible way to choose an appropriate action at each step towards cooperation based on a situational judgement, which is mapped from the history of interactions.
△ Less
Submitted 9 October, 2020; v1 submitted 7 October, 2019;
originally announced October 2019.
-
Sex-ratio bias induced by mutation
Authors:
Minjae Kim,
Hyeong-Chai Jeong,
Seung Ki Baek
Abstract:
A question in evolutionary biology is why the number of males is approximately equal to that of females in many species, and Fisher's theory of equal investment answers that it is the evolutionarily stable state. The Fisherian mechanism can be given a concrete form by a genetic model based on the following assumptions: (1) Males and females mate at random. (2) An allele acts on the father to deter…
▽ More
A question in evolutionary biology is why the number of males is approximately equal to that of females in many species, and Fisher's theory of equal investment answers that it is the evolutionarily stable state. The Fisherian mechanism can be given a concrete form by a genetic model based on the following assumptions: (1) Males and females mate at random. (2) An allele acts on the father to determine the expected progeny sex ratio. (3) The offspring inherits the allele from either side of the parents with equal probability. The model is known to achieve the 1:1 sex ratio due to the invasion of mutant alleles with different progeny sex ratios. In this study, however, we argue that mutation plays a more subtle role in that fluctuations caused by mutation renormalize the sex ratio and thereby keep it away from 1:1 in general. This finding shows how the sex ratio is affected by mutation in a systematic way, whereby the effective mutation rate can be estimated from an observed sex ratio.
△ Less
Submitted 4 February, 2019;
originally announced February 2019.
-
Long-range prisoner's dilemma game on a cycle
Authors:
Jiwon Bahk,
Seung Ki Baek,
Hyeong-Chai Jeong
Abstract:
We investigate evolutionary dynamics of altruism with long-range interaction on a cycle. The interaction between individuals is described by a simplified version of the prisoner's dilemma (PD) game in which the payoffs are parameterized by $c$, the cost of a cooperative action. In our model, the probabilities of the game interaction and competition decay algebraically with $r_{AB}$, the distance b…
▽ More
We investigate evolutionary dynamics of altruism with long-range interaction on a cycle. The interaction between individuals is described by a simplified version of the prisoner's dilemma (PD) game in which the payoffs are parameterized by $c$, the cost of a cooperative action. In our model, the probabilities of the game interaction and competition decay algebraically with $r_{AB}$, the distance between two players $A$ and $B$, but with different exponents: That is, the probability to play the PD game is proportional to $r_{AB}^{-α}$. If player $A$ is chosen for death, on the other hand, the probability for $B$ to occupy the empty site is proportional to $r_{AB}^{-β}$. In a limiting case of $β\to\infty$, where the competition for an empty site occurs between its nearest neighbors only, we analytically find the condition for the proliferation of altruism in terms of $c_{th}$, a threshold of $c$ below which altruism prevails. For finite $β$, we conjecture a formula for $c_{th}$ as a function of $α$ and $β$. We also propose a numerical method to locate $c_{th}$, according to which we observe excellent agreement with the conjecture even when the selection strength is of considerable magnitude.
△ Less
Submitted 27 December, 2018;
originally announced December 2018.
-
Seven rules to avoid the tragedy of the commons
Authors:
Yohsuke Murase,
Seung Ki Baek
Abstract:
Cooperation among self-interested players in a social dilemma is fragile and easily interrupted by mistakes. In this work, we study the repeated $n$-person public-goods game and search for a strategy that forms a cooperative Nash equilibrium in the presence of implementation error with a guarantee that the resulting payoff will be no less than any of the co-players'. By enumerating strategic possi…
▽ More
Cooperation among self-interested players in a social dilemma is fragile and easily interrupted by mistakes. In this work, we study the repeated $n$-person public-goods game and search for a strategy that forms a cooperative Nash equilibrium in the presence of implementation error with a guarantee that the resulting payoff will be no less than any of the co-players'. By enumerating strategic possibilities for $n=3$, we show that such a strategy indeed exists when its memory length $m$ equals three. It means that a deterministic strategy can be publicly employed to stabilize cooperation against error with avoiding the risk of being exploited. We furthermore show that, for general $n$-person public-goods game, $m \geq n$ is necessary to satisfy the above criteria.
△ Less
Submitted 18 April, 2018;
originally announced April 2018.
-
Chaos and unpredictability in evolution of cooperation in continuous time
Authors:
Taekho You,
Minji Kwon,
Hang-Hyun Jo,
Woo-Sung Jung,
Seung Ki Baek
Abstract:
Cooperators benefit others with paying costs. Evolution of cooperation crucially depends on the cost-benefit ratio of cooperation, denoted as $c$. In this work, we investigate the infinitely repeated prisoner's dilemma for various values of $c$ with four of the representative memory-one strategies, i.e., unconditional cooperation, unconditional defection, tit-for-tat, and win-stay-lose-shift. We c…
▽ More
Cooperators benefit others with paying costs. Evolution of cooperation crucially depends on the cost-benefit ratio of cooperation, denoted as $c$. In this work, we investigate the infinitely repeated prisoner's dilemma for various values of $c$ with four of the representative memory-one strategies, i.e., unconditional cooperation, unconditional defection, tit-for-tat, and win-stay-lose-shift. We consider replicator dynamics which deterministically describes how the fraction of each strategy evolves over time in an infinite-sized well-mixed population in the presence of implementation error and mutation among the four strategies. Our finding is that this three-dimensional continuous-time dynamics exhibits chaos through a bifurcation sequence similar to that of a logistic map as $c$ varies. If mutation occurs with rate $μ\ll 1$, the position of the bifurcation sequence on the $c$ axis is numerically found to scale as $μ^{0.1}$, and such sensitivity to $μ$ suggests that mutation may have non-perturbative effects on evolutionary paths. It demonstrates how the microscopic randomness of the mutation process can be amplified to macroscopic unpredictability by evolutionary dynamics.
△ Less
Submitted 16 December, 2017;
originally announced December 2017.
-
Duality between cooperation and defection in the presence of tit-for-tat in replicator dynamics
Authors:
Seung Ki Baek,
Su Do Yi,
Hyeong-Chai Jeong
Abstract:
The prisoner's dilemma describes a conflict between a pair of players, in which defection is a dominant strategy whereas cooperation is collectively optimal. The iterated version of the dilemma has been extensively studied to understand the emergence of cooperation. In the evolutionary context, the iterated prisoner's dilemma is often combined with population dynamics, in which a more successful s…
▽ More
The prisoner's dilemma describes a conflict between a pair of players, in which defection is a dominant strategy whereas cooperation is collectively optimal. The iterated version of the dilemma has been extensively studied to understand the emergence of cooperation. In the evolutionary context, the iterated prisoner's dilemma is often combined with population dynamics, in which a more successful strategy replicates itself with a higher growth rate. Here, we investigate the replicator dynamics of three representative strategies, i.e., unconditional cooperation, unconditional defection, and tit-for-tat, which prescribes reciprocal cooperation by mimicking the opponent's previous move. Our finding is that the dynamics is self-dual in the sense that it remains invariant when we apply time reversal and exchange the fractions of unconditional cooperators and defectors in the population. The duality implies that the fractions can be equalized by tit-for-tat players, although unconditional cooperation is still dominated by defection. Furthermore, we find that mutation among the strategies breaks the exact duality in such a way that cooperation is more favored than defection, as long as the cost-to-benefit ratio of cooperation is small.
△ Less
Submitted 29 September, 2017;
originally announced September 2017.
-
Combination with anti-tit-for-tat remedies problems of tit-for-tat
Authors:
Su Do Yi,
Seung Ki Baek,
Jung-Kyoo Choi
Abstract:
One of the most important questions in game theory concerns how mutual cooperation can be achieved and maintained in a social dilemma. In Axelrod's tournaments of the iterated prisoner's dilemma, Tit-for-Tat (TFT) demonstrated the role of reciprocity in the emergence of cooperation. However, the stability of TFT does not hold in the presence of implementation error, and a TFT population is prone t…
▽ More
One of the most important questions in game theory concerns how mutual cooperation can be achieved and maintained in a social dilemma. In Axelrod's tournaments of the iterated prisoner's dilemma, Tit-for-Tat (TFT) demonstrated the role of reciprocity in the emergence of cooperation. However, the stability of TFT does not hold in the presence of implementation error, and a TFT population is prone to neutral drift to unconditional cooperation, which eventually invites defectors. We argue that a combination of TFT and anti-TFT (ATFT) overcomes these difficulties in a noisy environment, provided that ATFT is defined as choosing the opposite to the opponent's last move. According to this TFT-ATFT strategy, a player normally uses TFT; turns to ATFT upon recognizing his or her own error; returns to TFT either when mutual cooperation is recovered or when the opponent unilaterally defects twice in a row. The proposed strategy provides simple and deterministic behavioral rules for correcting implementation error in a way that cannot be exploited by the opponent, and suppresses the neutral drift to unconditional cooperation.
△ Less
Submitted 24 October, 2016;
originally announced October 2016.
-
Comparing reactive and memory-one strategies of direct reciprocity
Authors:
Seung Ki Baek,
Hyeong-Chai Jeong,
Christian Hilbe,
Martin A. Nowak
Abstract:
Direct reciprocity is a mechanism for the evolution of cooperation based on repeated interactions. When individuals meet repeatedly, they can use conditional strategies to enforce cooperative outcomes that would not be feasible in one-shot social dilemmas. Direct reciprocity requires that individuals keep track of their past interactions and find the right response. However, there are natural boun…
▽ More
Direct reciprocity is a mechanism for the evolution of cooperation based on repeated interactions. When individuals meet repeatedly, they can use conditional strategies to enforce cooperative outcomes that would not be feasible in one-shot social dilemmas. Direct reciprocity requires that individuals keep track of their past interactions and find the right response. However, there are natural bounds on strategic complexity: Humans find it difficult to remember past interactions accurately, especially over long timespans. Given these limitations, it is natural to ask how complex strategies need to be for cooperation to evolve. Here, we study stochastic evolutionary game dynamics in finite populations to systematically compare the evolutionary performance of reactive strategies, which only respond to the co-player's previous move, and memory-one strategies, which take into account the own and the co-player's previous move. In both cases, we compare deterministic strategy and stochastic strategy spaces. For reactive strategies and small costs, we find that stochasticity benefits cooperation, because it allows for generous-tit-for-tat. For memory one strategies and small costs, we find that stochasticity does not increase the propensity for cooperation, because the deterministic rule of win-stay, lose-shift works best. For memory one strategies and large costs, however, stochasticity can augment cooperation.
△ Less
Submitted 23 May, 2016; v1 submitted 28 January, 2016;
originally announced January 2016.
-
Intelligent tit-for-tat in the iterated prisoner's dilemma game
Authors:
Seung Ki Baek,
Beom Jun Kim
Abstract:
We seek a route to the equilibrium where all the agents cooperate in the iterated prisoner's dilemma game on a two-dimensional plane, focusing on the role of tit-for-tat strategy. When a time horizon, within which a strategy can recall the past, is one time step, an equilibrium can be achieved as cooperating strategies dominate the whole population via proliferation of tit-for-tat. Extending the…
▽ More
We seek a route to the equilibrium where all the agents cooperate in the iterated prisoner's dilemma game on a two-dimensional plane, focusing on the role of tit-for-tat strategy. When a time horizon, within which a strategy can recall the past, is one time step, an equilibrium can be achieved as cooperating strategies dominate the whole population via proliferation of tit-for-tat. Extending the time horizon, we filter out poor strategies by simplified replicator dynamics and observe a similar evolutionary pattern to reach the cooperating equilibrium. In particular, the rise of a modified tit-for-tat strategy plays a central role, which implies how a robust strategy is adopted when provided with an enhanced memory capacity.
△ Less
Submitted 30 July, 2008; v1 submitted 14 July, 2008;
originally announced July 2008.
-
Immunization Dynamics on a 2-layer Network Model
Authors:
Hang-Hyun Jo,
Hie-Tae Moon,
Seung Ki Baek
Abstract:
We introduce a 2-layer network model for the study of the immunization dynamics in epidemics. Spreading of an epidemic is modeled as an excitatory process in a small-world network (body layer) while immunization by prevention for the disease as a dynamic process in a scale-free network (head layer). It is shown that prevention indeed turns periodic rages of an epidemic into small fluctuation. Th…
▽ More
We introduce a 2-layer network model for the study of the immunization dynamics in epidemics. Spreading of an epidemic is modeled as an excitatory process in a small-world network (body layer) while immunization by prevention for the disease as a dynamic process in a scale-free network (head layer). It is shown that prevention indeed turns periodic rages of an epidemic into small fluctuation. The study also reveals that, in a certain situation, prevention actually plays an adverse role and helps the disease survive. We argue that the presence of two different characteristic time scales contributes to the immunization dynamics observed.
△ Less
Submitted 16 October, 2003;
originally announced October 2003.
