Robert Hoffmann (2000)
Twenty Years on: The Evolution of Cooperation Revisited
Journal of Artificial Societies and Social Simulation
vol. 3, no. 2,
<http://jasss.soc.surrey.ac.uk/3/2/forum/1.html>
To cite articles published in the Journal of Artificial Societies and Social Simulation, please reference the above information and include paragraph numbers if necessary
Received: 26-Mar-00 Published: 31-Mar-00
Figure 1. The Prisoner's Dilemma. The payoffs obey T>R>P>S. Players have a choice between cooperation (c) and defection (d). The dominant strategy equilibrium (P,P) for the one-shot game is Pareto-dominated by (R, R) |
^{2}The discussion of all literature in this area is beyond the scope of a single review. A overview of this literature up to 1988 is contained in Axelrod and Dion (1988). Axelrod's website at http://pscs.physics.lsa.umich.edu/Software/ComplexCoop.html provides a comprehensive annotated bibliography.
^{3}The strategy that cooperates in round one of any game and subsequently repeats the opponent's previous move.
^{4}A lot has been written about this dynamic and its properties in the theoretical literature. It was originally developed in theoretical biology. Its first application to game theory is due to Taylor and Jonker (1978). See also Zeeman (1981), Schuster and Sigmund (1983), Hofbauer and Sigmund (1988), Sigmund (1993).
^{5}The effort of decision making has been considered in psychology for some time (e.g. Johnson and Payne 1985). A trade-off between decision efficacy and cognitive effort required is said to exist. In game theory, a strategy's memory requirement provides a natural vehicle for examining this issue (see, for example, Rubinstein 1986, Binmore and Samuelson 1992).
^{6}The former two are the strategies that cooperate (ALL-C) and defect (ALL-D) in all rounds of a given game.
^{7}Axelrod introduced a bias into the tournaments by pairing all strategies not just with every other strategy, but also with their own respective twins. This favours cooperative strategies that do well against each other, while strategies that defect fare badly against their own kind.
^{8}A number of authors have made this point. See Axelrod (1984, p.48), Sigmund (1993, p.196), see also Hirshleifer and Coll (1988, p.370), Dawkins (1989, p.215), Nachbar (1992, p.308), Linster (1992, p.881).
^{9}A three-dimensional shape resembling a doughnut.
^{10}The strategy that cooperates until a single act of defection by its opponents causes it to defect for the remainder of the game. It is sometimes known as the GRIM-strategy.
^{11}Axelrod (1984) follows Taylor (1976) to claim that strategies that are best replies to themselves can resist invasion. However, alternative best replies can emerge and spread neutrally until a third form of behaviour can emerge and prosper. As a result, only strategies that are strictly their own unique best replies (or better replies to alternative ones) can be evolutionary stable (Maynard Smith 1982). In the standard RPD, no pure strategy has this quality (Boyd and Lorberbaum 1987). However, noise and complexity cost generate payoff differentials between alternative best replies and may therefore re-establish evolutionary stability (Sugden 1986, May 1987, Boyd 1989).
^{12}The backward induction argument suggests that defection in every round is the only rational outcome of the finite RPD with complete information. The reason is that the identification of the final round leads to defecting endgame behaviour which ultimately unravels the game.
^{13}See, for example, Axelrod and Dion (1988, p.1387), Sigmund (1993 p.192), Bendor (1993), Bendor, Kramer and Stout (1991), Hirshleifer and Coll (1988), Molander (1985), Sugden (1986 p.109), Mueller (1988), Lomborg (1996).
^{14}In the paper first mentioning the prisoner's dilemma, Flood (1958, p.16) reports a private communication with John Nash in which the latter explains that two TRIGGER-strategies are in equilibrium in the infinite version of the game. The general result pertaining to infinite games is known as the Folk Theorem.
^{15}The parameters considered by Axelrod (1984) include the initial population (p.48), population structure (chapter 8), payoff variation (p.133), repetition (p.59, p.126) and noise (p.182-183). The issues of population dynamics and agent representation are examined in his later article (Axelrod 1987).
AUMANN, RJ (1981) "Survey of Repeated Games". In Aumann, RJ et al, Essays in Game Theory and Mathematical Economics, Bibliographisches Institut
AUMANN, RJ and Sorin, S (1989) "Cooperation and Bounded Recall". Games and Economic Behaviour 1, pp.5-39
AXELROD, R (1980a) Effective Choice in the Prisoner's Dilemma. Journal of Conflict Resolution, vol.24. pp.3-25
AXELROD, R (1980b) More Effective Choice in the Prisoner's Dilemma. Journal of Conflict Resolution 24. pp.379-403
AXELROD, R (1984) The Evolution of Cooperation. Basic Books
AXELROD, R (1986) An Evolutionary Approach to Norms. American Political Science Review 80. pp.306-318
AXELROD, R (1987) The Evolution of Strategies in the Iterated Prisoner's Dilemma, in Davis, L (ed.) Genetic Algorithms and Simulating Annealing. Pitman
AXELROD, R (1992) Citation Classic: How to Promote Cooperation. Social and Behavioral Sciences 44. p.10
AXELROD, R and Dion, D (1988) The Further Evolution of Cooperation. Science 242. pp.1385-1390
AXELROD, R (1997) The Complexity of Cooperation. Princeton University Press
BENDOR, J (1993) Uncertainty and the Evolution of Cooperation. Journal of Conflict Resolution 37(4). pp.709-734
BENDOR, J, Kramer, RM and Stout, S (1991) When in Doubt Cooperation in a Noisy Prisoner's Dilemma. Journal of Conflict Resolution 35(4). pp.691-719
BINMORE, K (1994) Playing Fair Game Theory and the Social Contract I. MIT Press
BINMORE, K (1998) Review The Complexity of Cooperation. Journal of Artificial Societies and Social Simulation 1(1). http://jasss.soc.surrey.ac.uk/1/1/review1.html
BINMORE, KG and Samuelson, L (1992) Evolutionary Stability in Repeated Games Played by Finite Automata. Journal of Economic Theory 57. pp.278-305
BOYD, R (1989) Mistakes Allow Evolutionary Stability in the Repeated Prisoner's Dilemma Game. Journal of Theoretical Biology 136. pp.47-56
BOYD, R and Lorberbaum, JP (1987) No Pure Strategy is Evolutionarily Stable in the Repeated Prisoner's Dilemma Game. Nature 327. pp.58-59
CONLISK, J (1996) Why Bounded Rationality. Journal of Economic Literature 34. pp.669-700
DAWKINS, R (1989) The Selfish Gene. Oxford University Press
ELLISON, G (1993) Learning, Local Interaction, and Coordination. Econometrica 61(5). pp.1047-1071
EMSHOFF, JR (1970) A Computer Simulation Model of the Prisoner's Dilemma. Behavioural Science 15. pp.304-317
FLOOD, MM (1958) Some Experimental Games. Management Science 5. pp.5-26
FOGEL, DB (1993) Evolving Behaviors in the Iterated Prisoner's Dilemma. Evolutionary Computation 1(1). pp.77-97
GRIM, P (1997) The Undecidability of the Spatialized Prisoner's Dilemma. Theory and Decision 42(1). pp.53-80
HARDIN, R (1982) Collective Action. Johns Hopkins University Press
HIRSHLEIFER, J and Coll, JM (1988) What Strategies Can Support the Evolutionary Emergence of Cooperation?. Journal of Conflict Resolution 32(2). pp.367-398
HOFBAUER, J and Sigmund, K (1988) The Theory of Evolution and Dynamical Systems. Cambridge University Press
HOFFMANN, R (1996) The Evolution of Cooperation Revisited. UNBS Discussion Paper 96/6
HOFFMANN, R (1999) The Independent Localisations of Interaction and Learning in the Repeated Prisoner's Dilemma. Theory and Decision 47. pp.57-72
HOFFMANN, R (2000) The Ecology of Cooperation.Theory and Decision. forthcoming
HOFFMANN, R and Waring, N (1998) "Complexity Cost and Two Types of Noise in the Repeated Prisoner's Dilemma". In Smith, G.D., Steele, N.C. & Albrecht, R.F. (eds), Artificial Neural Nets and Genetic Algorithms. Springer Verlag
HOLLAND, JH (1992) Genetic Algorithms. Scientific American, July 1992. pp.44-50
HOLLAND, JH and Miller, JH (1991) Artificial Adaptive Agents in Economic Theory. American Economic Association Papers and Proceedings 81(2). pp.365-370
JOHNSON, EJ and Payne, JW (1985) Effort and Accuracy in Choice. Management Science 31(4). pp.395-413
KIRCHKAMP, O (1995) Spatial Evolution of Automata in the Prisoners' Dilemma. University of Bonn SFB 303 Discussion Paper B-330, http://www.sfb504.uni-mannheim.de/~oliver/spatEvol.html
KRAINES, D and Kraines, V (1993) Learning to Cooperate with Pavlov An Adaptive Strategy for the Iterated Prisoner's Dilemma with Noise. Theory and Decision 35. pp.107-150
LINDGREN, K (1992) "Evolutionary Phenomena in Simple Dynamics". In Langton, CG (ed.) Artificial Life II. Addison-Wesley
LINSTER, BG (1992) Evolutionary Stability in the Infinitely Repeated Prisoner's Dilemma Played by Two-State Moore Machines. Southern Economic Journal 58. pp.880-903
LOMBORG, B (1996) Nucleus and Shield: The Evolution of Social Structure in the Interated Prisoner's Dilemma. American Sociological Review 61. pp.278-307
MCCLOSKEY, D (1983) The Rhetoric of Economics. Journal of Economic Literature 21. p.481-517
MARINOFF, L (1992) Maximizing Expected Utilities in the Prisoner's Dilemma. Journal of Conflict Resolution 36(1). pp.183-216
MAY, RM (1987) More Evolution of Cooperation. Nature 327. pp.15-17
MAYNARD SMITH, J (1982) Evolution and the Theory of Games. Cambridge University Press
MAYNARD SMITH, J and Price, GR (1973) The Logic of Animal Conflict. Nature 246. pp.15-18
MILINSKI, M (1987) Tit for Tat in stickleback and the evolution of cooperation. Nature 325. pp.434-435
MILLER, J (1996) The Coevolution of Automata in the Repeated Prisoner's Dilemma. Journal of Economic Behavior and Organization 29. pp.87-112
MOLANDER, P (1985) The Optimal Level of Generosity in a Selfish, Uncertain Environment. Journal of Conflict Resolution 29(4). pp.611-618
MUELLER, U (1988) Optimal Retaliation for Optimal Cooperation. Journal of Conflict Resolution 31(4). pp.692-724
NACHBAR, JH (1992) Evolution in the Finitely Repeated Prisoner's Dilemma. Journal of Economic Behavior and Organization 19. pp.307-326
NEYMAN, A (1985) Bounded Complexity Justifies Cooperation in the Finitely Repeated Prisoners' Dilemma. Economics Letters 19. pp.227-229
NOWAK, MA and May, RM (1992) Evolutionary Games and Spatial Chaos. Nature 359. pp.826-829
NOWAK, MA and May, RM (1993) The Spatial Dilemmas of Evolution. International Journal of Bifurcation and Chaos 3(1). pp.35-78
OLIPHANT, M (1994) "Evolving Cooperation in the Non-Iterated Prisoner's Dilemma: The Importance of Spatial Organization". In Brooks, R and Maes, P (eds.) Proceedings of the Fourth Artificial Life Workshop, MIT Press
OLSON, M (1965) The Logic of Collective Action. Harvard University Press
RADNER, R (1986) "Can Bounded Rationality Resolve The Prisoners' Dilemma?". In Hildenbrand, W and Mas-Colell, A (eds.) Contributions to Mathematical Economics in Honor of Gérard Debreu, North-Holland
ROUTLEDGE, BR (1993) Co-Evolution and Spatial Interaction. manuscript. http://sulawesi.gsia.cmu.edu/papers/Coevolution/
RUBINSTEIN, A (1986) Finite Automata in the Repeated Prisoner's Dilemma. Journal of Economic Theory 39. pp.83-96
SCHUSTER, P and Sigmund, K (1983) Replicator Dynamics. Journal of Theoretical Biology 100. pp.533-538
SIGMUND, K (1993) Games of Life. Oxford University Press
SIMON, HA (1981) The Sciences of the Artificial. MIT Press
STANLEY, EA, Ashlock, D and Tesfatsion, L (1994) "Iterated Prisoner's Dilemma with Choice and Refusal of Partners". In Langton, CG (ed.) Artificial Life III. Addison-Wesley
SUGDEN, R (1986) The Economics of Cooperation, Rights and Welfare. Basil Blackwell
SUGDEN, R (1989) Spontaneous Order. Journal of Economic Perspectives 3(4). pp.85-97
TAYLOR, M (1976) Anarchy and Cooperation. John Wiley
TAYLOR, PD and Jonker, LB (1978) Evolutionarily Stable Strategies and Game Dynamics. Mathematical Biosciences 40. pp.145-156
TRIVERS, R (1985) Social Evolution. Benjamin/Cummings
VANBERG, VJ and Congleton, RD (1992) Rationality, Morality and Exit. American Political Science Review 86(2). pp.418-431
ZEEMAN, EC (1981) Dynamics of the Evolution of Animal Conflicts. Journal of Theoretical Biology 89. pp.249-270
Return to Contents of this issue
© Copyright Journal of Artificial Societies and Social Simulation, 1998