The impact of noise on iterated prisoner's dilemma with multiple levels of cooperation

Real world dilemma rarely involved just two choices and perfect interactions without mistakes. In extending the realism of the iterated prisoner's evolutionary approaches included intermediate choices or mistakes (noise). This study takes a step further using a coevolving population of neural networks playing the IPD game with both intermediate choices and noise. Several issues will be addressed, which include the evolution of cooperation and the evolutionary stability in the presence of noise and more choices. Our experimental study shows that noise has a negative impact on the evolution of cooperation, but could improve, surprisingly, the evolutionary stability.

[1]  J. Sayer Minas,et al.  Some descriptive aspects of two-person non-zero-sum games , 1959 .

[2]  R. Axelrod.  Effective Choice in the Prisoner's Dilemma , 1980 .

[3]  R. Axelrod.  More Effective Choice in the Prisoner's Dilemma , 1980 .

[4]  W. Hamilton,et al.  The Evolution of Cooperation , 1984 .

[5]  P. Molander.  The Optimal Level of Generosity in a Selfish, Uncertain Environment , 1985 .

[6]  R. Axelrod,et al.  The Further Evolution of Cooperation , 1988, Science.

[7]  Roderick M. Kramer,et al.  When in Doubt... , 1991 .

[8]  David B. Fogel,et al.  Evolving Behaviors in the Iterated Prisoner's Dilemma , 1993, Evolutionary Computation.

[9]  M. Nowak,et al.  Chaos and the evolution of cooperation. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Peter Kollock,et al.  "An Eye for an Eye Leaves Everyone Blind": Cooperation and Accounting Systems , 1993 .

[11]  J. Lorberbaum,et al.  No strategy is evolutionarily stable in the repeated prisoner's dilemma. , 1994, Journal of theoretical biology.

[12]  Xin Yao,et al.  On Evolving Robust Strategies for Iterated Prisoner's Dilemma , 1993, Evo Workshops.

[13]  R. Axelrod,et al.  How to Cope with Noise in the Iterated Prisoner's Dilemma , 1995 .

[14]  X. Yao.  Evolutionary stability in the n-person iterated prisoner's dilemma. , 1996, Bio Systems.

[15]  D. Fogel,et al.  Evolving continuous behaviors in the Iterated Prisoner's Dilemma. , 1996, Bio Systems.

[16]  X. Yao,et al.  How important is your reputation in a multi-agent environment , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[17]  Sung-Bae Cho,et al.  Emergence of cooperative coalition in NIPD game with localization of interaction and learning , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[18]  M. Nowak,et al.  The continuous Prisoner's dilemma: II. Linear reactive strategies with noise. , 1999, Journal of theoretical biology.

[19]  David B. Fogel,et al.  Evolution, neural networks, games, and intelligence , 1999, Proc. IEEE.

[20]  Xin Yao,et al.  Does extra genetic diversity maintain escalation in a co-evolutionary arms race , 2000 .

[21]  D P Kraines,et al.  Natural selection of memory-one strategies for the iterated prisoner's dilemma. , 2000, Journal of theoretical biology.

[22]  Sung-Bae Cho,et al.  Exploiting coalition in co-evolutionary learning , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[23]  David B. Fogel,et al.  Evolving an expert checkers playing program without using human expertise , 2001, IEEE Trans. Evol. Comput..

[24]  Xin Yao,et al.  Why more choices cause less cooperation in iterated prisoner's dilemma , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[25]  Robert Axelrod,et al.  The Evolution of Strategies in the Iterated Prisoner's Dilemma , 2001 .

[26]  Xin Yao,et al.  Co-Evolution in Iterated Prisoner's Dilemma with Intermediate Levels of Cooperation: Application to Missile Defense , 2002, Int. J. Comput. Intell. Appl..

[27]  Bengt Carlsson,et al.  Differences between the iterated prisoner's dilemma and the chicken game under noisy conditions , 2002, SAC '02.

[28]  Siang Yew Chong,et al.  Evolved neural networks learning Othello strategies , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..