Applying Self-Organised Criticality to Evolutionary Algorithms

Complex systems are typically composed of a large number of locally interacting components that operate at a critical state between chaos and order, which is known as self-organised criticality. A common feature of this state is the exponential (power law) relationship between the frequency of an event and the size of its impact, such as the event of an earthquake and its strength on the Richter scale. Most state transitions in a component of a complex system only affect its neighbourhood, but once in a while entire avalanches of propagating state transitions can lead to a major reconfiguration of the system. In evolution, this system behaviour has been identified in species extinction on an evolutionary time-scale, where avalanches correspond to mass extinction. In this paper, we applied the concept of self-organised criticality (SOC) to control mutation on the individual level and extinction on the population level in the context of evolutionary algorithms (EA). Our results show that the SOC EAs clearly outperform standard EAs and a previously introduced mass extinction model. Interestingly, the great performance of our SOC EAs is based on a very simple modification of standard EAs and implies almost no additional computational costs.

[1]  John J. Grefenstette,et al.  Genetic Algorithms for Tracking Changing Environments , 1993, ICGA.

[2]  V. Scott Gordon,et al.  Terrain-Based Genetic Algorithm (TBGA): Modeling Parameter Space as Terrain , 1999, GECCO.

[3]  Gary B. Fogel,et al.  Emphasizing extinction in evolutionary programming , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[4]  B. Gutenberg,et al.  Seismicity of the Earth , 1970, Nature.

[5]  Zbigniew Michalewicz,et al.  Parameter control in evolutionary algorithms , 1999, IEEE Trans. Evol. Comput..

[6]  T. Krink,et al.  Parameter control using the agent based patchwork model , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[7]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[8]  Ricard V. Solé,et al.  Macroevolutionary algorithms: a new optimization method on fitness landscapes , 1999, IEEE Trans. Evol. Comput..

[9]  D. Raup Biological extinction in earth history. , 1986, Science.

[10]  Kalyanmoy Deb,et al.  Don't Worry, Be Messy , 1991, ICGA.

[11]  George Kingsley Zipf,et al.  Human behavior and the principle of least effort , 1949 .

[12]  Ricard V. Solé,et al.  Evolutionary optimization through extinction dynamics , 1999 .

[13]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[14]  W. Press Flicker noises in astronomy and elsewhere. , 1978 .

[15]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[16]  J. Sepkoski,et al.  Ten years in the library: new data confirm paleontological patterns , 1993, Paleobiology.

[17]  Per Bak,et al.  How Nature Works , 1996 .