Controlled observations of the genetic algorithm in a changing environment: Case studies using the shaky ladder hyperplane -defined functions

Though recently there has been interest in examining genetic algorithms (GA's) in dynamic environments, work still needs to be done. When studying the GA in static environments, a test suites of functions that are designed for the GA is often used so that the performance of the GA can be observed under systematic, controlled conditions. One example of these suites is the hyperplane-defined functions (hdf's) designed by Holland. This dissertation describes a new test suite of dynamic functions to the study of the GA, and explores three main variants of that test suite that exhibit different effects on the performance of the GA. This test suite, called the shaky ladder hyperplane-defined functions (sl-hdf's) is developed in accordance with a framework that calls for the GA and its behavior to be studied through systematic, controlled observations, thus providing recommendations to practitioners and possible hypotheses to theorists. I begin by describing the sl-hdf's: how they are created, what properties they have, and how they can be utilized for exploring the GA. I conduct examinations of the landscapes of the sl-hdf's and show that some standard metrics of ruggedness are inadequate for these landscapes. Next, I describe a suite of metrics that allow the behavior of the GA in dynamic environments to be observed and analyzed more readily. I then examine these measures on variations of the sl-hdf's. I show that the type and the frequency of changes in dynamic environments is important to the performance of the GA. For instance, in a very rugged environment, the GA is able to perform better when there are regular changes which prevent it from prematurely converging. In addition, I show that crossover greatly increases the performance of the GA on the sl-hdf's. I also investigate the use of self-adaptive mutation rates in dynamic environments. I show that in a variety of circumstances, self-adaptive mutation rates lead to worse performance on the sl-hdf's than a fixed mutation rate, even in a static environment. I conclude by detailing future work to further test the hypotheses presented in this thesis and investigate mechanisms that could be incorporated into the simple GA, like coevolution, to improve performance. I also show how the results of this dissertation could be applied to different fields, and end with a summary.

[1]  Wim Hordijk,et al.  A Measure of Landscapes , 1996, Evolutionary Computation.

[2]  Melanie Mitchell,et al.  A Comparison of Evolutionary and Coevolutionary Search , 2002, Int. J. Comput. Intell. Appl..

[3]  Julian Francis Miller,et al.  Information Characteristics and the Structure of Landscapes , 2000, Evolutionary Computation.

[4]  T. Back,et al.  On the behavior of evolutionary algorithms in dynamic environments , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[5]  Peter A. N. Bosman,et al.  Learning, anticipation and time-deception in evolutionary online dynamic optimization , 2005, GECCO '05.

[6]  Jason M. Daida,et al.  Optimal Mutation and Crossover Rates for a Genetic Algorithm Operating in a Dynamic Environment , 1998, Evolutionary Programming.

[7]  Ernesto Benini,et al.  Genetic Diversity as an Objective in Multi-Objective Evolutionary Algorithms , 2003, Evolutionary Computation.

[8]  Melanie Mitchell,et al.  Evolving Cellular Automata with Genetic Algorithms: A Review of Recent Work , 2000 .

[9]  Erica Jen,et al.  Stable or robust? What's the difference? , 2003, Complex..

[10]  D. Wolpert,et al.  No Free Lunch Theorems for Search , 1995 .

[11]  Frederic Mery,et al.  A fitness cost of learning ability in Drosophila melanogaster , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[12]  C. Wilke Evolution in time-dependent fitness landscapes , 1998, physics/9811021.

[13]  Fred A. Cazel Richard I , 2000 .

[14]  Janet Wiles,et al.  Diversity maintenance on neutral landscapes: an argument for recombination , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[15]  Peter F. Stadler,et al.  Complex Adaptations and the Structure of Recombination Spaces , 1997 .

[16]  David B. Fogel,et al.  A Comparison of Self-Adaptation Methods for Finite State Machines in Dynamic Environments , 1996, Evolutionary Programming.

[17]  William Rand,et al.  Shaky Ladders, Hyperplane-Defined Functions and Genetic Algorithms: Systematic Controlled Observation in Dynamic Environments , 2005, EvoWorkshops.

[18]  Janet Wiles,et al.  Mapping the Royal Road and Other Hierarchical Functions , 2003, Evolutionary Computation.

[19]  Jrgen Branke Evolutionary approaches to dynamic optimization problems , 2001 .

[20]  Terry Jones,et al.  A Description of Holland's Royal Road Function , 1994, Evolutionary Computation.

[21]  A. Sima Etaner-Uyar,et al.  Towards an analysis of dynamic environments , 2005, GECCO '05.

[22]  Stuart A. Kauffman,et al.  ORIGINS OF ORDER , 2019, Origins of Order.

[23]  L. Darrell Whitley,et al.  Evaluating Evolutionary Algorithms , 1996, Artif. Intell..

[24]  Helen G. Cobb,et al.  An Investigation into the Use of Hypermutation as an Adaptive Operator in Genetic Algorithms Having Continuous, Time-Dependent Nonstationary Environments , 1990 .

[25]  Thomas Martinetz,et al.  Genetic Algorithms in Time-Dependent Environments , 1999, ArXiv.

[26]  Terence C. Fogarty,et al.  Performance of a Genetic Algorithm with Variable Local Search Range Relative to Frequency of the Environmental Changes , 1998 .

[27]  David E. Goldberg,et al.  Hierarchical Problem Solving and the Bayesian Optimization Algorithm , 2000, GECCO.

[28]  Emma Hart,et al.  A Comparison of Dominance Mechanisms and Simple Mutation on Non-stationary Problems , 1998, PPSN.

[29]  James P. Crutchfield,et al.  Resource sharing and coevolution in evolving cellular automata , 1999, IEEE Trans. Evol. Comput..

[30]  Zbigniew Michalewicz,et al.  Parameter Control in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[31]  Peter F. Stadler,et al.  Algebraic Theory of Recombination Spaces , 1997, Evolutionary Computation.

[32]  Roger Weinberg,et al.  Computer simulation of a living cell , 1970 .

[33]  Alex Lubberts and Risto Miikkulainen Co-Evolving a Go-Playing Neural network , 2001 .

[34]  Edward O. Wilson,et al.  The Current State of Biological Diversity , 1988 .

[35]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[36]  John J. Grefenstette,et al.  Genetic Algorithms for Changing Environments , 1992, PPSN.

[37]  L. Booker Perspectives on adaptation in natural and artificial systems , 2004 .

[38]  David B. Fogel,et al.  Evolutionary Computation: The Fossil Record , 1998 .

[39]  William Rand,et al.  The Effect of Building Block Construction on the Behavior of the GA in Dynamic Environments: A Case Study Using the Shaky Ladder Hyperplane-Defined Functions , 2006, EvoWorkshops.

[40]  David E. Goldberg,et al.  A hierarchy machine: Learning to optimize from nature and humans , 2003, Complex..

[41]  N. Packard,et al.  Evolution of evolvability via adaptation of mutation rates. , 2003, Bio Systems.

[42]  Jordan B. Pollack,et al.  Modeling Building-Block Interdependency , 1998, PPSN.

[43]  Erik D. Goodman,et al.  A comparison of cohort genetic algorithms with canonical serial and island-model distributed GA's , 2001 .

[44]  Chien-Feng Huang Independent sampling genetic algorithms , 2001 .

[45]  E. Weinberger,et al.  Correlated and uncorrelated fitness landscapes and how to tell the difference , 1990, Biological Cybernetics.

[46]  R.W. Morrison,et al.  A test problem generator for non-stationary environments , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[47]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[48]  Janet Wiles,et al.  How Learning can guide evolution in hierarchical modular tasks - eScholarship , 2001 .

[49]  Geoffrey E. Hinton,et al.  How Learning Can Guide Evolution , 1996, Complex Syst..

[50]  Melanie Mitchell,et al.  The royal road for genetic algorithms: Fitness landscapes and GA performance , 1991 .

[51]  George C. Williams,et al.  Adaptation and Natural Selection , 2018 .

[52]  Lawrence Davis,et al.  Bit-Climbing, Representational Bias, and Test Suite Design , 1991, ICGA.

[53]  W. Daniel Hillis,et al.  Co-evolving parasites improve simulated evolution as an optimization procedure , 1990 .

[54]  John H. Holland,et al.  Building Blocks, Cohort Genetic Algorithms, and Hyperplane-Defined Functions , 2000, Evolutionary Computation.

[55]  Hans-Paul Schwefel,et al.  Evolutionary Learning Optimum-Seeking on Parallel Computer Architectures , 1988 .

[56]  Jordan B. Pollack,et al.  Evolving L-systems to generate virtual creatures , 2001, Comput. Graph..

[57]  Thomas Bck,et al.  Self-adaptation in genetic algorithms , 1991 .

[58]  Jürgen Branke,et al.  Evolutionary Optimization in Dynamic Environments , 2001, Genetic Algorithms and Evolutionary Computation.

[59]  D. Goldberg,et al.  Escaping hierarchical traps with competent genetic algorithms , 2001 .

[60]  Hans-Georg Beyer,et al.  Self-Adaptation in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[61]  RAFAEL A. MARTINEZ Grants , 2005, Journal of Investigative Medicine.

[62]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[63]  William Rand,et al.  The problem with a self-adaptative mutation rate in some environments: a case study using the shaky ladder hyperplane-defined functions , 2005, GECCO '05.

[64]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[65]  John H. Miller,et al.  The coevolution of automata in the repeated Prisoner's Dilemma , 1996 .

[66]  Jürgen Branke,et al.  Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[67]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[68]  Glenn R. Carroll,et al.  Concentration and Specialization: Dynamics of Niche Width in Populations of Organizations , 1985, American Journal of Sociology.

[69]  Jan Paredis,et al.  Coevolving Cellular Automata: Be Aware of the Red Queen! , 1997, ICGA.

[70]  Marco Tomassini,et al.  Evolutionary Algorithms , 1995, Towards Evolvable Hardware.

[71]  P. Kline Models of man , 1986, Nature.

[72]  R. Kaplan Evolutionary adjustment of spontaneous mutation rates , 2004, Humangenetik.

[73]  David E. Goldberg,et al.  Nonstationary Function Optimization Using Genetic Algorithms with Dominance and Diploidy , 1987, ICGA.