Deception, dominance and implicit parallelism in genetic search

This paper presents several theorems concerning the nature of deception, its relationship to hyperplane dominance, and the central role that deception plays in function optimization using genetic algorithms. The theoretical results relate to four general themes. First, the concept of a “deceptive attractor” is introduced; it is shown that a deceptive attractor must be the complement of the global solution for a problem to be fully deceptive. It is also shown that the deceptive attractor must either be a local optimum in Hamming space, or adjacent to a local optimum in Hamming space if the problem is fully deceptive. Second, it can be shown that the global solution to nondeceptive problems can be inferred (theoretically and often in practice) by determining the “winners” of the order-1 hyperplanes. The third theme relates the concept of deception and dominance. If a dominance relationship exists between two hyperplanes then deception is impossible between those two partitions of hyperspace; analogously, deception between two hyperplanes precludes a dominance relationship. The fourth theme relates to deception and implicit parallelism. It can be shown that if a genetic algorithm reliably allocates exponentially more trials to the observed best, then implicit parallelism (and the 2-arm bandit analogy) breaks down when deception is present.

[1]  Kalyanmoy Deb,et al.  Messy Genetic Algorithms: Motivation, Analysis, and First Results , 1989, Complex Syst..

[2]  D. E. Goldberg,et al.  Simple Genetic Algorithms and the Minimal, Deceptive Problem , 1987 .

[3]  David E. Goldberg,et al.  Genetic Algorithms and Walsh Functions: Part II, Deception and Its Analysis , 1989, Complex Syst..

[4]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[5]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[6]  John J. Grefenstette,et al.  How Genetic Algorithms Work: A Critical Look at Implicit Parallelism , 1989, ICGA.

[7]  David E. Goldberg,et al.  Construction of high-order deceptive functions using low-order Walsh coefficients , 1992, Annals of Mathematics and Artificial Intelligence.

[8]  Albert Donally Bethke,et al.  Genetic Algorithms as Function Optimizers , 1980 .

[9]  GUNAR E. LIEPINS,et al.  Representational issues in genetic optimization , 1990, J. Exp. Theor. Artif. Intell..

[10]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.

[11]  John J. Grefenstette,et al.  Genetic algorithms in noisy environments , 1988, Machine Learning.

[12]  L. Darrell Whitley,et al.  Fundamental Principles of Deception in Genetic Search , 1990, FOGA.

[13]  D. Goldberg,et al.  Signal, noise, and genetic algorithms , 1991 .

[14]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[15]  David E. Goldberg,et al.  Genetic Algorithms and Walsh Functions: Part I, A Gentle Introduction , 1989, Complex Syst..