The Schema Theorem and Price's Theorem

Abstract Holland's Schema Theorem is widely taken to be the foundation for explanations of the power of genetic algorithms (GAs). Yet some dissent has been expressed as to its implications. Here, dissenting arguments are reviewed and elaborated upon, explaining why the Schema Theorem has no implications for how well a GA is performing. Interpretations of the Schema Theorem have implicitly assumed that a correlation exists between parent and offspring fitnesses, and this assumption is made explicit in results based on Price's Covariance and Selection Theorem. Schemata do not play a part in the performance theorems derived for representations and operators in general. However, schemata re-emerge when recombination operators are used. Using Geiringer's recombination distribution representation of recombination operators, a “missing” schema theorem is derived which makes explicit the intuition for when a GA should perform well. Finally, the method of “adaptive landscape” analysis is examined and counterexamples offered to the commonly used correlation statistic. Instead, an alternative statistic — the transmission function in the fitness domain — is proposed as the optimal statistic for estimating GA performance from limited samples.

[1]  K. Kinnear Fitness landscapes and difficulty in genetic programming , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[2]  B. Charlesworth,et al.  The effect of linkage and population size on inbreeding depression due to mutational load. , 1992, Genetical research.

[3]  Alan Grafen,et al.  A geometric view of relatedness , 1985 .

[4]  C. Cockerham,et al.  An Extension of the Concept of Partitioning Hereditary Variance for Analysis of Covariances among Relatives When Epistasis Is Present. , 1954, Genetics.

[5]  Michael D. Vose,et al.  Formalizing Genetic Algorithms , 1991 .

[6]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1967 .

[7]  Weinberger,et al.  RNA folding and combinatory landscapes. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[8]  Nicholas J. Radcliffe,et al.  Non-Linear Genetic Representations , 1992, PPSN.

[9]  Lee Altenberg,et al.  Chaos from Linear Frequency-Dependent Selection , 1991, The American Naturalist.

[10]  Peter F. Stadler,et al.  Correlation in Landscapes of Combinatorial Optimization Problems , 1992 .

[11]  Michael D. Vose,et al.  Generalizing the Notion of Schema in Genetic Algorithms , 1991, Artif. Intell..

[12]  John J. Grefenstette Predictive Models Using Fitness Distributions of Genetic Operators , 1994, FOGA.

[13]  G. Price,et al.  Extension of covariance selection mathematics , 1972, Annals of human genetics.

[14]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[15]  M. Wade Soft Selection, Hard Selection, Kin Selection, and Group Selection , 1985, The American Naturalist.

[16]  Nicholas J. Radcliffe,et al.  Equivalence Class Analysis of Genetic Algorithms , 1991, Complex Syst..

[17]  Heinz Mühlenbein,et al.  The Science of Breeding and Its Application to the Breeder Genetic Algorithm (BGA) , 1993, Evolutionary Computation.

[18]  E D Weinberger,et al.  Why some fitness landscapes are fractal. , 1993, Journal of theoretical biology.

[19]  S Karlin,et al.  Central equilibria in multilocus systems. I. Generalized nonepistatic selection regimes. , 1979, Genetics.

[20]  M Slatkin,et al.  The distribution of allelic effects under mutation and selection. , 1990, Genetical research.

[21]  Gunar E. Liepins,et al.  Punctuated Equilibria in Genetic Search , 1991, Complex Syst..

[22]  R. Bürger Predictions of the dynamics of a polygenic character under directional selection. , 1993, Journal of theoretical biology.

[23]  L. Altenberg The evolution of evolvability in genetic programming , 1994 .

[24]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[25]  Colin R. Reeves,et al.  An Experimental Design Perspective on Genetic Algorithms , 1994, FOGA.

[26]  Weinberger,et al.  Local properties of Kauffman's N-k model: A tunably rugged energy landscape. , 1991, Physical review. A, Atomic, molecular, and optical physics.

[27]  Michael D. Vose,et al.  The Genetic Algorithm Fractal , 1993, Evolutionary Computation.

[28]  Bernard Manderick,et al.  The Genetic Algorithm and the Structure of the Fitness Landscape , 1991, ICGA.

[29]  N. Barton,et al.  Dynamics of polygenic characters under selection. , 1990 .

[30]  H. Geiringer On the Probability Theory of Linkage in Mendelian Heredity , 1944 .

[31]  Lashon B. Booker,et al.  Recombination Distributions for Genetic Algorithms , 1992, FOGA.

[32]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[33]  M. Feldman,et al.  Evolution of continuous variation: direct approach through joint distribution of genotypes and phenotypes. , 1976, Proceedings of the National Academy of Sciences of the United States of America.

[34]  Keith E. Mathias,et al.  Genetic Operators, the Tness Landscape and the Traveling Salesman Problem , 1992 .

[35]  P D Taylor,et al.  Inclusive fitness models with two sexes. , 1988, Theoretical population biology.

[36]  M W Feldman,et al.  Selection, generalized transmission and the evolution of modifier genes. I. The reduction principle. , 1987, Genetics.

[37]  Correlation structure of the landscape of the graph-bipartitioning problem , 1992 .

[38]  John J. Grefenstette,et al.  Conditions for Implicit Parallelism , 1990, FOGA.

[39]  C. Goodnight EPISTASIS AND THE EFFECT OF FOUNDER EVENTS ON THE ADDITIVE GENETIC VARIANCE , 1988, Evolution; international journal of organic evolution.

[40]  Samuel Karlin,et al.  Central equilibria in multilocus systems , 1979 .

[41]  George R. Price,et al.  Selection and Covariance , 1970, Nature.

[42]  J. David Schaffer,et al.  Proceedings of the third international conference on Genetic algorithms , 1989 .

[43]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[44]  Schloss Birlinghoven Evolution in Time and Space -the Parallel Genetic Algorithm , 1991 .

[45]  R. B. Robbins Some Applications of Mathematics to Breeding Problems III. , 1917, Genetics.

[46]  Gilbert Syswerda,et al.  Simulated Crossover in Genetic Algorithms , 1992, FOGA.

[47]  P. Stadler,et al.  The landscape of the traveling salesman problem , 1992 .

[48]  M. Slatkin Selection and polygenic characters. , 1970, Proceedings of the National Academy of Sciences of the United States of America.

[49]  S Karlin,et al.  Models of multifactorial inheritance: I. Multivariate formulations and basic convergence results. , 1979, Theoretical population biology.

[50]  Heinz Mühlenbein,et al.  Evolution in Time and Space - The Parallel Genetic Algorithm , 1990, FOGA.

[51]  R. Punnett,et al.  The Genetical Theory of Natural Selection , 1930, Nature.

[52]  L. Darrell Whitley,et al.  Genetic Operators, the Fitness Landscape and the Traveling Salesman Problem , 1992, PPSN.

[53]  Peter F. Stadler,et al.  Linear Operators on Correlated Landscapes , 1994 .

[54]  Larry J. Eshelman,et al.  Biases in the Crossover Landscape , 1989, ICGA.

[55]  Patrick D. Surry,et al.  Fitness Variance of Formae and Performance Prediction , 1994, FOGA.

[56]  Heinz Mühlenbein,et al.  Estimating the Heritability by Decomposing the Genetic Variance , 1994, PPSN.

[57]  D. Ackley A connectionist machine for genetic hillclimbing , 1987 .

[58]  S Karlin,et al.  Classifications and comparisons of multilocus recombination distributions. , 1978, Proceedings of the National Academy of Sciences of the United States of America.

[59]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[60]  John J. Grefenstette,et al.  How Genetic Algorithms Work: A Critical Look at Implicit Parallelism , 1989, ICGA.

[61]  Lars Kai Hansen,et al.  Unsupervised learning and generalization , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[62]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.