A Taxonomy for Artificial Embryogeny

A major challenge for evolutionary computation is to evolve phenotypes such as neural networks, sensory systems, or motor controllers at the same level of complexity as found in biological organisms. In order to meet this challenge, many researchers are proposing indirect encodings, that is, evolutionary mechanisms where the same genes are used multiple times in the process of building a phenotype. Such gene reuse allows compact representations of very complex phenotypes. Development is a natural choice for implementing indirect encodings, if only because nature itself uses this very process. Motivated by the development of embryos in nature, we define artificial embryogeny (AE) as the subdiscipline of evolutionary computation (EC) in which phenotypes undergo a developmental phase. An increasing number of AE systems are currently being developed, and a need has arisen for a principled approach to comparing and contrasting, and ultimately building, such systems. Thus, in this paper, we develop a principled taxonomy for AE. This taxonomy provides a unified context for long-term research in AE, so that implementation decisions can be compared and contrasted along known dimensions in the design space of embryogenic systems. It also allows predicting how the settings of various AE parameters affect the capacity to efficiently evolve complex phenotypes.

[1]  C. Waddington Canalization of Development and the Inheritance of Acquired Characters , 1942, Nature.

[2]  D H HUBEL,et al.  RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE IN TWO NONSTRIATE VISUAL AREAS (18 AND 19) OF THE CAT. , 1965, Journal of neurophysiology.

[3]  A. Lindenmayer Mathematical models for cellular interactions in development. II. Simple and branching filaments with two-sided inputs. , 1968, Journal of theoretical biology.

[4]  L. Wolpert Developmental Biology , 1968, Nature.

[5]  A. Lindenmayer Mathematical models for cellular interactions in development. I. Filaments with one-sided inputs. , 1968, Journal of theoretical biology.

[6]  N. Sigal,et al.  Genetic recombination: the nature of a crossed strand-exchange between two homologous DNA molecules. , 1972, Journal of molecular biology.

[7]  Aristid Lindenmayer,et al.  Adding Continuous Components to L-Systems , 1974, L Systems.

[8]  C. Radding,et al.  Homologous pairing and strand exchange in genetic recombination. , 1982, Annual review of genetics.

[9]  Richard S. Sutton,et al.  Neuronlike adaptive elements that can solve difficult learning control problems , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[10]  C. Gans,et al.  Neural Crest and the Origin of Vertebrates: A New Head , 1983, Science.

[11]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[12]  R. Williams,et al.  Growth cones, dying axons, and developmental fluctuations in the fiber population of the cat's optic nerve , 1986, The Journal of comparative neurology.

[13]  R. Elinson Change in developmental patterns: embryos of amphibians with large eggs , 1986 .

[14]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[15]  Charles W. Anderson,et al.  Learning to Control an Inverted Pendulum with Connectionist Networks , 1988, 1988 American Control Conference.

[16]  V. Ambros A hierarchy of regulatory genes controls a larva-to-adult developmental switch in C. elegans , 1989, Cell.

[17]  C.W. Anderson,et al.  Learning to control an inverted pendulum using neural networks , 1989, IEEE Control Systems Magazine.

[18]  Hiroaki Kitano,et al.  Designing Neural Networks Using Genetic Algorithms with Graph Generation System , 1990, Complex Syst..

[19]  Przemyslaw Prusinkiewicz,et al.  The Algorithmic Beauty of Plants , 1990, The Virtual Laboratory.

[20]  A. M. Turing,et al.  The chemical basis of morphogenesis , 1952, Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences.

[21]  Alexis P. Wieland,et al.  Evolving Controls for Unstable Systems , 1991 .

[22]  D. Parisi,et al.  Growing neural networks , 1991 .

[23]  David H. Sharp,et al.  A connectionist model of development. , 1991, Journal of theoretical biology.

[24]  A. P. Wieland,et al.  Evolving neural network controllers for unstable systems , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[25]  T. Wiesel,et al.  Receptive field dynamics in adult primary visual cortex , 1992, Nature.

[26]  P. Lawrence The making of a fly , 1992 .

[27]  A. Cangelosi,et al.  Cell division and migration in a ‘genotype’ for neural networks , 1993 .

[28]  Richard K. Belew,et al.  Evolving Aesthetic Sorting Networks Using Developmental Grammars , 1993, ICGA.

[29]  F. Bloom Principles of Neural Science, 3rd ed , 1993 .

[30]  J. Fischer Principles of Neural Science (3rd ed.) , 1993 .

[31]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[32]  V. Brabender,et al.  The developmental model. , 1993 .

[33]  R. Williams,et al.  Rapid evolution of the visual system: a cellular assay of the retina and dorsal lateral geniculate nucleus of the Spanish wildcat and the domestic cat , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[34]  Frédéric Gruau,et al.  Genetic Synthesis of Modular Neural Networks , 1993, ICGA.

[35]  Frank Dellaert,et al.  Toward an evolvable model of development for autonomous agent synthesis , 1994 .

[36]  William E. Hart,et al.  The Role of Development in Genetic Algorithms , 1994, FOGA.

[37]  Karl Sims,et al.  Evolving 3D Morphology and Behavior by Competition , 1994, Artificial Life.

[38]  Jari Vaario,et al.  From Evolutionary Computation to Computational Evolution , 1994, Informatica.

[39]  D. Curtis,et al.  nanos is an evolutionarily conserved organizer of anterior-posterior polarity. , 1995, Development.

[40]  David B. Fogel,et al.  Evolving Neural Control Systems , 1995, IEEE Expert.

[41]  Robert G. Reynolds,et al.  Morphogenic Evolutionary Computations: Introduction, Issues and Examples , 1995 .

[42]  S. Carroll Homeotic genes and the evolution of arthropods and chordates , 1995, Nature.

[43]  Peter J. Angeline,et al.  Morphogenic Evolutionary Computations: Introduction, Issues and Example , 1995, Evolutionary Programming.

[44]  F. Dellaert TOWARD A BIOLOGICALLY DEFENSIBLE MODEL OF DEVELOPMENT , 1995 .

[45]  Maja J. Matarić,et al.  A Developmental Model for the Evolution of Complete Autonomous Agents , 1996 .

[46]  Larry D. Pyeatt,et al.  A comparison between cellular encoding and direct encoding for genetic neural networks , 1996 .

[47]  R. Raff Understanding Evolution: The Next Step. (Book Reviews: The Shape of Life. Genes, Development, and the Evolution of Animal Form.) , 1996 .

[48]  Lee Spector,et al.  Evolving Graphs and Networks with Edge Encoding: Preliminary Report , 1996 .

[49]  S. Voss,et al.  Adaptive evolution via a major gene effect: paedomorphosis in the Mexican axolotl. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[50]  M. Cohn,et al.  Hox9 genes and vertebrate limb specification , 1997, nature.

[51]  Peter Eggenberger,et al.  Evolving Morphologies of Simulated 3d Organisms Based on Differential Gene Expression , 1997 .

[52]  P. Lijnzaad,et al.  A physical map of 30,000 human genes. , 1998, Science.

[53]  T. Schnier,et al.  Evolved Representations and Their Use in Computational Creativity , 1998 .

[54]  Kunihiko Kaneko,et al.  Emergence of Multicellular Organisms with Dynamic Differentiation and Spatial Pattern , 1997, Artificial Life.

[55]  Simon M. Lucas,et al.  A comparison of matrix rewriting versus direct encoding for evolving neural networks , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[56]  H. Nijhout,et al.  Competition among body parts in the development and evolution of insect morphology. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[57]  Y L Wang,et al.  Zebrafish hox clusters and vertebrate genome evolution. , 1998, Science.

[58]  Andrew P. Martin Increasing Genomic Complexity by Gene Duplication and the Origin of Vertebrates , 1999, The American Naturalist.

[59]  Peter J. Bentley,et al.  Three Ways to Grow Designs: A Comparison of Embryogenies for an Evolutionary Design Problem , 1999, GECCO.

[60]  A. Force,et al.  Preservation of duplicate genes by complementary, degenerative mutations. , 1999, Genetics.

[61]  R. Raff,et al.  A novel ontogenetic pathway in hybrid embryos between species with different modes of development. , 1999, Development.

[62]  Risto Miikkulainen,et al.  Solving Non-Markovian Control Tasks with Neuro-Evolution , 1999, IJCAI.

[63]  Carola B. Sigrist,et al.  Vulva formation in Pristionchus pacificus relies on continuous gonadal induction , 1999, Development Genes and Evolution.

[64]  Jordan B. Pollack,et al.  Automatic design and manufacture of robotic lifeforms , 2000, Nature.

[65]  Stefano Nolfi,et al.  Duplication of Modules Facilitates the Evolution of Functional Specialization , 1999, Artificial Life.

[66]  Una-May O'Reilly,et al.  Emergent Design: Artificial Life for Architecture Design , 2000 .

[67]  B. Reinhart,et al.  The 21-nucleotide let-7 RNA regulates developmental timing in Caenorhabditis elegans , 2000, Nature.

[68]  John S. McCaskill,et al.  Emergent Design: Artificial Life for Architecture Design , 2000 .

[69]  Christoph Adami,et al.  A Developmental Model for the Evolution of Artificial Neural Networks , 2000, Artificial Life.

[70]  Chandana Paul,et al.  Investigating Morphological Symmetry and Locomotive Efficiency using Virtual Embodied Evolution , 2000 .

[71]  S. Lall,et al.  Conservation and divergence in molecular mechanisms of axis formation. , 2001, Annual review of genetics.

[72]  Maciej Komosinski,et al.  Comparison of Different Genotype Encodings for Simulated Three-Dimensional Agents , 2002, Artificial Life.

[73]  A. Wilkins The Evolution of Developmental Pathways , 2001 .

[74]  Gregory S. Hornby,et al.  Body-brain co-evolution using L-systems as a generative encoding , 2001 .

[75]  Gregory S. Hornby,et al.  The advantages of generative grammatical encodings for physical design , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[76]  R. Pfeifer,et al.  Repeated structure and dissociation of genotypic and phenotypic complexity in artificial ontogeny , 2001 .

[77]  Jordan B. Pollack,et al.  Creating High-Level Components with a Generative Representation for Body-Brain Evolution , 2002, Artificial Life.

[78]  L. Luo,et al.  Representation of the Glomerular Olfactory Map in the Drosophila Brain , 2002, Cell.

[79]  Lance Hosey Whales , 2002 .

[80]  Josh Bongard,et al.  Evolving modular genetic regulatory networks , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[81]  Risto Miikkulainen,et al.  Efficient Reinforcement Learning Through Evolving Neural Network Topologies , 2002, GECCO.

[82]  Risto Miikkulainen,et al.  Continual Coevolution Through Complexification , 2002, GECCO.

[83]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[84]  R. Beer,et al.  20 – A developmental model for the evolution of complete autonomous agents , 2003 .

[85]  N. Jakobi 21 – Harnessing morphogenesis , 2003 .

[86]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[87]  L. D. Whitley,et al.  Genetic Reinforcement Learning for Neurocontrol Problems , 2004, Machine Learning.

[88]  Keith L. Downing,et al.  Development and the Baldwin Effect , 2004, Artificial Life.

[89]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[90]  Risto Miikkulainen,et al.  Efficient Reinforcement Learning through Symbiotic Evolution , 2004 .

[91]  Janet Wiles,et al.  A Gene Network Model for Developing Cell Lineages , 2005, Artificial Life.

[92]  Stuart A. Kauffman,et al.  ORIGINS OF ORDER , 2019, Origins of Order.