Kernel representations for evolving continuous functions

To parameterize continuous functions for evolutionary learning, we use kernel expansions in nested sequences of function spaces of growing complexity. This approach is particularly powerful when dealing with non-convex constraints and discontinuous objective functions. Kernel methods offer a number of beneficial properties for parameterizing continuous functions, such as smoothness and locality, which make them attractive as a basis for mutation operators. Beyond such practical considerations, kernel methods make heavy use of inner products in function space and offer a well established regularization framework. We show how evolutionary computation can profit from these properties. Searching function spaces of iteratively increasing complexity allows the solution to evolve from a simple first guess to a complex and highly refined function. At transition points where the evolution strategy is confronted with the next level of functional complexity, the kernel framework can be used to project the search distribution into the extended search space. The feasibility of the method is demonstrated on challenging trajectory planning problems where redundant robots have to avoid obstacles.

[1]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[2]  Stefano Nolfi,et al.  Evolving robots able to integrate sensory-motor information over time , 2001, Theory in Biosciences.

[3]  Ingo Rechenberg,et al.  Evolutionsstrategie : Optimierung technischer Systeme nach Prinzipien der biologischen Evolution , 1973 .

[4]  A. Hayashi Geometrical motion planning for highly redundant manipulators using a continuous model , 1991 .

[5]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[6]  Kenneth O. Stanley,et al.  Evolving a Single Scalable Controller for an Octopus Arm with a Variable Number of Segments , 2010, PPSN.

[7]  Jean-Claude Latombe,et al.  Robot motion planning , 1991, The Kluwer international series in engineering and computer science.

[8]  Erdinc Sahin Conkur,et al.  Manoeuvring highly redundant manipulators , 1997, Robotica.

[9]  María Cristina Riff,et al.  An On-the-fly Evolutionary Algorithm for Robot Motion Planning , 2005, ICES.

[10]  Julian F. Miller,et al.  Genetic and Evolutionary Computation — GECCO 2003 , 2003, Lecture Notes in Computer Science.

[11]  Derek P. Atherton,et al.  No-overshoot control of robotic manipulators in the presence of obstacles , 1994, J. Field Robotics.

[12]  Jean-Claude Latombe,et al.  Robot Motion Planning: A Distributed Representation Approach , 1991, Int. J. Robotics Res..

[13]  Tamar Flash,et al.  Dynamic model of the octopus arm. I. Biomechanics of the octopus reaching movement. , 2005, Journal of neurophysiology.

[14]  Xin Yao,et al.  Fast Evolution Strategies , 1997, Evolutionary Programming.

[15]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[16]  Vladimir Vapnik,et al.  The Support Vector Method , 1997, ICANN.

[17]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[18]  Y. Engel,et al.  , Ranit Aharonov , Yaakov Engel , Binyamin of the Octopus Reaching Movement Dynamic Model of the Octopus Arm , 2005 .

[19]  Dario Floreano,et al.  Evolution of Altruistic Robots , 2008, WCCI.

[20]  Tom Schaul,et al.  Efficient natural evolution strategies , 2009, GECCO.

[21]  Tom Schaul,et al.  High dimensions and heavy tails for natural evolution strategies , 2011, GECCO '11.

[22]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[23]  Tom Schaul,et al.  Stochastic search using the natural gradient , 2009, ICML '09.

[24]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[25]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[26]  John R. Koza,et al.  Genetic Programming II , 1992 .

[27]  Tom Schaul,et al.  A Natural Evolution Strategy for Multi-objective Optimization , 2010, PPSN.

[28]  Hans-Paul Schwefel,et al.  A comprehensive introduction , 2002 .

[29]  Tom Schaul,et al.  Exponential natural evolution strategies , 2010, GECCO '10.

[30]  W. Vent,et al.  Rechenberg, Ingo, Evolutionsstrategie — Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. 170 S. mit 36 Abb. Frommann‐Holzboog‐Verlag. Stuttgart 1973. Broschiert , 1975 .

[31]  Jürgen Schmidhuber,et al.  Evolving neural networks in compressed weight space , 2010, GECCO '10.

[32]  Ioannis Iossifidis,et al.  Dynamical Systems Approach for the Autonomous Avoidance of Obstacles and Joint-limits for an Redundant Robot Arm , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Sethu Vijayakumar,et al.  Adaptive Optimal Feedback Control with Learned Internal Dynamics Models , 2010, From Motor Learning to Interaction Learning in Robots.

[34]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[35]  Tom Schaul,et al.  Natural Evolution Strategies , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[36]  O. Khatib,et al.  Real-Time Obstacle Avoidance for Manipulators and Mobile Robots , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[37]  Julian Francis Miller,et al.  Evolution of Robot Controller Using Cartesian Genetic Programming , 2005, EuroGP.

[38]  James D. Lee,et al.  Optimal control of a flexible robot arm , 1988 .

[39]  Risto Miikkulainen,et al.  Efficient Non-linear Control Through Neuroevolution , 2006, ECML.