Adaptive Niche Radii and Niche Shapes Approaches for Niching with the CMA-ES

While the motivation and usefulness of niching methods is beyond doubt, the relaxation of assumptions and limitations concerning the hypothetical search landscape is much needed if niching is to be valid in a broader range of applications. Upon the introduction of radii-based niching methods with derandomized evolution strategies (ES), the purpose of this study is to address the so-called niche radius problem. A new concept of an adaptive individual niche radius is applied to niching with the covariance matrix adaptation evolution strategy (CMA-ES). Two approaches are considered. The first approach couples the radius to the step size mechanism, while the second approach employs the Mahalanobis distance metric with the covariance matrix mechanism for the distance calculation, for obtaining niches with more complex geometrical shapes. The proposed approaches are described in detail, and then tested on high-dimensional artificial landscapes at several levels of difficulty. They are shown to be robust and to achieve satisfying results.

[1]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[2]  Nikolaus Hansen,et al.  Step-Size Adaption Based on Non-Local Use of Selection Information , 1994, PPSN.

[3]  Nikolaus Hansen,et al.  On the Adaptation of Arbitrary Normal Mutation Distributions in Evolution Strategies: The Generating Set Adaptation , 1995, ICGA.

[4]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[5]  L. Darrell Whitley,et al.  Evaluating Evolutionary Algorithms , 1996, Artif. Intell..

[6]  N. Hansen,et al.  Sizing the population with respect to the local progress in (1,/spl lambda/)-evolution strategies-a theoretical analysis , 1995, Proceedings of 1995 IEEE International Conference on Evolutionary Computation.

[7]  Dumitru Dumitrescu,et al.  Disburdening the species conservation evolutionary algorithm of arguing with radii , 2007, GECCO '07.

[8]  Mike Preuss,et al.  Counteracting genetic drift and disruptive recombination in (μpluskommaλ)-EA on multimodal fitness landscapes , 2005, GECCO '05.

[9]  T. Back Selective pressure in evolutionary algorithms: a characterization of selection mechanisms , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[10]  Ofer M. Shir,et al.  Enhancing Decision Space Diversity in Evolutionary Multiobjective Algorithms , 2009, EMO.

[11]  Ponnuthurai N. Suganthan,et al.  Real-parameter evolutionary multimodal optimization - A survey of the state-of-the-art , 2011, Swarm Evol. Comput..

[12]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[13]  Jürgen Branke,et al.  Evolutionary Optimization in Dynamic Environments , 2001, Genetic Algorithms and Evolutionary Computation.

[14]  K. Warwick,et al.  Dynamic Niche Clustering: a fuzzy variable radius niching technique for multimodal optimisation in GAs , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[15]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[16]  Kalyanmoy Deb,et al.  Omni-optimizer: A Procedure for Single and Multi-objective Optimization , 2005, EMO.

[17]  Ofer M. Shir,et al.  Niching with derandomized evolution strategies in artificial and real-world landscapes , 2009, Natural Computing.

[18]  Márk Jelasity,et al.  UEGO, an Abstract Niching Technique for Global Optimization , 1998, PPSN.

[19]  Xiaodong Yin,et al.  A Fast Genetic Algorithm with Sharing Scheme Using Cluster Analysis Methods in Multimodal Function Optimization , 1993 .

[20]  Claudio De Stefano,et al.  On the role of population size and niche radius in fitness sharing , 2004, IEEE Transactions on Evolutionary Computation.

[21]  Ofer M. Shir,et al.  Niching in evolution strategies , 2005, GECCO '05.

[22]  Samir W. Mahfoud Niching methods for genetic algorithms , 1996 .

[23]  R. K. Ursem Multinational evolutionary algorithms , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[24]  K. Deb,et al.  Population Structures C 6 . 2 Speciation methods , 1997 .

[25]  Christian Igel,et al.  A computational efficient covariance matrix update and a (1+1)-CMA for evolution strategies , 2006, GECCO.

[26]  Ofer M. Shir,et al.  Dynamic niching in evolution strategies with covariance matrix adaptation , 2005, 2005 IEEE Congress on Evolutionary Computation.

[27]  Ofer M. Shir,et al.  Niche Radius Adaptation with Asymmetric Sharing , 2008, PPSN.

[28]  W. Vent,et al.  Rechenberg, Ingo, Evolutionsstrategie — Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. 170 S. mit 36 Abb. Frommann‐Holzboog‐Verlag. Stuttgart 1973. Broschiert , 1975 .

[29]  Aimo A. Törn,et al.  Global Optimization , 1999, Science.

[30]  Andreas Zell,et al.  A Clustering Based Niching EA for Multimodal Search Spaces , 2003, Artificial Evolution.

[31]  Ofer M. Shir,et al.  Niche Radius Adaptation in the CMA-ES Niching Algorithm , 2006, PPSN.

[32]  Stefan Roth,et al.  Covariance Matrix Adaptation for Multi-objective Optimization , 2007, Evolutionary Computation.

[33]  Dumitru Dumitrescu,et al.  Elitist generational genetic chromodynamics - a new radii-based evolutionary algorithm for multimodal optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[34]  Michael J. Shaw,et al.  Genetic algorithms with dynamic niche sharing for multimodal function optimization , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[35]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[36]  Claude-Pierre Jeannerod,et al.  On the complexity of polynomial matrix computations , 2003, ISSAC '03.

[37]  Sheridan K. Houghten,et al.  Genetic algorithm with alternating selection pressure for protein side-chain packing and pK(a) prediction , 2011, Biosyst..

[38]  Nikolaus Hansen,et al.  A Derandomized Approach to Self-Adaptation of Evolution Strategies , 1994, Evolutionary Computation.

[39]  Hans-Georg Beyer,et al.  Qualms Regarding the Optimality of Cumulative Path Length Control in CSA/CMA-Evolution Strategies , 2003, Evolutionary Computation.

[40]  Shigenobu Kobayashi,et al.  Adaptive isolation model using data clustering for multimodal function optimization , 2005, GECCO '05.

[41]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[42]  Gideon Avigad,et al.  Concept-Based Interactive Brainstorming in Engineering Design , 2004, J. Adv. Comput. Intell. Intell. Informatics.

[43]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[44]  D. Fogel Evolutionary algorithms in theory and practice , 1997, Complex..

[45]  Ofer M. Shir,et al.  Niching in Evolution Strategies and Its Application to Laser Pulse Shaping , 2005, Artificial Evolution.

[46]  Franz Aurenhammer,et al.  Niching evolution strategy with cluster algorithms , 2000 .

[47]  Michael Nikolaou,et al.  A hybrid approach to global optimization using a clustering algorithm in a genetic search framework , 1998 .

[48]  Ingo Rechenberg,et al.  Evolutionsstrategie : Optimierung technischer Systeme nach Prinzipien der biologischen Evolution , 1973 .

[49]  M. Preuss,et al.  Counteracting genetic drift and disruptive recombination in (μpluskommaλ)-EA on multimodal fitness landscapes , 2005, GECCO '05.

[50]  M. Preuss,et al.  On the extinction of sub-populations on multimodal landscapes , 2004 .