Multimodal Optimization by Means of a Topological Species Conservation Algorithm

Any evolutionary technique for multimodal optimization must answer two crucial questions in order to guarantee some success on a given task: How to most unboundedly distinguish between the different attraction basins and how to most accurately safeguard the consequently discovered solutions. This paper thus aims to present a novel technique that integrates the conservation of the best successive local individuals (as in the species conserving genetic algorithm) with a topological subpopulations separation (as in the multinational genetic algorithm) instead of the common but problematic radius-triggered manner. A special treatment for offspring integration, a more rigorous control on the allowed number and uniqueness of the resulting seeds, and a more efficient fitness evaluations budget management further augment a previously suggested naïve combination of the two algorithms. Experiments have been performed on a series of benchmark test functions, including a problem from engineering design. Comparison is primarily conducted to show the significant performance difference to the naïve combination; also the related radius-dependent conserving algorithm is subsequently addressed. Additionally, three more multimodal evolutionary methods, being either conceptually close, competitive as radius-based strategies, or recent state-of-the-art are also taken into account. We detect a clear advantage of three of the six algorithms that, in the case of our method, probably comes from the proper topological separation into subpopulations according to the existing attraction basins, independent of their locations in the function landscape. Additionally, an investigation of the parameter independence of the method as compared to the radius-compelled algorithms is systematically accomplished.

[1]  Dumitru Dumitrescu,et al.  EA-Powered Basin Number Estimation by Means of Preservation and Exploration , 2008, PPSN.

[2]  Ofer M. Shir,et al.  Niche Radius Adaptation in the CMA-ES Niching Algorithm , 2006, PPSN.

[3]  P. John Clarkson,et al.  A Species Conserving Genetic Algorithm for Multimodal Function Optimization , 2002, Evolutionary Computation.

[4]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[5]  Robert G. Reynolds,et al.  Problem solving using cultural algorithms , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[6]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[7]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[8]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[9]  Thomas Bartz-Beielstein,et al.  Experimental Research in Evolutionary Computation - The New Experimentalism , 2010, Natural Computing Series.

[10]  D. J. Cavicchio,et al.  Adaptive search using simulated evolution , 1970 .

[11]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[12]  Claudio De Stefano,et al.  Where Are the Niches? Dynamic Fitness Sharing , 2007, IEEE Transactions on Evolutionary Computation.

[13]  Dumitru Dumitrescu,et al.  Disburdening the species conservation evolutionary algorithm of arguing with radii , 2007, GECCO '07.

[14]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[15]  Christian Igel,et al.  A computational efficient covariance matrix update and a (1+1)-CMA for evolution strategies , 2006, GECCO.

[16]  Mike Preuss,et al.  Counteracting genetic drift and disruptive recombination in (μpluskommaλ)-EA on multimodal fitness landscapes , 2005, GECCO '05.

[17]  A. E. Eiben,et al.  Multimodal Problems and Spatial Distribution , 2003 .

[18]  M. Preuss NICHING PROSPECTS , 2006 .

[19]  René Thomsen,et al.  Multimodal optimization using crowding-based differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[20]  Margaret J. Robertson,et al.  Design and Analysis of Experiments , 2006, Handbook of statistics.

[21]  John H. Holland Interim and Prospectus , 1992 .

[22]  M. Preuss,et al.  Counteracting genetic drift and disruptive recombination in (μpluskommaλ)-EA on multimodal fitness landscapes , 2005, GECCO '05.

[23]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[24]  Vitaliy Feoktistov Differential Evolution: In Search of Solutions , 2006 .

[25]  Rasmus K. Ursem,et al.  Multinational GAs: Multimodal Optimization Techniques in Dynamic Environments , 2000, GECCO.

[26]  Samir W. Mahfoud Niching methods for genetic algorithms , 1996 .

[27]  R. K. Ursem Multinational evolutionary algorithms , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[28]  Ofer M. Shir,et al.  Niching in evolution strategies , 2005, GECCO '05.

[29]  Ofer M. Shir,et al.  Niching with derandomized evolution strategies in artificial and real-world landscapes , 2009, Natural Computing.