Ensemble crowding differential evolution with neighborhood mutation for multimodal optimization

Many optimization problems possess multiple global solutions or comparably fit local solutions. These multimodal optimization problems require the identification of not just one global optimal, but also multiple compatible solutions. Differential Evolution (DE) has been demonstrated to be highly effective for solving single-objective unimodal problems, but its loss of diversity over the course of evolution prevents it from locating multiple compatible solutions. Our proposed method combines the diversity maintenance of niching and neighborhood mutation techniques with the versatility of ensemble parameters for DE to enhance the exploitation of individual peaks on difficult multi-modal problems. Greedy local mutation strategy and crossover are shown to have improved the performance of the neighborhood crowding DE (NCDE) in our experiment with 14 common multimodal benchmark functions.

[1]  Jürgen Branke,et al.  Evolutionary Optimization in Dynamic Environments , 2001, Genetic Algorithms and Evolutionary Computation.

[2]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[3]  Ponnuthurai N. Suganthan,et al.  Evolutionary programming with ensemble of explicit memories for dynamic optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[4]  Ponnuthurai N. Suganthan,et al.  Real-parameter evolutionary multimodal optimization - A survey of the state-of-the-art , 2011, Swarm Evol. Comput..

[5]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[6]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[7]  Jing J. Liang,et al.  Differential Evolution With Neighborhood Mutation for Multimodal Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[8]  Lixin Ding,et al.  An improved crowding-based differential evolution for multimodal optimization , 2011, 2011 International Conference on Electrical and Control Engineering.

[9]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[10]  Rammohan Mallipeddi,et al.  Ensemble based face recognition using discriminant PCA Features , 2012, 2012 IEEE Congress on Evolutionary Computation.

[11]  David E. Goldberg,et al.  Probabilistic Crowding: Deterministic Crowding with Probabilistic Replacement , 1999 .

[12]  Ponnuthurai N. Suganthan,et al.  Dynamic Grouping Crowding Differential Evolution with Ensemble of Parameters for Multi-modal Optimization , 2010, SEMCCO.

[13]  Ponnuthurai N. Suganthan,et al.  Novel multimodal problems and differential evolution with ensemble of restricted tournament selection , 2010, IEEE Congress on Evolutionary Computation.

[14]  Dumitru Dumitrescu,et al.  Multimodal Optimization by Means of a Topological Species Conservation Algorithm , 2010, IEEE Transactions on Evolutionary Computation.

[15]  Xiaodong Li,et al.  Efficient differential evolution using speciation for multimodal function optimization , 2005, GECCO '05.

[16]  Ponnuthurai N. Suganthan,et al.  Differential Evolution Algorithm with Ensemble of Parameters and Mutation and Crossover Strategies , 2010, SEMCCO.

[17]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[18]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[19]  P. N. Suganthan,et al.  Ensemble of niching algorithms , 2010, Inf. Sci..

[20]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[21]  Ponnuthurai N. Suganthan,et al.  Current position-based Fitness Euclidean-distance Ratio Particle Swarm Optimizer for multi-modal optimization , 2010, 2010 Second World Congress on Nature and Biologically Inspired Computing (NaBIC).

[22]  Xiaodong Li,et al.  This article has been accepted for inclusion in a future issue. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 Locating and Tracking Multiple Dynamic Optima by a Particle Swarm Model Using Speciation , 2022 .

[23]  Hussein A. Abbass,et al.  Multiobjective optimization for dynamic environments , 2005, 2005 IEEE Congress on Evolutionary Computation.

[24]  Ponnuthurai N. Suganthan,et al.  Ensemble Differential Evolution with dynamic subpopulations and adaptive clearing for solving dynamic optimization problems , 2012, 2012 IEEE Congress on Evolutionary Computation.

[25]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[26]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[27]  Jing J. Liang,et al.  Ensemble of Clearing Differential Evolution for Multi-modal Optimization , 2012, ICSI.

[28]  Xiaodong Li,et al.  Particle swarm with speciation and adaptation in a dynamic environment , 2006, GECCO.

[29]  Zbigniew Michalewicz,et al.  Parameter Control in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[30]  Kalyanmoy Deb,et al.  Comparison of multi-modal optimization algorithms based on evolutionary algorithms , 2006, GECCO.

[31]  Changhe Li,et al.  A Clustering Particle Swarm Optimizer for Locating and Tracking Multiple Optima in Dynamic Environments , 2010, IEEE Transactions on Evolutionary Computation.

[32]  Anyong Qing Differential Evolution: Fundamentals and Applications in Electrical Engineering , 2009 .

[33]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[34]  Samir W. Mahfoud Niching methods for genetic algorithms , 1996 .

[35]  René Thomsen,et al.  Multimodal optimization using crowding-based differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).