Differential Evolution With Neighborhood Mutation for Multimodal Optimization

In this paper, a neighborhood mutation strategy is proposed and integrated with various niching differential evolution (DE) algorithms to solve multimodal optimization problems. Although variants of DE are highly effective in locating a single global optimum, no DE variant performs competitively when solving multi-optima problems. In the proposed neighborhood based differential evolution, the mutation is performed within each Euclidean neighborhood. The neighborhood mutation is able to maintain the multiple optima found during the evolution and evolve toward the respective global/local optimum. To test the performance of the proposed neighborhood mutation DE, a total of 29 problem instances are used. The proposed algorithms are compared with a number of state-of-the-art multimodal optimization approaches and the experimental results suggest that although the idea of neighborhood mutation is simple, it is able to provide better and more consistent performance over the state-of-the-art multimodal algorithms. In addition, a comparative survey on niching algorithms and their applications are also presented.

[1]  H. Zhong-xi,et al.  Multi-objective Optimization with Modified Pareto Differential Evolution , 2008, 2008 International Conference on Intelligent Computation Technology and Automation (ICICTA).

[2]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[3]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[4]  Tomoyuki Hiroyasu,et al.  Distributed genetic algorithms with a new sharing approach in multiobjective optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[5]  Xiaodong Li,et al.  A particle swarm model for tracking multiple peaks in a dynamic environment using speciation , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[6]  René Thomsen,et al.  Multimodal optimization using crowding-based differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[7]  Amit Konar,et al.  Differential Evolution with Local Neighborhood , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[8]  Mohand Boughanem,et al.  A Study on Using Genetic Niching for Query Optimisation in Document Retrieval , 2002, ECIR.

[9]  Hussein A. Abbass,et al.  Multiobjective optimization for dynamic environments , 2005, 2005 IEEE Congress on Evolutionary Computation.

[10]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[11]  A. Pétrowski An Efficient Hierarchical Clustering Technique for Speciation , 2007 .

[12]  Ferrante Neri,et al.  A fast evolutionary-deterministic algorithm to study multimodal current fields under safety level , 2006 .

[13]  Inmaculada García,et al.  Solving the Multiple Competitive Facilities Location and Design Problem on the Plane , 2009, Evolutionary Computation.

[14]  Brian D. Rigling,et al.  Exploitation of Sub-populations in Evolution Strategies for Improved Numerical Optimization , 1999 .

[15]  Ting-Yu Chen,et al.  A multiobjective optimization solver using rank-niche evolution strategy , 2006, Adv. Eng. Softw..

[16]  Ville Tirronen,et al.  Scale factor inheritance mechanism in distributed differential evolution , 2009, Soft Comput..

[17]  Olfa Nasraoui,et al.  Unsupervised Niche Clustering: Discovering an Unknown Number of Clusters in Noisy Data Sets , 2005 .

[18]  Ralph R. Martin,et al.  A Sequential Niche Technique for Multimodal Function Optimization , 1993, Evolutionary Computation.

[19]  Bruno Sareni,et al.  Fitness sharing and niching methods revisited , 1998, IEEE Trans. Evol. Comput..

[20]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[21]  Xiaodong Yin,et al.  A Fast Genetic Algorithm with Sharing Scheme Using Cluster Analysis Methods in Multimodal Function Optimization , 1993 .

[22]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[23]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[24]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[25]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[26]  Ponnuthurai N. Suganthan,et al.  Evolutionary programming with ensemble of explicit memories for dynamic optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[27]  Ponnuthurai N. Suganthan,et al.  Real-parameter evolutionary multimodal optimization - A survey of the state-of-the-art , 2011, Swarm Evol. Comput..

[28]  Lino A. Costa,et al.  An Adaptive Sharing Elitist Evolution Strategy for Multiobjective Optimization , 2003, Evolutionary Computation.

[29]  Weiguo Sheng,et al.  Clustering with Niching Genetic K-means Algorithm , 2004, GECCO.

[30]  Xiaodong Li,et al.  Efficient differential evolution using speciation for multimodal function optimization , 2005, GECCO '05.

[31]  Zachary V. Hendershot A Differential Evolution Algorithm for Automatically Discovering Multiple Global Optima in Multidimensional, Discontinuous Spaces , 2004, MAICS.

[32]  Kenneth V. Price,et al.  An introduction to differential evolution , 1999 .

[33]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[34]  Dumitru Dumitrescu,et al.  Nash equilibria detection for multi-player games , 2010, IEEE Congress on Evolutionary Computation.

[35]  Pavlos S. Georgilakis,et al.  Market-based transmission expansion planning by improved differential evolution , 2010 .

[36]  Jie Yao,et al.  A multi-population genetic algorithm for robust and fast ellipse detection , 2005, Pattern Analysis and Applications.

[37]  Ville Tirronen,et al.  Distributed differential evolution with explorative–exploitative population families , 2009, Genetic Programming and Evolvable Machines.

[38]  Kevin Warwick,et al.  A Variable Radius Niching Technique for Speciation in Genetic Algorithms , 2000, GECCO.

[39]  Janez Brest,et al.  Population size reduction for the differential evolution algorithm , 2008, Applied Intelligence.

[40]  Dumitru Dumitrescu,et al.  Evolutionary swarm cooperative optimization in dynamic environments , 2009, Natural Computing.

[41]  Dimitris K. Tasoulis,et al.  Parallel differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[42]  Ponnuthurai N. Suganthan,et al.  Novel multimodal problems and differential evolution with ensemble of restricted tournament selection , 2010, IEEE Congress on Evolutionary Computation.

[43]  Jani Rönkkönen ContinuousMultimodal Global Optimization with Differential Evolution-Based Methods , 2009 .

[44]  Dumitru Dumitrescu,et al.  Multimodal Optimization by Means of a Topological Species Conservation Algorithm , 2010, IEEE Transactions on Evolutionary Computation.

[45]  Daniela Zaharie A MULTIPOPULATION DIFFERENTIAL EVOLUTION ALGORITHM FOR MULTIMODAL OPTIMIZATION , 2004 .

[46]  Qing Ling,et al.  Robust Optimal Design Under Standard Crowding Differential Evolution Framework , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[47]  P. Whigham,et al.  Spatially-Structured Sharing Technique for Multimodal Problems , 2008, Journal of Computer Science and Technology.

[48]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[49]  Claudio De Stefano,et al.  Where Are the Niches? Dynamic Fitness Sharing , 2007, IEEE Transactions on Evolutionary Computation.

[50]  Junjie Yang,et al.  Adaptive Niche Multi-objective Particle Swarm Optimization Algorithm , 2008, 2008 Fourth International Conference on Natural Computation.

[51]  DebK.,et al.  A fast and elitist multiobjective genetic algorithm , 2002 .

[52]  Xiaodong Li,et al.  A Non-dominated Sorting Particle Swarm Optimizer for Multiobjective Optimization , 2003, GECCO.

[53]  Weiguo Sheng,et al.  A weighted sum validity function for clustering with a hybrid niching genetic algorithm , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[54]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[55]  Xiaodong Li,et al.  Niching Without Niching Parameters: Particle Swarm Optimization Using a Ring Topology , 2010, IEEE Transactions on Evolutionary Computation.

[56]  Yan Li,et al.  Using Niche Genetic Algorithm to Find Fuzzy Rules , 2009 .

[57]  Samir W. Mahfoud Niching methods for genetic algorithms , 1996 .

[58]  Daniela Zaharie Density based clustering with crowding differential evolution , 2005, Seventh International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC'05).

[59]  Francisco Herrera,et al.  Finding multiple solutions in job shop scheduling by niching genetic algorithms , 2003, J. Intell. Manuf..

[60]  Xiaodong Li,et al.  Erratum to "Niching Without Niching Parameters: Particle Swarm Optimization Using a Ring Topology" [Feb 10 150-169] , 2010, IEEE Trans. Evol. Comput..

[61]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[62]  Xiaodong Li,et al.  Particle swarm with speciation and adaptation in a dynamic environment , 2006, GECCO.

[63]  Kalyanmoy Deb,et al.  Comparison of multi-modal optimization algorithms based on evolutionary algorithms , 2006, GECCO.

[64]  P. John Clarkson,et al.  A Species Conserving Genetic Algorithm for Multimodal Function Optimization , 2002, Evolutionary Computation.

[65]  Dimitris K. Tasoulis,et al.  Enhancing Differential Evolution Utilizing Proximity-Based Mutation Operators , 2011, IEEE Transactions on Evolutionary Computation.

[66]  Samir W. Mahfoud A Comparison of Parallel and Sequential Niching Methods , 1995, ICGA.

[67]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[68]  Ofer M. Shir,et al.  Niche Radius Adaptation in the CMA-ES Niching Algorithm , 2006, PPSN.

[69]  Weiguo Sheng,et al.  A Niching Memetic Algorithm for Simultaneous Clustering and Feature Selection , 2008, IEEE Transactions on Knowledge and Data Engineering.

[70]  Ponnuthurai N. Suganthan,et al.  Multi-objective evolutionary algorithms based on the summation of normalized objectives and diversified selection , 2010, Inf. Sci..

[71]  Dumitru Dumitrescu,et al.  Disburdening the species conservation evolutionary algorithm of arguing with radii , 2007, GECCO '07.

[72]  Ofer M. Shir,et al.  Adaptive Niche Radii and Niche Shapes Approaches for Niching with the CMA-ES , 2010, Evolutionary Computation.

[73]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[74]  Kuo-Chin Fan,et al.  Applying genetic algorithms on pattern recognition: an analysis and survey , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[75]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[76]  Ling Qing,et al.  Restricted evolution based multimodal function optimization in holographic grating design , 2005, 2005 IEEE Congress on Evolutionary Computation.

[77]  P. N. Suganthan,et al.  Ensemble of niching algorithms , 2010, Inf. Sci..

[78]  Javier E. Vitela,et al.  A real-coded niching memetic algorithm for continuous multimodal function optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[79]  Frank W. Moore,et al.  Automatic selection of sub-populations and minimal spanning distances for improved numerical optimization , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[80]  David H. Ackley,et al.  An empirical study of bit vector function optimization , 1987 .

[81]  Dumitru Dumitrescu,et al.  A collaborative model for tracking optima in dynamic environments , 2007, 2007 IEEE Congress on Evolutionary Computation.

[82]  David E. Goldberg,et al.  Probabilistic Crowding: Deterministic Crowding with Probabilistic Replacement , 1999 .

[83]  E. Dilettoso,et al.  A self-adaptive niching genetic algorithm for multimodal optimization of electromagnetic devices , 2006, IEEE Transactions on Magnetics.

[84]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.