Inducing Niching Behavior in Differential Evolution Through Local Information Sharing

In practical situations, it is very often desirable to detect multiple optimally sustainable solutions of an optimization problem. The population-based evolutionary multimodal optimization algorithms can be very helpful in such cases. They detect and maintain multiple optimal solutions during the run by incorporating specialized niching operations to aid the parallel localized convergence of population members around different basins of attraction. This paper presents an improved information-sharing mechanism among the individuals of an evolutionary algorithm for inducing efficient niching behavior. The mechanism can be integrated with stochastic real-parameter optimizers relying on differential perturbation of the individuals (candidate solutions) based on the population distribution. Various real-coded genetic algorithms (GAs), particle swarm optimization (PSO), and differential evolution (DE) fit the example of such algorithms. The main problem arising from differential perturbation is the unequal attraction toward the different basins of attraction that is detrimental to the objective of parallel convergence to multiple basins of attraction. We present our study through DE algorithm owing to its highly random nature of mutation and show how population diversity is preserved by modifying the basic perturbation (mutation) scheme through the use of random individuals selected probabilistically. By integrating the proposed technique with DE framework, we present three improved versions of well-known DE-based niching methods. Through an extensive experimental analysis, a statistically significant improvement in the overall performance has been observed upon integrating of our technique with the DE-based niching methods.

[1]  Ofer M. Shir,et al.  Adaptive Niche Radii and Niche Shapes Approaches for Niching with the CMA-ES , 2010, Evolutionary Computation.

[2]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[3]  Dumitru Dumitrescu,et al.  Nash equilibria detection for multi-player games , 2010, IEEE Congress on Evolutionary Computation.

[4]  Jing J. Liang,et al.  Differential Evolution With Neighborhood Mutation for Multimodal Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[5]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[6]  Zachary V. Hendershot A Differential Evolution Algorithm for Automatically Discovering Multiple Global Optima in Multidimensional, Discontinuous Spaces , 2004, MAICS.

[7]  Weiguo Sheng,et al.  A weighted sum validity function for clustering with a hybrid niching genetic algorithm , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  D. J. Cavicchio,et al.  Adaptive search using simulated evolution , 1970 .

[9]  Enrique Alba,et al.  Parallelism and evolutionary algorithms , 2002, IEEE Trans. Evol. Comput..

[10]  Samir W. Mahfoud A Comparison of Parallel and Sequential Niching Methods , 1995, ICGA.

[11]  René Thomsen,et al.  Multimodal optimization using crowding-based differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[12]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[13]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[14]  Xiaodong Li,et al.  Erratum to "Niching Without Niching Parameters: Particle Swarm Optimization Using a Ring Topology" [Feb 10 150-169] , 2010, IEEE Trans. Evol. Comput..

[15]  Ponnuthurai N. Suganthan,et al.  Novel multimodal problems and differential evolution with ensemble of restricted tournament selection , 2010, IEEE Congress on Evolutionary Computation.

[16]  Xiaodong Li,et al.  Efficient differential evolution using speciation for multimodal function optimization , 2005, GECCO '05.

[17]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[18]  Kwong-Sak Leung,et al.  Protein structure prediction on a lattice model via multimodal optimization techniques , 2010, GECCO '10.

[19]  Ponnuthurai N. Suganthan,et al.  Real-parameter evolutionary multimodal optimization - A survey of the state-of-the-art , 2011, Swarm Evol. Comput..

[20]  M. Preuss NICHING PROSPECTS , 2006 .

[21]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[22]  Mohand Boughanem,et al.  A Study on Using Genetic Niching for Query Optimisation in Document Retrieval , 2002, ECIR.

[23]  Aravind Srinivasan,et al.  Innovization: innovating design principles through optimization , 2006, GECCO.

[24]  A. Pétrowski An Efficient Hierarchical Clustering Technique for Speciation , 2007 .

[25]  R. Storn,et al.  Differential evolution a simple and efficient adaptive scheme for global optimization over continu , 1997 .

[26]  Francisco Herrera,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power , 2010, Inf. Sci..

[27]  Ting-Yu Chen,et al.  A multiobjective optimization solver using rank-niche evolution strategy , 2006, Adv. Eng. Softw..

[28]  Ling Qing,et al.  Restricted evolution based multimodal function optimization in holographic grating design , 2005, 2005 IEEE Congress on Evolutionary Computation.

[29]  Pascal Bouvry,et al.  Improving Classical and Decentralized Differential Evolution With New Mutation Operator and Population Topologies , 2011, IEEE Transactions on Evolutionary Computation.

[30]  Kay Chen Tan,et al.  Multimodal Optimization Using a Biobjective Differential Evolution Algorithm Enhanced With Mean Distance-Based Selection , 2013, IEEE Transactions on Evolutionary Computation.

[31]  Ponnuthurai N. Suganthan,et al.  Crowding-based local differential evolution with speciation-based memory archive for dynamic multimodal optimization , 2013, GECCO '13.

[32]  Dimitris K. Tasoulis,et al.  Parallel differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[33]  O. M. Shir Niching in derandomized evolution strategies and its applications in quantum control , 2008 .

[34]  Xiaodong Yin,et al.  A Fast Genetic Algorithm with Sharing Scheme Using Cluster Analysis Methods in Multimodal Function Optimization , 1993 .

[35]  E. Dilettoso,et al.  A self-adaptive niching genetic algorithm for multimodal optimization of electromagnetic devices , 2006, IEEE Transactions on Magnetics.

[36]  Ville Tirronen,et al.  A study on scale factor in distributed differential evolution , 2011, Inf. Sci..

[37]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[38]  Dong-Kyun Woo,et al.  A Novel Multimodal Optimization Algorithm Applied to Electromagnetic Optimization , 2011, IEEE Transactions on Magnetics.

[39]  Ofer M. Shir,et al.  Niche Radius Adaptation in the CMA-ES Niching Algorithm , 2006, PPSN.

[40]  Claudio De Stefano,et al.  Where Are the Niches? Dynamic Fitness Sharing , 2007, IEEE Transactions on Evolutionary Computation.

[41]  Enrique Alba,et al.  A Study of Canonical GAs for NSOPs , 2007, Metaheuristics.

[42]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[43]  P. John Clarkson,et al.  A Species Conserving Genetic Algorithm for Multimodal Function Optimization , 2002, Evolutionary Computation.

[44]  Dimitris K. Tasoulis,et al.  Enhancing Differential Evolution Utilizing Proximity-Based Mutation Operators , 2011, IEEE Transactions on Evolutionary Computation.

[45]  David Naso,et al.  Compact Differential Evolution , 2011, IEEE Transactions on Evolutionary Computation.

[46]  Daniela Zaharie A MULTIPOPULATION DIFFERENTIAL EVOLUTION ALGORITHM FOR MULTIMODAL OPTIMIZATION , 2004 .

[47]  Janez Brest,et al.  Population size reduction for the differential evolution algorithm , 2008, Applied Intelligence.

[48]  Inmaculada García,et al.  Solving the Multiple Competitive Facilities Location and Design Problem on the Plane , 2009, Evolutionary Computation.

[49]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[50]  K. Koper,et al.  Multimodal function optimization with a niching genetic algorithm: A seismological example , 1999, Bulletin of the Seismological Society of America.

[51]  Ville Tirronen,et al.  Scale factor inheritance mechanism in distributed differential evolution , 2009, Soft Comput..

[52]  Xiaodong Li,et al.  A multimodal particle swarm optimizer based on fitness Euclidean-distance ratio , 2007, GECCO '07.

[53]  David E. Goldberg,et al.  Probabilistic Crowding: Deterministic Crowding with Probabilistic Replacement , 1999 .

[54]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[55]  Enrique Alba,et al.  Cellular genetic algorithms , 2014, GECCO.

[56]  Xiaodong Li,et al.  Niching Without Niching Parameters: Particle Swarm Optimization Using a Ring Topology , 2010, IEEE Transactions on Evolutionary Computation.

[57]  Yan Li,et al.  Using Niche Genetic Algorithm to Find Fuzzy Rules , 2009 .

[58]  Daniela Zaharie,et al.  Influence of crossover on the behavior of Differential Evolution Algorithms , 2009, Appl. Soft Comput..

[59]  Samir W. Mahfoud Niching methods for genetic algorithms , 1996 .