Enhancing clearing-based niching method using Delaunay Triangulation

The interest in multi-modal optimization methods is increasing in the recent years since many of real-world optimization problems have multiple/many optima and decision makers prefer to find all of them. Multiple global/local peaks create difficulties for optimization algorithms. In this context, niching is well-known and widely used technique for finding multiple solutions in multi-modal optimization. One commonly used niching technique in evolutionary algorithms is the Clearing method. However, canonical clearing scheme reduces the exploration capacity of the evolutionary algorithms. In this paper, Delaunay Triangulation based Clearing (DT-Clearing) procedure is proposed to handle multi-modal optimizations more efficiently while preserving simplicity of canonical clearing approach. In DT-Clearing, cleared individuals are reallocated in the biggest empty spaces formed within the search space which are determined through Delaunay Triangulation. The reallocation of cleared individuals discourages wasting of the resources and allows better exploration of the landscape. The algorithm also uses an external memory, an archive of the explored niches, thus preventing the redundant visiting of the individuals, henceforth finding more solutions in lesser number of generations. The method is tested using multi-modal benchmark problems proposed for the IEEE CEC 2013, Special Session on Niching Methods for Multimodal Optimization. Our method obtains promising results in comparison with the canonical clearing and demonstrates to be a competitive niching algorithm.

[1]  Grant Dick,et al.  Weighted local sharing and local clearing for multimodal optimisation , 2010, Soft Comput..

[2]  Abdelaziz Bouroumi,et al.  A fuzzy clustering-based niching approach to multimodal function optimization , 2000, Cognitive Systems Research.

[3]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[4]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[5]  Marc Parizeau,et al.  DEAP: evolutionary algorithms made easy , 2012, J. Mach. Learn. Res..

[6]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[7]  K. Warwick,et al.  Dynamic Niche Clustering: a fuzzy variable radius niching technique for multimodal optimisation in GAs , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[8]  Bruno Sareni,et al.  Fitness sharing and niching methods revisited , 1998, IEEE Trans. Evol. Comput..

[9]  Xiaodong Yin,et al.  A Fast Genetic Algorithm with Sharing Scheme Using Cluster Analysis Methods in Multimodal Function Optimization , 1993 .

[10]  Yew-Soon Ong,et al.  Valley-Adaptive Clearing Scheme for Multimodal Optimization Evolutionary Search , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[11]  Marc Parizeau,et al.  Once you SCOOP, no need to fork , 2014, XSEDE '14.

[12]  M. N. Vrahatis,et al.  Objective function “stretching” to alleviate convergence to local minima , 2001 .

[13]  Ofer M. Shir,et al.  Niche Radius Adaptation in the CMA-ES Niching Algorithm , 2006, PPSN.

[14]  Xin Yao,et al.  Speciation as automatic categorical modularization , 1997, IEEE Trans. Evol. Comput..

[15]  Magda B. Fayek,et al.  Context based clearing procedure: A niching method for genetic algorithms , 2010 .

[16]  Xiaodong Li,et al.  Benchmark Functions for CEC'2013 Special Session and Competition on Niching Methods for Multimodal Function Optimization' , 2013 .

[17]  Gholamhossein Dastghaibyfard,et al.  A faster circle-sweep Delaunay triangulation algorithm , 2012, Adv. Eng. Softw..

[18]  Mike Preuss,et al.  Niching the CMA-ES via nearest-better clustering , 2010, GECCO '10.

[19]  Jing J. Liang,et al.  Niching particle swarm optimization with local search for multi-modal optimization , 2012, Inf. Sci..

[20]  Xuewen Xia,et al.  A Local Search Particle Swarm Optimization with Dual Species Conservation for Multimodal Optimization , 2012, ICICA.

[21]  David E. Goldberg,et al.  Probabilistic Crowding: Deterministic Crowding with Probabilistic Replacement , 1999 .

[22]  Xiaodong Li,et al.  A dynamic archive niching differential evolution algorithm for multimodal optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[23]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[24]  Samir W. Mahfoud Niching methods for genetic algorithms , 1996 .

[25]  D. J. Cavicchio,et al.  Adaptive search using simulated evolution , 1970 .

[26]  Kalyanmoy Deb,et al.  Comparison of multi-modal optimization algorithms based on evolutionary algorithms , 2006, GECCO.

[27]  Mauro Roisenberg,et al.  A topological niching covariance matrix adaptation for multimodal optimization , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[28]  Xiaodong Li,et al.  Seeking Multiple Solutions: An Updated Survey on Niching Methods and Their Applications , 2017, IEEE Transactions on Evolutionary Computation.

[29]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[30]  Claudio De Stefano,et al.  Where Are the Niches? Dynamic Fitness Sharing , 2007, IEEE Transactions on Evolutionary Computation.