A Novel Class of Test Problems for Performance Evaluation of Niching Methods

This paper proposes a novel procedure for generating parametric scalable functions with diverse properties to strengthen numerical evaluation of niching methods. It combines three simple basic functions to form a composite multimodal function, in which the function parameter controls the number of global minima. The resultant composite function may show a variety of challenges in global optimization such as high condition, correlation, and presence of many undesirable local minima, as well as those peculiar to multimodal optimization, such as nonuniformly distributed global minima with dissimilar basin sizes. Moreover, the proposed procedure results in computationally inexpensive composite functions, when compared to those generated by available methods. This allows for benchmarking long-term success of niching methods on problems with many global minima. Six parametric benchmark functions are proposed in which the function parameter controls the number of global minima. Detailed analysis on distribution, basin shapes and sizes of the global minima is provided. One of the proposed test problems involve constraints, a matter which did not receive much attention in the past. These test functions are employed to compare some of the most successful niching methods in the literature. The numerical results disclose a drastic disparity between the performance of different niching methods on the composite functions and the existing test problems, demonstrating that the proposed composite functions simulate distinct challenges. Our findings highlight importance of the core search algorithm and challenge suitability of many niching strategies in more complicated landscapes and higher dimensions.

[1]  Hans-Georg Beyer,et al.  The Dynamics of Cumulative Step Size Adaptation on the Ellipsoid Model , 2016, Evolutionary Computation.

[2]  L. Darrell Whitley,et al.  Evaluating Evolutionary Algorithms , 1996, Artif. Intell..

[3]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[4]  Sanyang Liu,et al.  A Cluster-Based Differential Evolution With Self-Adaptive Strategy for Multimodal Optimization , 2014, IEEE Transactions on Cybernetics.

[5]  Oliver Kramer,et al.  Finite life span for improving the selection scheme in evolution strategies , 2017, Soft Comput..

[6]  Ponnuthurai N. Suganthan,et al.  Real-parameter evolutionary multimodal optimization - A survey of the state-of-the-art , 2011, Swarm Evol. Comput..

[7]  Jonathan E. Fieldsend,et al.  Running Up Those Hills: Multi-modal search with the niching migratory multi-swarm optimiser , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[8]  Jing J. Liang,et al.  Novel composition test functions for numerical global optimization , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[9]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[10]  Anne Auger,et al.  Comparing results of 31 algorithms from the black-box optimization benchmarking BBOB-2009 , 2010, GECCO '10.

[11]  Ponnuthurai N. Suganthan,et al.  Novel multimodal problems and differential evolution with ensemble of restricted tournament selection , 2010, IEEE Congress on Evolutionary Computation.

[12]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[13]  Yaroslav D. Sergeyev,et al.  Algorithm 829: Software for generation of classes of test functions with known local and global minima for global optimization , 2003, TOMS.

[14]  Richard A. Watson,et al.  Reducing Local Optima in Single-Objective Problems by Multi-objectivization , 2001, EMO.

[15]  Jie Yao,et al.  Bi-Objective Multipopulation Genetic Algorithm for Multimodal Function Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[16]  Ali Ahrari,et al.  On the utility of randomly generated functions for performance evaluation of evolutionary algorithms , 2010, Optim. Lett..

[17]  Ponnuthurai N. Suganthan,et al.  A Distance-Based Locally Informed Particle Swarm Model for Multimodal Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[18]  Ke Tang,et al.  History-Based Topological Speciation for Multimodal Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[19]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[20]  Dumitru Dumitrescu,et al.  Multimodal Optimization by Means of a Topological Species Conservation Algorithm , 2010, IEEE Transactions on Evolutionary Computation.

[21]  Mahdi Yaghoobi,et al.  A new method in multimodal optimization based on firefly algorithm , 2016, Artificial Intelligence Review.

[22]  Mike Preuss,et al.  Improved Topological Niching for Real-Valued Global Optimization , 2012, EvoApplications.

[23]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[24]  Dirk V. Arnold,et al.  Comparison of Constraint-Handling Mechanisms for the (1,λ)-ES on a Simple Constrained Problem , 2016, Evolutionary Computation.

[25]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[26]  Kalyanmoy Deb,et al.  Multimodal Optimization by Covariance Matrix Self-Adaptation Evolution Strategy with Repelling Subpopulations , 2017, Evolutionary Computation.

[27]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[28]  Jing J. Liang,et al.  Differential Evolution With Neighborhood Mutation for Multimodal Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[29]  Caitlin Mueller,et al.  From analysis to design : A new computational strategy for structural creativity , 2013 .

[30]  Masahito Yamamoto,et al.  Attraction basin sphere estimation approach for niching CMA-ES , 2017, Soft Comput..

[31]  Ofer M. Shir,et al.  Adaptive Niche Radii and Niche Shapes Approaches for Niching with the CMA-ES , 2010, Evolutionary Computation.

[32]  Xiaodong Li,et al.  Benchmark Functions for CEC'2013 Special Session and Competition on Niching Methods for Multimodal Function Optimization' , 2013 .

[33]  Swagatam Das,et al.  An Improved Parent-Centric Mutation With Normalized Neighborhoods for Inducing Niching Behavior in Differential Evolution , 2014, IEEE Transactions on Cybernetics.

[34]  Xiaodong Li,et al.  A framework for generating tunable test functions for multimodal optimization , 2011, Soft Comput..

[35]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[36]  Kalyanmoy Deb,et al.  Multimodal Optimization Using a Bi-Objective Evolutionary Algorithm , 2012, Evolutionary Computation.

[37]  Zelda B. Zabinsky,et al.  A Numerical Evaluation of Several Stochastic Algorithms on Selected Continuous Global Optimization Test Problems , 2005, J. Glob. Optim..

[38]  R. Salomon Re-evaluating genetic algorithm performance under coordinate rotation of benchmark functions. A survey of some theoretical and practical aspects of genetic algorithms. , 1996, Bio Systems.

[39]  Mike Preuss,et al.  Niching the CMA-ES via nearest-better clustering , 2010, GECCO '10.

[40]  Marcus Gallagher,et al.  A general-purpose tunable landscape generator , 2006, IEEE Transactions on Evolutionary Computation.

[41]  Swagatam Das,et al.  Inducing Niching Behavior in Differential Evolution Through Local Information Sharing , 2015, IEEE Transactions on Evolutionary Computation.

[42]  Xin-She Yang,et al.  A literature survey of benchmark functions for global optimisation problems , 2013, Int. J. Math. Model. Numer. Optimisation.

[43]  Jing J. Liang,et al.  Novel benchmark functions for continuous multimodal optimization with comparative results , 2016, Swarm Evol. Comput..

[44]  Kay Chen Tan,et al.  Multimodal Optimization Using a Biobjective Differential Evolution Algorithm Enhanced With Mean Distance-Based Selection , 2013, IEEE Transactions on Evolutionary Computation.

[45]  Ralph R. Martin,et al.  A Sequential Niche Technique for Multimodal Function Optimization , 1993, Evolutionary Computation.

[46]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[47]  Kalyanmoy Deb,et al.  A parameterless-niching-assisted bi-objective approach to multimodal optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[48]  Kalyanmoy Deb,et al.  Comparison of multi-modal optimization algorithms based on evolutionary algorithms , 2006, GECCO.

[49]  Anne Auger,et al.  Real-Parameter Black-Box Optimization Benchmarking 2009: Noiseless Functions Definitions , 2009 .

[50]  Xiaodong Li,et al.  Niching Without Niching Parameters: Particle Swarm Optimization Using a Ring Topology , 2010, IEEE Transactions on Evolutionary Computation.

[51]  Anne Auger,et al.  Impacts of invariance in search: When CMA-ES and PSO face ill-conditioned and non-separable problems , 2011, Appl. Soft Comput..

[52]  Samir W. Mahfoud Niching methods for genetic algorithms , 1996 .