Real-parameter evolutionary multimodal optimization - A survey of the state-of-the-art

Abstract Multimodal optimization amounts to finding multiple global and local optima (as opposed to a single solution) of a function, so that the user can have a better knowledge about different optimal solutions in the search space and as and when needed, the current solution may be switched to another suitable one while still maintaining the optimal system performance. Evolutionary Algorithms (EAs), due to their population-based approaches, are able to detect multiple solutions within a population in a single simulation run and have a clear advantage over the classical optimization techniques, which need multiple restarts and multiple runs in the hope that a different solution may be discovered every run, with no guarantee however. Numerous evolutionary optimization techniques have been developed since late 1970s for locating multiple optima (global or local). These techniques are commonly referred to as “niching” methods. Niching can be incorporated into a standard EA to promote and maintain formation of multiple stable subpopulations within a single population, with an aim to locate multiple globally optimal or suboptimal solutions simultaneously. This article is the first of its kind to present a comprehensive review of the basic concepts related to real-parameter evolutionary multimodal optimization, a survey of the major niching techniques, a detailed account of the adaptation of EAs from diverse paradigms to tackle multimodal problems, benchmark problems and performance measures.

[1]  Xiaodong Li,et al.  Adaptively Choosing Neighbourhood Bests Using Species in a Particle Swarm Optimizer for Multimodal Function Optimization , 2004, GECCO.

[2]  Carlos A. Coello Coello,et al.  An updated survey of GA-based multiobjective optimization techniques , 2000, CSUR.

[3]  Ponnuthurai N. Suganthan,et al.  Novel multimodal problems and differential evolution with ensemble of restricted tournament selection , 2010, IEEE Congress on Evolutionary Computation.

[4]  William M. Spears,et al.  Simple Subpopulation Schemes , 1998 .

[5]  Ling Qing,et al.  Crowding clustering genetic algorithm for multimodal function optimization , 2006 .

[6]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[7]  Kwong-Sak Leung,et al.  Protein structure prediction on a lattice model via multimodal optimization techniques , 2010, GECCO '10.

[8]  Jani Rönkkönen ContinuousMultimodal Global Optimization with Differential Evolution-Based Methods , 2009 .

[9]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[10]  Dumitru Dumitrescu,et al.  Multimodal Optimization by Means of a Topological Species Conservation Algorithm , 2010, IEEE Transactions on Evolutionary Computation.

[11]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[12]  Andreas Zell,et al.  A Clustering Based Niching Method for Evolutionary Algorithms , 2003, GECCO.

[13]  Ofer M. Shir,et al.  Adaptive Niche Radii and Niche Shapes Approaches for Niching with the CMA-ES , 2010, Evolutionary Computation.

[14]  Xiaodong Li,et al.  Developing Niching Algorithms in Particle Swarm Optimization , 2011 .

[15]  Ponnuthurai N. Suganthan,et al.  Dynamic Grouping Crowding Differential Evolution with Ensemble of Parameters for Multi-modal Optimization , 2010, SEMCCO.

[16]  Carlos A. Coello Coello,et al.  Test Function Generators for Assessing the Performance of PSO Algorithms in Multimodal Optimization , 2011 .

[17]  Daniel Angus,et al.  Niching ant colony optimisation , 2008 .

[18]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[19]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[20]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[21]  Lei Wang,et al.  Predication based immune network for multimodal function optimization , 2010, Eng. Appl. Artif. Intell..

[22]  Michael J. Shaw,et al.  Genetic algorithms with dynamic niche sharing for multimodal function optimization , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[23]  Shigenobu Kobayashi,et al.  Adaptive isolation model using data clustering for multimodal function optimization , 2005, GECCO '05.

[24]  Kalyanmoy Deb,et al.  Multimodal Optimization Using a Bi-Objective Evolutionary Algorithm , 2012, Evolutionary Computation.

[25]  Ofer M. Shir,et al.  Dynamic niching in evolution strategies with covariance matrix adaptation , 2005, 2005 IEEE Congress on Evolutionary Computation.

[26]  Ofer M. Shir,et al.  Performance analysis of niching algorithms based on derandomized-ES variants , 2007, GECCO '07.

[27]  Andries Petrus Engelbrecht,et al.  Enhancing the NichePSO , 2007, 2007 IEEE Congress on Evolutionary Computation.

[28]  Hyun-Kyo Jung,et al.  Niching genetic algorithm with restricted competition selection for multimodal function optimization , 1999 .

[29]  Michael N. Vrahatis,et al.  Modification of the Particle Swarm Optimizer for Locating All the Global Minima , 2001 .

[30]  Ender Özcan,et al.  Particle Swarms for Multimodal Optimization , 2007, ICANNGA.

[31]  Xiaodong Li,et al.  A multimodal particle swarm optimizer based on fitness Euclidean-distance ratio , 2007, GECCO '07.

[32]  Jie Yao,et al.  Bi-Objective Multipopulation Genetic Algorithm for Multimodal Function Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[33]  David E. Goldberg,et al.  Probabilistic Crowding: Deterministic Crowding with Probabilistic Replacement , 1999 .

[34]  Patrick Siarry,et al.  A multipopulation genetic algorithm aimed at multimodal optimization , 2002 .

[35]  René Thomsen,et al.  Multimodal optimization using crowding-based differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[36]  Xiaodong Li,et al.  Adaptively choosing niching parameters in a PSO , 2006, GECCO.

[37]  G. Di Caro,et al.  Ant colony optimization: a new meta-heuristic , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[38]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[39]  Xiaodong Li,et al.  Efficient differential evolution using speciation for multimodal function optimization , 2005, GECCO '05.

[40]  Ian C. Parmee,et al.  Adaptive Restricted Tournament Selection for the Identification of Multiple Sub-Optima in a Multi-Modal Function , 1996, Evolutionary Computing, AISB Workshop.

[41]  Salman Mohagheghi,et al.  Particle Swarm Optimization: Basic Concepts, Variants and Applications in Power Systems , 2008, IEEE Transactions on Evolutionary Computation.

[42]  Rajeev Kumar,et al.  Effective Evolutionary Multimodal Optimization by Multiobjective Reformulation Without Explicit Niching/Sharing , 2004, AACC.

[43]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[44]  Chao-Yang Pang,et al.  Applying ant colony optimization to search all extreme points of function , 2010, ICIEA 2010.

[45]  Javier E. Vitela,et al.  A real-coded niching memetic algorithm for continuous multimodal function optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[46]  Jianjun Hu,et al.  Robust and Efficient Genetic Algorithms with Hierarchical Niching and a Sustainable Evolutionary Computation Model , 2004, GECCO.

[47]  Ofer M. Shir,et al.  Niching in evolution strategies , 2005, GECCO '05.

[48]  Frank W. Moore,et al.  Automatic selection of sub-populations and minimal spanning distances for improved numerical optimization , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[49]  David H. Ackley,et al.  An empirical study of bit vector function optimization , 1987 .

[50]  K. Warwick,et al.  Dynamic Niche Clustering: a fuzzy variable radius niching technique for multimodal optimisation in GAs , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[51]  R. Brits,et al.  Solving systems of unconstrained equations using particle swarm optimization , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[52]  Bruno Sareni,et al.  Fitness sharing and niching methods revisited , 1998, IEEE Trans. Evol. Comput..

[53]  Ofer M. Shir,et al.  Niching with derandomized evolution strategies in artificial and real-world landscapes , 2009, Natural Computing.

[54]  Grant Dick,et al.  The behaviour of genetic drift in a spatially-structured evolutionary algorithm , 2005, 2005 IEEE Congress on Evolutionary Computation.

[55]  Chang-Hwan Im,et al.  Multimodal function optimization based on particle swarm optimization , 2006, IEEE Transactions on Magnetics.

[56]  Chang-Hwan Im,et al.  An Improved Particle Swarm Optimization Algorithm Mimicking Territorial Dispute Between Groups for Multimodal Function Optimization Problems , 2008, IEEE Transactions on Magnetics.

[57]  L.N. de Castro,et al.  An artificial immune network for multimodal function optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[58]  Xiaodong Li,et al.  This article has been accepted for inclusion in a future issue. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 Locating and Tracking Multiple Dynamic Optima by a Particle Swarm Model Using Speciation , 2022 .

[59]  Ralph R. Martin,et al.  A Sequential Niche Technique for Multimodal Function Optimization , 1993, Evolutionary Computation.

[60]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[61]  Carlos A. Coello Coello,et al.  On the use of particle swarm optimization with multimodal functions , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[62]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[63]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[64]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[65]  Shigeyoshi Tsutsui,et al.  Forking Genetic Algorithms: GAs with Search Space Division Schemes , 1997, Evolutionary Computation.

[66]  Francisco Herrera,et al.  Real-Coded Memetic Algorithms with Crossover Hill-Climbing , 2004, Evolutionary Computation.

[67]  E. Dilettoso,et al.  A self-adaptive niching genetic algorithm for multimodal optimization of electromagnetic devices , 2006, IEEE Transactions on Magnetics.

[68]  Michael N. Vrahatis,et al.  On the computation of all global minimizers through particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[69]  Andries Petrus Engelbrecht,et al.  Niching for Dynamic Environments Using Particle Swarm Optimization , 2006, SEAL.

[70]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[71]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[72]  Antonina Starita,et al.  Particle swarm optimization for multimodal functions: a clustering approach , 2008 .

[73]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[74]  Xiaodong Yin,et al.  A Fast Genetic Algorithm with Sharing Scheme Using Cluster Analysis Methods in Multimodal Function Optimization , 1993 .

[75]  Xiaodong Li,et al.  Niching Without Niching Parameters: Particle Swarm Optimization Using a Ring Topology , 2010, IEEE Transactions on Evolutionary Computation.

[76]  Abdelhakim Ameur El Imrani,et al.  Dielectric composite multimodal optimization using a multipopulation cultural algorithm , 2008, Intell. Data Anal..

[77]  Rasmus K. Ursem,et al.  Multinational GAs: Multimodal Optimization Techniques in Dynamic Environments , 2000, GECCO.

[78]  R. K. Ursem Multinational evolutionary algorithms , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[79]  Ernesto Costa,et al.  Niching techniques: a study on the cluster geometry optimization problem , 2007, GECCO '07.

[80]  Ofer M. Shir,et al.  Niche Radius Adaptation in the CMA-ES Niching Algorithm , 2006, PPSN.

[81]  Fa-Chao Li,et al.  A density clustering based niching genetic algorithm for multimodal optimization , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[82]  Kenneth A. De Jong,et al.  On Decentralizing Selection Algorithms , 1995, ICGA.

[83]  Mattias Wahde,et al.  Biologically inspired optimization methods , 2008 .

[84]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[85]  Mohammad Mehdi Ebadzadeh,et al.  DNPSO: A Dynamic Niching Particle Swarm Optimizer for multi-modal optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[86]  Carlos A. Coello Coello,et al.  A Review of Particle Swarm Optimization Methods Used for Multimodal Optimization , 2009, Innovations in Swarm Intelligence.

[87]  Jani Rönkkönen,et al.  Comparing the Uni-Modal Scaling Performance of Global and Local Selection in a Mutation-Only Differential Evolution Algorithm , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[88]  Jing J. Liang,et al.  Differential Evolution With Neighborhood Mutation for Multimodal Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[89]  Enrique Alba,et al.  Today/future importance analysis , 2010, GECCO '10.

[90]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[91]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[92]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[93]  Ole J Mengshoel,et al.  The Crowding Approach to Niching in Genetic Algorithms , 2008, Evolutionary Computation.

[94]  Samir W. Mahfoud Crowding and Preselection Revisited , 1992, PPSN.

[95]  Zachary V. Hendershot A Differential Evolution Algorithm for Automatically Discovering Multiple Global Optima in Multidimensional, Discontinuous Spaces , 2004, MAICS.

[96]  Chang-Hwan Im,et al.  A novel algorithm for multimodal function optimization based on evolution strategy , 2004 .

[97]  Samir W. Mahfoud A Comparison of Parallel and Sequential Niching Methods , 1995, ICGA.

[98]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[99]  François E. Cellier,et al.  Artificial Neural Networks and Genetic Algorithms , 1991 .

[100]  Michael Guntsch,et al.  Applying Population Based ACO to Dynamic Optimization Problems , 2002, Ant Algorithms.

[101]  Kalyanmoy Deb,et al.  Finding multiple solutions for multimodal optimization problems using a multi-objective evolutionary approach , 2010, GECCO '10.

[102]  K. Parsopoulos,et al.  Stretching technique for obtaining global minimizers through Particle Swarm Optimization , 2001 .

[103]  W. Cedeno,et al.  On the use of niching for dynamic landscapes , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[104]  Abdelaziz Bouroumi,et al.  A multipopulation cultural algorithm using fuzzy clustering , 2007, Appl. Soft Comput..

[105]  Jian-Ping Li,et al.  Random search with species conservation for multimodal functions , 2009, 2009 IEEE Congress on Evolutionary Computation.

[106]  A. Ravindran,et al.  Engineering Optimization: Methods and Applications , 2006 .

[107]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[108]  A. Engelbrecht,et al.  Using vector operations to identify niches for particle swarm optimization , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[109]  P. N. Suganthan,et al.  Ensemble of niching algorithms , 2010, Inf. Sci..

[110]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[111]  Fabrício Olivetti de França,et al.  An artificial immune network for multimodal function optimization on dynamic environments , 2005, GECCO.

[112]  Xiaodong Li,et al.  Enhancing the robustness of a speciation-based PSO , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[113]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[114]  Ofer M. Shir,et al.  Niching in Evolution Strategies and Its Application to Laser Pulse Shaping , 2005, Artificial Evolution.

[115]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .