Evolutionary Multiobjective Optimization-Based Multimodal Optimization: Fitness Landscape Approximation and Peak Detection

Recently, by taking advantage of evolutionary multiobjective optimization techniques in diversity preservation, the means of multiobjectivization has attracted increasing interest in the studies of multimodal optimization (MMO). While most existing work of multiobjectivization aims to find all optimal solutions simultaneously, in this paper, we propose to approximate multimodal fitness landscapes via multiobjectivization, thus providing an estimation of potential optimal areas. To begin with, an MMO problem is transformed into a multiobjective optimization problem (MOP) by adding an adaptive diversity indicator as the second optimization objective, and an approximate fitness landscape is obtained via optimization of the transformed MOP using a multiobjective evolutionary algorithm. Then, on the basis of the approximate fitness landscape, an adaptive peak detection method is proposed to find peaks where optimal solutions may exist. Finally, local search is performed inside the detected peaks on the approximate fitness landscape. To assess the performance of the proposed algorithm, extensive experiments are conducted on 20 multimodal test functions, in comparison with three state-of-the-art algorithms for MMO. Experimental results demonstrate that the proposed algorithm not only shows promising performance in benchmark comparisons, but also has good potential in assisting preference-based decision-making in MMO.

[1]  Xiaodong Li,et al.  Seeking Multiple Solutions: An Updated Survey on Niching Methods and Their Applications , 2017, IEEE Transactions on Evolutionary Computation.

[2]  Francisco Herrera,et al.  Analysis of new niching genetic algorithms for finding multiple solutions in the job shop scheduling , 2012, J. Intell. Manuf..

[3]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[4]  Jing J. Liang,et al.  Differential Evolution With Neighborhood Mutation for Multimodal Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[5]  Donald R. Jones,et al.  Direct Global Optimization Algorithm , 2009, Encyclopedia of Optimization.

[6]  Kay Chen Tan,et al.  Multimodal Optimization Using a Biobjective Differential Evolution Algorithm Enhanced With Mean Distance-Based Selection , 2013, IEEE Transactions on Evolutionary Computation.

[7]  David W. Corne,et al.  Properties of an adaptive archiving algorithm for storing nondominated vectors , 2003, IEEE Trans. Evol. Comput..

[8]  Ofer M. Shir,et al.  Niching in Evolution Strategies and Its Application to Laser Pulse Shaping , 2005, Artificial Evolution.

[9]  Bruno Sareni,et al.  Fitness sharing and niching methods revisited , 1998, IEEE Trans. Evol. Comput..

[10]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[11]  Xiaodong Yin,et al.  A Fast Genetic Algorithm with Sharing Scheme Using Cluster Analysis Methods in Multimodal Function Optimization , 1993 .

[12]  Yong Wang,et al.  MOMMOP: Multiobjective Optimization for Locating Multiple Optimal Solutions of Multimodal Optimization Problems , 2015, IEEE Transactions on Cybernetics.

[13]  Kalyanmoy Deb,et al.  Evaluating the -Domination Based Multi-Objective Evolutionary Algorithm for a Quick Computation of Pareto-Optimal Solutions , 2005, Evolutionary Computation.

[14]  Lily Rachmawati,et al.  Dynamic resizing for grid-based archiving in evolutionary multi objective optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[15]  Aimo Törn,et al.  Topographical global optimization , 1992 .

[16]  Ka-Chun Wong,et al.  Evolutionary Multimodal Optimization: A Short Survey , 2015, ArXiv.

[17]  Elena Pérez,et al.  Taking advantage of solving the resource constrained multi-project scheduling problems using multi-modal genetic algorithms , 2016, Soft Comput..

[18]  Bernhard Sendhoff,et al.  A Multiobjective Evolutionary Algorithm Using Gaussian Process-Based Inverse Modeling , 2015, IEEE Transactions on Evolutionary Computation.

[19]  René Thomsen,et al.  Multimodal optimization using crowding-based differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[20]  Kalyanmoy Deb,et al.  A parameterless-niching-assisted bi-objective approach to multimodal optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[21]  Yong Wang,et al.  A regularity model-based multiobjective estimation of distribution algorithm with reducing redundant cluster operator , 2012, Appl. Soft Comput..

[22]  Jinhua Zheng,et al.  Enhancing Diversity for Average Ranking Method in Evolutionary Many-Objective Optimization , 2010, PPSN.

[23]  Kalyanmoy Deb,et al.  Comparison of multi-modal optimization algorithms based on evolutionary algorithms , 2006, GECCO.

[24]  P. John Clarkson,et al.  A Species Conserving Genetic Algorithm for Multimodal Function Optimization , 2002, Evolutionary Computation.

[25]  K. Deb,et al.  Design of truss-structures for minimum weight using genetic algorithms , 2001 .

[26]  Jun Zhang,et al.  Adaptive Multimodal Continuous Ant Colony Optimization , 2017, IEEE Transactions on Evolutionary Computation.

[27]  Xiaodong Li,et al.  Benchmark Functions for CEC'2013 Special Session and Competition on Niching Methods for Multimodal Function Optimization' , 2013 .

[28]  Xianda Zhang,et al.  A robust dynamic niching genetic algorithm with niche migration for automatic clustering problem , 2010, Pattern Recognit..

[29]  Guo Guanqi,et al.  Evolutionary parallel local search for function optimization , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[30]  Mahdi Eftekhari,et al.  Feature selection using multimodal optimization techniques , 2016, Neurocomputing.

[31]  Andreas Zell,et al.  A Clustering Based Niching EA for Multimodal Search Spaces , 2003, Artificial Evolution.

[32]  Mike Preuss,et al.  Improved Topological Niching for Real-Valued Global Optimization , 2012, EvoApplications.

[33]  Günter Rudolph,et al.  Niching by multiobjectivization with neighbor information: Trade-offs and benefits , 2013, 2013 IEEE Congress on Evolutionary Computation.

[34]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[35]  Sanyang Liu,et al.  A Cluster-Based Differential Evolution With Self-Adaptive Strategy for Multimodal Optimization , 2014, IEEE Transactions on Cybernetics.

[36]  D. Goldberg,et al.  Adaptive Niching via coevolutionary Sharing , 1997 .

[37]  Jonathan E. Fieldsend,et al.  Multi-modal optimisation using a localised surrogates assisted evolutionary algorithm , 2013, 2013 13th UK Workshop on Computational Intelligence (UKCI).

[38]  A. Kan,et al.  A Stochastic Approach to Global Optimization , 2015 .

[39]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[40]  Ponnuthurai N. Suganthan,et al.  Novel multimodal problems and differential evolution with ensemble of restricted tournament selection , 2010, IEEE Congress on Evolutionary Computation.

[41]  Dumitru Dumitrescu,et al.  Multimodal Optimization by Means of a Topological Species Conservation Algorithm , 2010, IEEE Transactions on Evolutionary Computation.

[42]  Shengxiang Yang,et al.  A Grid-Based Evolutionary Algorithm for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[43]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[44]  Swagatam Das,et al.  Inducing Niching Behavior in Differential Evolution Through Local Information Sharing , 2015, IEEE Transactions on Evolutionary Computation.

[45]  Ponnuthurai N. Suganthan,et al.  A Distance-Based Locally Informed Particle Swarm Model for Multimodal Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[46]  Ke Tang,et al.  History-Based Topological Speciation for Multimodal Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[47]  Ofer M. Shir,et al.  Niching in Evolutionary Algorithms , 2012, Handbook of Natural Computing.

[48]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[49]  Ponnuthurai N. Suganthan,et al.  Real-parameter evolutionary multimodal optimization - A survey of the state-of-the-art , 2011, Swarm Evol. Comput..

[50]  Jonathan E. Fieldsend,et al.  Running Up Those Hills: Multi-modal search with the niching migratory multi-swarm optimiser , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[51]  Gary G. Yen,et al.  Dynamic multiobjective evolutionary algorithm: adaptive cell-based rank and density estimation , 2003, IEEE Trans. Evol. Comput..

[52]  Andreas Zell,et al.  On the Benefits of Multimodal Optimization for Metablic Network Modeling , 2009, GCB.

[53]  Jie Yao,et al.  Bi-Objective Multipopulation Genetic Algorithm for Multimodal Function Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[54]  David E. Goldberg,et al.  Probabilistic Crowding: Deterministic Crowding with Probabilistic Replacement , 1999 .

[55]  Kalyanmoy Deb,et al.  Multi-Objective Evolutionary Algorithms , 2015, Handbook of Computational Intelligence.

[56]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[57]  Kalyanmoy Deb,et al.  Multimodal Optimization Using a Bi-Objective Evolutionary Algorithm , 2012, Evolutionary Computation.

[58]  Mike Preuss,et al.  Diversified Virtual Camera Composition , 2012, EvoApplications.

[59]  Mike Preuss,et al.  Multimodal Optimization by Means of Evolutionary Algorithms , 2015, Natural Computing Series.

[60]  Xin Yao,et al.  Every Niching Method has its Niche: Fitness Sharing and Implicit Sharing Compared , 1996, PPSN.

[61]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[62]  Andries Petrus Engelbrecht,et al.  Niche Particle Swarm Optimization for Neural Network Ensembles , 2009, ECAL.

[63]  Xin Yao,et al.  Speciation as automatic categorical modularization , 1997, IEEE Trans. Evol. Comput..