A Multimodal Approach for Evolutionary Multi-objective Optimization (MEMO): Proof-of-Principle Results

Most evolutionary multi-objective optimization (EMO) methods use domination and niche-preserving principles in their selection operation to find a set of Pareto-optimal solutions in a single simulation run. However, classical generative multi-criterion optimization methods repeatedly solve a parameterized single-objective problem to achieve the same. Due to lack of parallelism in the classical generative methods, they have been reported to be slow compared to efficient EMO methods. In this paper, we use a specific scalarization method, but instead of repetitive independent applications, we formulate a multimodal scalarization of multiple objectives and develop a niche-based evolutionary algorithm to find multiple Pareto-optimal solutions in a single simulation run. Proof-of-principle results on two to 10-objective problems from our proposed multimodal approach are compared with standard evolutionary multi/many-objective optimization methods.

[1]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[2]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[3]  Yacov Y. Haimes,et al.  Multiobjective Decision Making: Theory and Methodology , 1983 .

[4]  Jacek M. Zurada,et al.  Swarm and Evolutionary Computation , 2012, Lecture Notes in Computer Science.

[5]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[6]  E. Dilettoso,et al.  A self-adaptive niching genetic algorithm for multimodal optimization of electromagnetic devices , 2006, IEEE Transactions on Magnetics.

[7]  Kwong-Sak Leung,et al.  Protein structure prediction on a lattice model via multimodal optimization techniques , 2010, GECCO '10.

[8]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[9]  R. S. Laundy,et al.  Multiple Criteria Optimisation: Theory, Computation and Application , 1989 .

[10]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[11]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[12]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[13]  O. M. Shir,et al.  CONCEPTUAL DESIGNS IN LASER PULSE SHAPING OBTAINED BY NICHING IN EVOLUTION STRATEGIES , .

[14]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[15]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[16]  Patrick Siarry,et al.  Island Model Cooperating with Speciation for Multimodal Optimization , 2000, PPSN.

[17]  Günter Rudolph,et al.  Solving multimodal problems via multiobjective techniques with Application to phase equilibrium detection , 2007, 2007 IEEE Congress on Evolutionary Computation.

[18]  Carlos A. Coello Coello,et al.  A Review of Particle Swarm Optimization Methods Used for Multimodal Optimization , 2009, Innovations in Swarm Intelligence.

[19]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[20]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[21]  D. J. Cavicchio,et al.  Adaptive search using simulated evolution , 1970 .

[22]  David E. Goldberg,et al.  Probabilistic Crowding: Deterministic Crowding with Probabilistic Replacement , 1999 .

[23]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[24]  Xin-She Yang,et al.  Firefly Algorithms for Multimodal Optimization , 2009, SAGA.

[25]  Xiaodong Li,et al.  A Generator for Multimodal Test Functions with Multiple Global Optima , 2008, SEAL.

[26]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[27]  A. Pétrowski.  An Efficient Hierarchical Clustering Technique for Speciation , 2007 .

[28]  Xiaodong Li,et al.  This article has been accepted for inclusion in a future issue. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 Locating and Tracking Multiple Dynamic Optima by a Particle Swarm Model Using Speciation , 2022 .

[29]  Lakhmi C. Jain,et al.  Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[30]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[31]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[32]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[33]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[34]  Qing Li,et al.  Multiobjective optimization for crash safety design of vehicles using stepwise regression model , 2008 .

[35]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[36]  Ponnuthurai N. Suganthan,et al.  Real-parameter evolutionary multimodal optimization - A survey of the state-of-the-art , 2011, Swarm Evol. Comput..

[37]  Masahiro Tanaka,et al.  GA-based decision support system for multicriteria optimization , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[38]  Aravind Srinivasan,et al.  Innovization: innovating design principles through optimization , 2006, GECCO.

[39]  Kang Li,et al.  A Sequential Niching Technique for Particle Swarm Optimization , 2005, ICIC.

[40]  Xiaodong Li,et al.  Efficient differential evolution using speciation for multimodal function optimization , 2005, GECCO '05.

[41]  E. Polak,et al.  On Multicriteria Optimization , 1976 .

[42]  Peter J. Fleming,et al.  Genetic Algorithms for Multiobjective Optimization: FormulationDiscussion and Generalization , 1993, ICGA.

[43]  P. John Clarkson,et al.  A Species Conserving Genetic Algorithm for Multimodal Function Optimization , 2002, Evolutionary Computation.

[44]  Jaroslaw A. Czyz,et al.  Multimodal optimization of structures with frequency constraints , 1995 .

[45]  Kalyanmoy Deb,et al.  Multimodal Optimization Using a Bi-Objective Evolutionary Algorithm , 2012, Evolutionary Computation.

[46]  Marco Laumanns,et al.  A Tutorial on Evolutionary Multiobjective Optimization , 2004, Metaheuristics for Multiobjective Optimisation.

[47]  Thomas Bäck,et al.  Parallel Problem Solving from Nature — PPSN V , 1998, Lecture Notes in Computer Science.

[48]  Simon French,et al.  Multiple Criteria Decision Making: Theory and Application , 1981 .

[49]  Fernando José Von Zuben,et al.  Learning and optimization using the clonal selection principle , 2002, IEEE Trans. Evol. Comput..

[50]  Kalyanmoy Deb,et al.  MULTI-OBJECTIVE FUNCTION OPTIMIZATION USING NON-DOMINATED SORTING GENETIC ALGORITHMS , 1994 .

[51]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[52]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[53]  Xiaodong Yin,et al.  A Fast Genetic Algorithm with Sharing Scheme Using Cluster Analysis Methods in Multimodal Function Optimization , 1993 .

[54]  C. Fonseca,et al.  GENETIC ALGORITHMS FOR MULTI-OBJECTIVE OPTIMIZATION: FORMULATION, DISCUSSION, AND GENERALIZATION , 1993 .

[55]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[56]  Andrzej P. Wierzbicki,et al.  The Use of Reference Objectives in Multiobjective Optimization , 1979 .

[57]  Andreas Zell,et al.  A Clustering Based Niching EA for Multimodal Search Spaces , 2003, Artificial Evolution.

[58]  Samir W. Mahfoud.  Crowding and Preselection Revisited , 1992, PPSN.

[59]  Cem Celal Tutum,et al.  Thermo-Chemical Modelling Strategies for the Pultrusion Process , 2013, Applied Composite Materials.

[60]  Kalyanmoy Deb,et al.  Comparing Classical Generating Methods with an Evolutionary Multi-objective Optimization Method , 2005, EMO.

[61]  Hyun-Kyo Jung,et al.  A novel algorithm for multimodal function optimization based on evolution strategy , 2004, IEEE Transactions on Magnetics.

[62]  Hyun-Kyo Jung,et al.  Niching genetic algorithm with restricted competition selection for multimodal function optimization , 1999 .

[63]  Kalyanmoy Deb,et al.  Optimum design of pultrusion process via evolutionary multi-objective optimization , 2014 .

[64]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point Based Nondominated Sorting Approach, Part II: Handling Constraints and Extending to an Adaptive Approach , 2014, IEEE Transactions on Evolutionary Computation.

[65]  Ofer M. Shir,et al.  Niching in evolution strategies , 2005, GECCO '05.

[66]  R. K. Ursem.  Multinational evolutionary algorithms , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).