HCS: A New Local Search Strategy for Memetic Multiobjective Evolutionary Algorithms

In this paper, we propose and investigate a new local search strategy for multiobjective memetic algorithms. More precisely, we suggest a novel iterative search procedure, known as the Hill Climber with Sidestep (HCS), which is designed for the treatment of multiobjective optimization problems, and show further two possible ways to integrate the HCS into a given evolutionary strategy leading to new memetic (or hybrid) algorithms. The pecularity of the HCS is that it is intended to be capable both moving toward and along the (local) Pareto set depending on the distance of the current iterate toward this set. The local search procedure utilizes the geometry of the directional cones of such optimization problems and works with or without gradient information. Finally, we present some numerical results on some well-known benchmark problems, indicating the strength of the local search strategy as a standalone algorithm as well as its benefit when used within a MOEA. For the latter we use the state of the art algorithms Nondominated Sorting Genetic Algorithm-II and Strength Pareto Evolutionary Algorithm 2 as base MOEAs.

[1]  Peter A. N. Bosman,et al.  Exploiting gradient information in numerical multi--objective evolutionary optimization , 2005, GECCO '05.

[2]  H. Fawcett.  Manual of Political Economy , 1995 .

[3]  Carlos A. Coello Coello,et al.  Solving Multiobjective Optimization Problems Using an Artificial Immune System , 2005, Genetic Programming and Evolvable Machines.

[4]  K. Deb,et al.  Hybrid methods for multi-objective evolutionary algorithms , 2002 .

[5]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[6]  Massimiliano Vasile.  Hybrid Behavioral-Based Multiobjective Space Trajectory Optimization , 2009 .

[7]  Ferrante Neri,et al.  Integrating Cross-Dominance Adaptation in Multi-Objective Memetic Algorithms , 2009 .

[8]  Jim Smith,et al.  Operator and parameter adaptation in genetic algorithms , 1997, Soft Comput..

[9]  Jörg Fliege,et al.  Steepest descent methods for multicriteria optimization , 2000, Math. Methods Oper. Res..

[10]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[11]  Massimiliano Vasile,et al.  A hybrid multiagent approach for global trajectory optimization , 2009, J. Glob. Optim..

[12]  Jürgen Teich,et al.  Systematic integration of parameterized local search into evolutionary algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[13]  Andreas Griewank,et al.  Evaluating derivatives - principles and techniques of algorithmic differentiation, Second Edition , 2000, Frontiers in applied mathematics.

[14]  Gary B. Lamont,et al.  Evolutionary algorithms for solving multi-objective problems, Second Edition , 2007, Genetic and evolutionary computation series.

[15]  Carlos A. Coello Coello,et al.  A Memetic PSO Algorithm for Scalar Optimization Problems , 2007, 2007 IEEE Swarm Intelligence Symposium.

[16]  Jürgen Teich,et al.  Covering Pareto Sets by Multilevel Evolutionary Subdivision Techniques , 2003, EMO.

[17]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[18]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[19]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[20]  Xiaodong Li,et al.  Solving Rotated Multi-objective Optimization Problems Using Differential Evolution , 2004, Australian Conference on Artificial Intelligence.

[21]  DebK.,et al.  A fast and elitist multiobjective genetic algorithm , 2002 .

[22]  H. H. Rosenbrock,et al.  An Automatic Method for Finding the Greatest or Least Value of a Function , 1960, Comput. J..

[23]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[24]  Hussein A. Abbass,et al.  A Memetic Coevolutionary Multi-Objective Differential Evolution Algorithm , 2009 .

[25]  Stefan Roth,et al.  Covariance Matrix Adaptation for Multi-objective Optimization , 2007, Evolutionary Computation.

[26]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[27]  Kalyanmoy Deb,et al.  A Local Search Based Evolutionary Multi-objective Optimization Approach for Fast and Accurate Convergence , 2008, PPSN.

[28]  Marco Laumanns,et al.  Convergence of stochastic search algorithms to gap-free pareto front approximations , 2007, GECCO '07.

[29]  Hisao Ishibuchi,et al.  A multi-objective genetic local search algorithm and its application to flowshop scheduling , 1998, IEEE Trans. Syst. Man Cybern. Part C.

[30]  Joshua D. Knowles,et al.  M-PAES: a memetic algorithm for multiobjective optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[31]  F. Oppacher,et al.  Hybridized crossover-based search techniques for program discovery , 1995, Proceedings of 1995 IEEE International Conference on Evolutionary Computation.

[32]  W. Hart.  Adaptive global optimization with local search , 1994 .

[33]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[34]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[35]  Eugene L. Allgower,et al.  Numerical continuation methods - an introduction , 1990, Springer series in computational mathematics.

[36]  Andrzej Jaszkiewicz,et al.  Do multiple-objective metaheuristics deliver on their promises? A computational experiment on the set-covering problem , 2003, IEEE Trans. Evol. Comput..

[37]  Jürgen Branke,et al.  About Selecting the Personal Best in Multi-Objective Particle Swarm Optimization , 2006, PPSN.

[38]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[39]  Carlos A. Coello Coello,et al.  Evolutionary continuation methods for optimization problems , 2009, GECCO.

[40]  Hiroaki Satoh,et al.  Minimal generation gap model for GAs considering both exploration and exploitation , 1996 .

[41]  L. Armijo.  Minimization of functions having Lipschitz continuous first partial derivatives. , 1966 .

[42]  Ian Griffin,et al.  Hybrid multiobjective genetic algorithm with a new adaptive local search process , 2005, GECCO '05.

[43]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[44]  C. A. Coello Coello,et al.  Hybridizing evolutionary strategies with continuation methods for solving multi-objective problems , 2008 .

[45]  Isao Ono,et al.  Uniform sampling of local pareto-optimal solution curves by pareto path following and its applications in multi-objective GA , 2007, GECCO '07.

[46]  Natalio Krasnogor,et al.  Studies on the theory and design space of memetic algorithms , 2002 .

[47]  Enrico Rigoni,et al.  NBI and MOGA-II, two complementary algorithms for Multi-Objective optimizations , 2005, Practical Approaches to Multi-Objective Optimization.

[48]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[49]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[50]  E. Allgower,et al.  Numerical Continuation Methods , 1990 .

[51]  C. Hillermeier.  Nonlinear Multiobjective Optimization: A Generalized Homotopy Approach , 2001 .

[52]  Frederico G. Guimarães,et al.  A Quadratic Approximation-Based Local Search Procedure for Multiobjective Genetic Algorithms , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[53]  Xiaolin Hu,et al.  Hybridization of the multi-objective evolutionary algorithms and the gradient-based algorithms , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[54]  M. Dellnitz,et al.  Covering Pareto Sets by Multilevel Subdivision Techniques , 2005 .

[55]  Hisao Ishibuchi,et al.  Multi-objective genetic local search algorithm , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[56]  Yuren Zhou,et al.  Multiobjective Optimization and Hybrid Evolutionary Algorithm to Solve Constrained Optimization Problems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[57]  David E. Goldberg,et al.  Designing Efficient Genetic and Evolutionary Algorithm Hybrids , 2005 .

[58]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[59]  Martin Brown,et al.  Directed Multi-Objective Optimization , 2005, Int. J. Comput. Syst. Signals.

[60]  Claus Hillermeier,et al.  Nonlinear Multiobjective Optimization , 2001 .

[61]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[62]  Balram Suman,et al.  Study of simulated annealing based algorithms for multiobjective optimization of a constrained problem , 2004, Comput. Chem. Eng..

[63]  Xiaodong Li,et al.  Rotated Problems and Rotationally Invariant Crossover in Evolutionary Multi-Objective Optimization , 2008, Int. J. Comput. Intell. Appl..

[64]  Carlos A. Coello Coello,et al.  A new memetic strategy for the numerical treatment of multi-objective optimization problems , 2008, GECCO '08.

[65]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[66]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[67]  Hisao Ishibuchi,et al.  Generalization of Dominance Relation-Based Replacement Rules for Memetic EMO Algorithms , 2003, GECCO.

[68]  Massimiliano Vasile,et al.  Design of optimal spacecraft-asteroid formations through a hybrid global optimization approach , 2008, Int. J. Intell. Comput. Cybern..

[69]  Francisco Herrera,et al.  Real-Coded Memetic Algorithms with Crossover Hill-Climbing , 2004, Evolutionary Computation.

[70]  Enrico Rigoni,et al.  MOGA-II PERFORMANCE ON NOISY OPTIMIZATION PROBLEMS , 2004 .

[71]  Massimiliano Vasile.  A behavioral-based meta-heuristic for robust global trajectory optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[72]  Joshua D. Knowles,et al.  Memetic Algorithms for Multiobjective Optimization: Issues, Methods and Prospects , 2004 .

[73]  S. Schäffler,et al.  Stochastic Method for the Solution of Unconstrained Vector Optimization Problems , 2002 .

[74]  Bernhard Sendhoff,et al.  Adapting Weighted Aggregation for Multiobjective Evolution Strategies , 2001, EMO.

[75]  Hisao Ishibuchi,et al.  Balance between genetic search and local search in memetic algorithms for multiobjective permutation flowshop scheduling , 2003, IEEE Trans. Evol. Comput..

[76]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..