Combining surrogate models and local search for dealing with expensive multi-objective optimization problems

The development of multi-objective evolutionary algorithms (MOEAs) assisted by surrogate models has significantly increased in the last few years. However, in realworld applications, the high modality and dimensionality that functions normally have, often causes problems to such models. Therefore, if the Pareto optimal set of a multi-objective optimization problem is located in a search space in which the surrogate model is not able to shape the corresponding region, the search could be misinformed and thus converge to wrong regions. This has motivated the idea of incorporating refinement mechanisms to such approaches, in order to improve the search. In this paper, we present a local search mechanism which improves the search of a MOEA assisted by surrogate models. Our preliminary results indicate that our proposed approach can produce good quality results when it is restricted to performing only between 1,000 and 5,000 fitness function evaluations. Our proposed approach is validated using a set of standard test problems and an airfoil design problem.

[1]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[2]  J. Dennis,et al.  NORMAL-BOUNDARY INTERSECTION: AN ALTERNATE METHOD FOR GENERATING PARETO OPTIMAL POINTS IN MULTICRITERIA OPTIMIZATION PROBLEMS , 1996 .

[3]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[4]  Jaroslav Hájek,et al.  Aerodynamic optimization via multi-objective micro-genetic algorithm with range adaptation, knowledge-based reinitialization, crowding and epsilon-dominance , 2009, Adv. Eng. Softw..

[5]  Sanjoy Das,et al.  Multi-objective hybrid PSO using µ-fuzzy dominance , 2007, GECCO '07.

[6]  Saúl Zapotecas Martínez,et al.  MOEA/D assisted by rbf networks for expensive multi-objective optimization problems , 2013, GECCO '13.

[7]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[8]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[9]  Saúl Zapotecas Martínez,et al.  A multi-objective particle swarm optimizer based on decomposition , 2011, GECCO '11.

[10]  Saúl Zapotecas Martínez,et al.  A direct local search mechanism for decomposition-based multi-objective evolutionary algorithms , 2012, 2012 IEEE Congress on Evolutionary Computation.

[11]  Robert Hooke,et al.  `` Direct Search'' Solution of Numerical and Statistical Problems , 1961, JACM.

[12]  H. Sobieczky Parametric Airfoils and Wings , 1999 .

[13]  Kyriakos C. Giannakoglou,et al.  Multiobjective Metamodel–Assisted Memetic Algorithms , 2009 .

[14]  Qingfu Zhang,et al.  Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model , 2010, IEEE Transactions on Evolutionary Computation.

[15]  Saúl Zapotecas Martínez,et al.  A Memetic Algorithm with Non Gradient-Based Local Search Assisted by a Meta-model , 2010, PPSN.

[16]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[17]  Jeffrey C. Lagarias,et al.  Convergence Properties of the Nelder-Mead Simplex Method in Low Dimensions , 1998, SIAM J. Optim..

[18]  Wenhui Fan,et al.  Hybrid Non-dominated Sorting Differential Evolutionary Algorithm with Nelder-Mead , 2010, 2010 Second WRI Global Congress on Intelligent Systems.

[19]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[20]  Tapabrata Ray,et al.  An Evolutionary Algorithm with Spatially Distributed Surrogates for Multiobjective Optimization , 2007, ACAL.

[21]  Michael T. M. Emmerich,et al.  Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels , 2006, IEEE Transactions on Evolutionary Computation.

[22]  M. Drela XFOIL: An Analysis and Design System for Low Reynolds Number Airfoils , 1989 .

[23]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[24]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[25]  Saúl Zapotecas Martínez,et al.  A multi-objective meta-model assisted memetic algorithm with non gradient-based local search , 2010, GECCO '10.

[26]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[27]  J. Hammersley MONTE CARLO METHODS FOR SOLVING MULTIVARIABLE PROBLEMS , 1960 .

[28]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.