MOEA/D assisted by rbf networks for expensive multi-objective optimization problems

The development of multi-objective evolutionary algorithms assisted by surrogate models has increased in the last few years. However, in real-world applications, the high modality and dimensionality that functions have, often causes problems to such models. In fact, if the Pareto optimal set of a multi-objective optimization problem is located in a search space in which the surrogate model is not able to shape the corresponding region, the search could be misinformed and thus converge to wrong regions. Because of this, a considerable amount of research has focused on improving the prediction of the surrogate models by adding the new solutions to the training set and retraining the model. However, when the size of the training set increases, the training complexity can significantly increase. In this paper, we present a surrogate model which maintains the size of the training set, and in which the prediction of the function is improved by using radial basis function networks in a cooperative way. Preliminary results indicate that our proposed approach can produce good quality results when it is restricted to performing only 200, 1,000 and 5,000 fitness function evaluations. Our proposed approach is validated using a set of standard test problems and an airfoil design problem.

[1]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[2]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[3]  David A. Sprecher,et al.  A universal mapping for kolmogorov's superposition theorem , 1993, Neural Networks.

[4]  A. Keane,et al.  Evolutionary Optimization of Computationally Expensive Problems via Surrogate Modeling , 2003 .

[5]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[6]  Aimin Zhou,et al.  A Multiobjective Evolutionary Algorithm Based on Decomposition and Preselection , 2015, BIC-TA.

[7]  R. Storn,et al.  Differential evolution a simple and efficient adaptive scheme for global optimization over continu , 1997 .

[8]  Jaroslav Hájek,et al.  Aerodynamic optimization via multi-objective micro-genetic algorithm with range adaptation, knowledge-based reinitialization, crowding and epsilon-dominance , 2009, Adv. Eng. Softw..

[9]  V. Tikhomirov On the Representation of Continuous Functions of Several Variables as Superpositions of Continuous Functions of one Variable and Addition , 1991 .

[10]  Saúl Zapotecas Martínez,et al.  A multi-objective particle swarm optimizer based on decomposition , 2011, GECCO '11.

[11]  Michael T. M. Emmerich,et al.  Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels , 2006, IEEE Transactions on Evolutionary Computation.

[12]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[13]  M. Drela XFOIL: An Analysis and Design System for Low Reynolds Number Airfoils , 1989 .

[14]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[15]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[16]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[17]  H. Sobieczky Parametric Airfoils and Wings , 1999 .

[18]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[19]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[20]  J. Dennis,et al.  NORMAL-BOUNDARY INTERSECTION: AN ALTERNATE METHOD FOR GENERATING PARETO OPTIMAL POINTS IN MULTICRITERIA OPTIMIZATION PROBLEMS , 1996 .

[21]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[22]  Qingfu Zhang,et al.  Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model , 2010, IEEE Transactions on Evolutionary Computation.

[23]  Saúl Zapotecas Martínez,et al.  A Memetic Algorithm with Non Gradient-Based Local Search Assisted by a Meta-model , 2010, PPSN.

[24]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.