Trust-Region Based Multi-objective Optimization for Low Budget Scenarios

In many practical multi-objective optimization problems, evaluation of objectives and constraints are computationally time-consuming, because they require expensive simulation of complicated models. Researchers often use a comparatively less time-consuming surrogate or metamodel (model of models) to drive the optimization task. Effectiveness of the metamodeling method relies not only on how it manages the search process (to find infill sampling) but also how it deals with associated error uncertainty between metamodels and the true models during an optimization run. In this paper, we propose a metamodel-based multi-objective evolutionary algorithm that adaptively maintains regions of trust in variable space to make a balance between error uncertainty and progress. In contrast to other trust-region methods for single-objective optimization, our method aims to solve multi-objective expensive problems where we incorporate multiple trust regions, corresponding to multiple non-dominated solutions. These regions can grow or shrink in size according to the deviation between metamodel prediction and high-fidelity computed values. We introduce two performance indicators based on hypervolume and achievement scalarization function (ASF) to control the size of the trust regions. The results suggest that our proposed trust-region based methods can effectively solve test and real-world problems using a limited budget of solution evaluations with increased accuracy.

[1]  Kalyanmoy Deb,et al.  Best Order Sort: A New Algorithm to Non-dominated Sorting for Evolutionary Multi-objective Optimization , 2016, GECCO.

[2]  Jong-hyun Ryu,et al.  A Derivative-Free Trust-Region Method for Biobjective Optimization , 2014, SIAM J. Optim..

[3]  Kaisa Miettinen,et al.  A Surrogate-Assisted Reference Vector Guided Evolutionary Algorithm for Computationally Expensive Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[4]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[5]  Kalyanmoy Deb,et al.  Trust-region based algorithms with low-budget for multi-objective optimization , 2018, GECCO.

[6]  Wolfgang Ponweiser,et al.  Multiobjective Optimization on a Limited Budget of Evaluations Using Model-Assisted -Metric Selection , 2008, PPSN.

[7]  Tapabrata Ray,et al.  Multi-Objective Optimization With Multiple Spatially Distributed Surrogates , 2016 .

[8]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[9]  Szu Hui Ng,et al.  G-STAR: A new Kriging-based trust region method for global optimization , 2016, 2016 Winter Simulation Conference (WSC).

[10]  N. M. Alexandrov,et al.  A trust-region framework for managing the use of approximation models in optimization , 1997 .

[11]  Kalyanmoy Deb,et al.  High dimensional model representation for solving expensive multi-objective optimization problems , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[12]  Layne T. Watson,et al.  Efficient global optimization algorithm assisted by multiple surrogate techniques , 2012, Journal of Global Optimization.

[13]  Andrzej P. Wierzbicki,et al.  The Use of Reference Objectives in Multiobjective Optimization , 1979 .

[14]  Kalyanmoy Deb,et al.  Metamodeling for multimodal selection functions in evolutionary multi-objective optimization , 2017, GECCO.

[15]  Kalyanmoy Deb,et al.  Classifying Metamodeling Methods for Evolutionary Multi-objective Optimization: First Results , 2017, EMO.

[16]  Kalyanmoy Deb,et al.  An Efficient Nondominated Sorting Algorithm for Large Number of Fronts , 2019, IEEE Transactions on Cybernetics.

[17]  Tapabrata Ray,et al.  Multiple surrogate assisted multiobjective optimization using improved pre-selection , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[18]  Michael T. M. Emmerich,et al.  Hypervolume-based expected improvement: Monotonicity properties and exact computation , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[19]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[20]  Qingfu Zhang,et al.  Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model , 2010, IEEE Transactions on Evolutionary Computation.

[21]  Kalyanmoy Deb,et al.  A Generative Kriging Surrogate Model for Constrained and Unconstrained Multi-objective Optimization , 2016, GECCO.

[22]  Michael T. M. Emmerich,et al.  Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels , 2006, IEEE Transactions on Evolutionary Computation.

[23]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[24]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[25]  Kalyanmoy Deb,et al.  A Taxonomy for Metamodeling Frameworks for Evolutionary Multiobjective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[26]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[27]  Jörg Fliege,et al.  A Method for Constrained Multiobjective Optimization Based on SQP Techniques , 2016, SIAM J. Optim..