Metamodeling for multimodal selection functions in evolutionary multi-objective optimization

Most real-world optimization problems involve computationally expensive simulations for evaluating a solution. Despite significant progress in the use of metamodels for single-objective optimization, metamodeling methods have received a lukewarm attention for multi-objective optimization. A recent study classified various metamodeling approaches, of which one particular method is interesting, challenging, and novel. In this paper, we study this so-called M6 method in detail. In this approach, a selection operator's assignment function, as it is implemented in an evolutionary multi-objective optimization (EMO) algorithm, is directly metamodeled. Thus, this methodology requires only one selection function to be metamodeled irrespective of multitude of objective and constraint functions in a problem. However, the flip side of the methodology is that the resulting function is multimodal having a different optimum for every desired Pareto-optimal solution. We have used two different selection functions based on two recent ideas: (i) KKT proximity measure function and (ii) multimodal based evolutionary multi-objective (MEMO) selection function. The resulting meta-modeling methods are applied to a number of standard two and three-objective constraint and unconstrained test problems. Near Pareto-optimal solutions are found using only a fraction of high-fidelity solution evaluations compared to usual EMO applications.

[1]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[2]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[3]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[4]  Kalyanmoy Deb,et al.  A fast and accurate solution of constrained optimization problems using a hybrid bi-objective and penalty function approach , 2010, IEEE Congress on Evolutionary Computation.

[5]  Wolfgang Ponweiser,et al.  Multiobjective Optimization on a Limited Budget of Evaluations Using Model-Assisted -Metric Selection , 2008, PPSN.

[6]  Kalyanmoy Deb,et al.  Classifying Metamodeling Methods for Evolutionary Multi-objective Optimization: First Results , 2017, EMO.

[7]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[8]  R. S. Laundy,et al.  Multiple Criteria Optimisation: Theory, Computation and Application , 1989 .

[9]  Kalyanmoy Deb,et al.  A Generative Kriging Surrogate Model for Constrained and Unconstrained Multi-objective Optimization , 2016, GECCO.

[10]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[11]  Kalyanmoy Deb,et al.  A Multimodal Approach for Evolutionary Multi-objective Optimization (MEMO): Proof-of-Principle Results , 2015, EMO.

[12]  Bernhard Sendhoff,et al.  Comparing neural networks and Kriging for fitness approximation in evolutionary optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[13]  Michael T. M. Emmerich,et al.  Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels , 2006, IEEE Transactions on Evolutionary Computation.

[14]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[15]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[16]  Qingfu Zhang,et al.  Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model , 2010, IEEE Transactions on Evolutionary Computation.

[17]  Kalyanmoy Deb,et al.  High dimensional model representation for solving expensive multi-objective optimization problems , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[18]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[19]  Kalyanmoy Deb,et al.  An Optimality Theory Based Proximity Measure for Evolutionary Multi-Objective and Many-Objective Optimization , 2015, EMO.

[20]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[21]  Ramana V. Grandhi,et al.  Improved Distributed Hypercube Sampling , 2002 .