A Generative Kriging Surrogate Model for Constrained and Unconstrained Multi-objective Optimization

Surrogate models are effective in reducing the computational time required for solving optimization problems. However, there have been a lukewarm interest in finding multiple trade off solutions for multi-objective optimization problems using surrogate models. The literature on surrogate modeling for constrained optimization problems is also rare. The diffculty lies in the requirement of building and solving multiple surrogate models, one for each Pareto-optimal solution. In this paper, we first provide a brief introduction of the past studies and suggest a computationally fast, Kriging-based, and generative procedure for finding multiple near Pareto optimal solutions in a systematic manner. The expected improvement metric is maximized using a real-parameter genetic algorithm for finding new solutions for high-fidelity evaluations. The approach is computationally fast due to the interlinking of building multiple surrogate models and in its systematic sequencing methodology for assisting one model with another. In standard two and three-objective test problems with and without constraints, our proposed methodology takes only a few hundreds of high-fidelity solution evaluations to find a widely distributed near Pareto optimal solutions compared to the standard EMO methods requiring tens of thousands of high-fidelity solution evaluations. The framework is generic and can be extended to utilize other surrogate modeling methods easily.

[1]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[2]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[3]  Kalyanmoy Deb,et al.  Multi-objective Genetic Algorithms: Problem Difficulties and Construction of Test Problems , 1999, Evolutionary Computation.

[4]  Andy J. Keane,et al.  Engineering Design via Surrogate Modelling - A Practical Guide , 2008 .

[5]  Søren Nymand Lophaven,et al.  DACE - A Matlab Kriging Toolbox, Version 2.0 , 2002 .

[6]  Andrzej P. Wierzbicki,et al.  The Use of Reference Objectives in Multiobjective Optimization , 1979 .

[7]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[8]  Søren Nymand Lophaven,et al.  DACE - A Matlab Kriging Toolbox , 2002 .

[9]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[10]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[11]  Aimin Zhou,et al.  A Multiobjective Evolutionary Algorithm Based on Decomposition and Preselection , 2015, BIC-TA.

[12]  Kalyanmoy Deb,et al.  Real-coded Genetic Algorithms with Simulated Binary Crossover: Studies on Multimodal and Multiobjective Problems , 1995, Complex Syst..

[13]  Wolfgang Ponweiser,et al.  Multiobjective Optimization on a Limited Budget of Evaluations Using Model-Assisted -Metric Selection , 2008, PPSN.

[14]  Kalyanmoy Deb,et al.  Constrained Efficient Global Optimization for Pultrusion Process , 2015 .

[15]  Jürgen Teich,et al.  A New Approach on Many Objective Diversity Measurement , 2005, Practical Approaches to Multi-Objective Optimization.

[16]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[17]  Michael T. M. Emmerich,et al.  Single- and multiobjective evolutionary optimization assisted by Gaussian random field metamodels , 2006, IEEE Transactions on Evolutionary Computation.

[18]  Thomas J. Santner,et al.  Design and analysis of computer experiments , 1998 .

[19]  Bernhard Sendhoff,et al.  A framework for evolutionary optimization with approximate fitness functions , 2002, IEEE Trans. Evol. Comput..

[20]  G. Matheron Principles of geostatistics , 1963 .

[21]  Kalyanmoy Deb,et al.  An Optimality Theory Based Proximity Measure for Evolutionary Multi-Objective and Many-Objective Optimization , 2015, EMO.

[22]  Donald R. Jones,et al.  A Taxonomy of Global Optimization Methods Based on Response Surfaces , 2001, J. Glob. Optim..

[23]  Qingfu Zhang,et al.  Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model , 2010, IEEE Transactions on Evolutionary Computation.

[24]  Wilfrido Gómez-Flores,et al.  On the selection of surrogate models in evolutionary optimization algorithms , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[25]  Shigeru Obayashi,et al.  Updating Kriging Surrogate Models Based on the Hypervolume Indicator in Multi-Objective Optimization , 2013 .

[26]  Sonja Kuhnt,et al.  Design and analysis of computer experiments , 2010 .

[27]  D. Krige A statistical approach to some basic mine valuation problems on the Witwatersrand, by D.G. Krige, published in the Journal, December 1951 : introduction by the author , 1951 .