A multi-objective batch infill strategy for efficient global optimization

High-fidelity simulations and/or physical experiments are often required to evaluate performance of products and processes. Although accurate, they are often time consuming and/or costly, which makes it prohibitive to use them within a global optimization framework. To deal with this issue, Surrogate Assisted Optimization (SAO) approaches have been commonly used in literature. Efficient Global Optimization (EGO) is one such approach which relies on Kriging model and maximizes the expected improvement to identify the best location for sampling. Most EGO approaches studied in the literature sample one point at a time. However, this approach is inefficient for the cases when it is possible to evaluate a batch of solutions at the same cost as a single solution. This might happen for example, when a number of physical samples could be tested in an experimental setup simultaneously, or a number of simulations could be run in parallel on a cluster. This study presents an approach to sample multiple locations at each iteration. To achieve this, a multi-objective (MO) formulation is proposed and solved which considers maximization of expected improvement and maximization of distance from existing truly evaluated solutions. A decomposition based approach is then used to sample the infill solutions from the resulting non-dominated front. Numerical experiments are presented on ten well known benchmarks and a comparison is done with existing methods to demonstrate the efficacy of the proposed approach. The results obtained for constrained optimization problems are particularly encouraging.

[1]  Andy J. Keane,et al.  Engineering Design via Surrogate Modelling - A Practical Guide , 2008 .

[2]  Donald R. Jones,et al.  Global versus local search in constrained optimization of computer models , 1998 .

[3]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[4]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[5]  Charles Audet,et al.  A surrogate-model-based method for constrained optimization , 2000 .

[6]  J. F. Price,et al.  On descent from local minima , 1971 .

[7]  M. Sasena,et al.  Global optimization of problems with disconnected feasible regions via surrogate modeling , 2002 .

[8]  Klaus Schittkowski,et al.  Test examples for nonlinear programming codes , 1980 .

[9]  William J. Welch,et al.  Computer experiments and global optimization , 1997 .

[10]  D. Ginsbourger,et al.  A Multi-points Criterion for Deterministic Parallel Global Optimization based on Gaussian Processes , 2008 .

[11]  James M. Parr,et al.  Infill sampling criteria for surrogate-based optimization with constraint handling , 2012 .

[12]  Qingfu Zhang,et al.  A multiobjective optimization based framework to balance the global exploration and local exploitation in expensive optimization , 2015, J. Glob. Optim..

[13]  Andy J. Keane,et al.  Enhancing infill sampling criteria for surrogate-based constrained optimization , 2012, J. Comput. Methods Sci. Eng..

[14]  A. Basudhar,et al.  Constrained efficient global optimization with support vector machines , 2012, Structural and Multidisciplinary Optimization.

[15]  Tapabrata Ray,et al.  A Decomposition-Based Evolutionary Algorithm for Many Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[16]  Klaus Schittkowski,et al.  More test examples for nonlinear programming codes , 1981 .

[17]  Susana Gómez,et al.  The tunnelling method for solving the constrained global optimization problem with several non-connected feasible regions , 1982 .

[18]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[19]  Hisao Ishibuchi,et al.  Evolutionary many-objective optimization , 2008, 2008 3rd International Workshop on Genetic and Evolving Systems.

[20]  Andy J. Keane,et al.  On the Design of Optimization Strategies Based on Global Response Surface Approximation Models , 2005, J. Glob. Optim..

[21]  Michael James Sasena,et al.  Flexibility and efficiency enhancements for constrained global design optimization with kriging approximations. , 2002 .

[22]  G. Gary Wang,et al.  Review of Metamodeling Techniques in Support of Engineering Design Optimization , 2007, DAC 2006.

[23]  Wolfgang Ponweiser,et al.  Clustered multiple generalized expected improvement: A novel infill sampling criterion for surrogate models , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).