A parallel constrained efficient global optimization algorithm for expensive constrained optimization problems

ABSTRACT The Constrained Expected Improvement (CEI) criterion used in the so-called Constrained Efficient Global Optimization (C-EGO) algorithm is one of the most famous infill criteria for expensive constrained optimization problems. However, the standard CEI criterion selects only one point to evaluate in each cycle, which is time consuming when parallel computing architecture is available. This work proposes a new Parallel Constrained EGO (PC-EGO) algorithm to extend the C-EGO algorithm to parallel computing. The proposed PC-EGO algorithm is tested on sixteen analytical problems as well as one real-world engineering problem. The experiment results show that the proposed PC-EGO algorithm converges significantly faster and finds better solutions on the test problems compared to the standard C-EGO algorithm. Moreover, when compared to another state-of-the-art parallel constrained EGO algorithm, the proposed PC-EGO algorithm shows more efficient and robust performance.

[1]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[2]  M. Sasena,et al.  Exploration of Metamodeling Sampling Criteria for Constrained Global Optimization , 2002 .

[3]  Zuomin Dong,et al.  A new Kriging–Bat Algorithm for solving computationally expensive black-box global optimization problems , 2019 .

[4]  Christine A. Shoemaker,et al.  Constrained Global Optimization of Expensive Black Box Functions Using Radial Basis Functions , 2005, J. Glob. Optim..

[5]  A. Jahangirian,et al.  A surrogate assisted evolutionary optimization method with application to the transonic airfoil design , 2010 .

[6]  Andy J. Keane,et al.  Recent advances in surrogate-based optimization , 2009 .

[7]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms for Constrained Parameter Optimization Problems , 1996, Evolutionary Computation.

[8]  William J. Welch,et al.  Computer experiments and global optimization , 1997 .

[9]  Christine A. Shoemaker,et al.  Influence of ensemble surrogate models and sampling strategy on the solution quality of algorithms for computationally expensive black-box global optimization problems , 2014, J. Glob. Optim..

[10]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[11]  R. Regis.  Constrained optimization by radial basis function interpolation for high-dimensional expensive black-box problems with infeasible initial points , 2014 .

[12]  C. Shoemaker,et al.  Combining radial basis function surrogates and dynamic coordinate search in high-dimensional expensive black-box optimization , 2013 .

[13]  Qingfu Zhang,et al.  A multiobjective optimization based framework to balance the global exploration and local exploitation in expensive optimization , 2015, J. Glob. Optim..

[14]  Jianqiao Chen,et al.  A surrogate-based particle swarm optimization algorithm for solving optimization problems with expensive black box functions , 2013 .

[15]  Yizhong Wu,et al.  An adaptive metamodel-based global optimization algorithm for black-box type problems , 2015 .

[16]  G. Gary Wang,et al.  Performance study of mode-pursuing sampling method , 2009 .

[17]  Andy J. Keane,et al.  Engineering Design via Surrogate Modelling - A Practical Guide , 2008 .

[18]  Layne T. Watson,et al.  Efficient global optimization algorithm assisted by multiple surrogate techniques , 2012, Journal of Global Optimization.

[19]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[20]  G. G. Wang,et al.  Adaptive Response Surface Method Using Inherited Latin Hypercube Design Points , 2003 .

[21]  Stephen J. Leary,et al.  A parallel updating scheme for approximating and optimizing high fidelity computer simulations , 2004 .

[22]  Rick Hesse.  A Heuristic Search Procedure for Estimating a Global Solution of Nonconvex Programming Problems , 1973, Oper. Res..

[23]  G. Gary Wang,et al.  Review of Metamodeling Techniques in Support of Engineering Design Optimization , 2007 .

[24]  G. G. Wang,et al.  Efficient adaptive response surface method using intelligent space exploration strategy , 2015 .

[25]  Ren-Jye Yang,et al.  Approximation methods in multidisciplinary analysis and optimization: a panel discussion , 2004 .

[26]  Charles Audet,et al.  A surrogate-model-based method for constrained optimization , 2000 .

[27]  Juliane Müller,et al.  GOSAC: global optimization with surrogate approximation of constraints , 2017, J. Glob. Optim..

[28]  D. Ginsbourger,et al.  Kriging is well-suited to parallelize optimization , 2010 .

[29]  Sébastien Le Digabel,et al.  Modeling an Augmented Lagrangian for Blackbox Constrained Optimization , 2014, Technometrics.

[30]  G. G. Wang,et al.  Mode-pursuing sampling method for global optimization on expensive black-box functions , 2004 .

[31]  Bernhard Sendhoff,et al.  A framework for evolutionary optimization with approximate fitness functions , 2002, IEEE Trans. Evol. Comput..

[32]  Shengli Xu,et al.  Constrained global optimization via a DIRECT-type constraint-handling technique and an adaptive metamodeling strategy , 2017 .

[33]  Timothy W. Simpson,et al.  Metamodeling in Multidisciplinary Design Optimization: How Far Have We Really Come? , 2014 .

[34]  Yuansheng Cheng,et al.  Pseudo expected improvement criterion for parallel EGO algorithm , 2017, J. Glob. Optim..

[35]  James M. Parr,et al.  Infill sampling criteria for surrogate-based optimization with constraint handling , 2012 .

[36]  G. Gary Wang,et al.  ADAPTIVE RESPONSE SURFACE METHOD - A GLOBAL OPTIMIZATION SCHEME FOR APPROXIMATION-BASED DESIGN PROBLEMS , 2001 .

[37]  K. Rashid,et al.  An adaptive multiquadric radial basis function method for expensive black-box mixed-integer nonlinear constrained optimization , 2013 .

[38]  Rommel G. Regis,et al.  Stochastic radial basis function algorithms for large-scale optimization involving expensive black-box objective and constraint functions , 2011, Comput. Oper. Res..

[39]  K. Gupta,et al.  Metamodel-Based Optimization for Problems With Expensive Objective and Constraint Functions , 2011 .

[40]  Zuomin Dong,et al.  Trends, features, and tests of common and recently introduced global optimization methods , 2010 .

[41]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[42]  Teng Long,et al.  Filter-Based Sequential Radial Basis Function Method for Spacecraft Multidisciplinary Design Optimization , 2019, AIAA Journal.