Constrained Bi-objective Surrogate-Assisted Optimization of Problems with Heterogeneous Evaluation Times: Expensive Objectives and Inexpensive Constraints

In the past years, a significant amount of research has been done in optimizing computationally expensive and time-consuming objective functions using various surrogate modeling approaches. Constraints have often been neglected or assumed to be a by-product of the expensive objective computation and thereby being available after executing the expensive evaluation routines. However, many optimization problems in practice have separately evaluable computationally inexpensive geometrical or physical constraint functions, while the objectives may still be time-consuming. This scenario probably makes the simplest case of handling heterogeneous and multi-scale surrogate modeling in the presence of constraints. In this paper, we propose a method which makes use of the inexpensiveness of constraints to ensure all time-consuming objective evaluations are only executed for feasible solutions. Results on test and real-world problems indicate that the proposed approach finds a widely distributed set of near-Pareto-optimal solutions with a small budget of expensive evaluations.

[1]  Joshua D. Knowles,et al.  'Hang On a Minute': Investigations on the Effects of Delayed Objective Functions in Multiobjective Optimization , 2013, EMO.

[2]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[3]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[4]  Kalyanmoy Deb,et al.  Generating Well-Spaced Points on a Unit Simplex for Evolutionary Many-Objective Optimization , 2020, IEEE Transactions on Evolutionary Computation.

[5]  Gabriele Eichfelder,et al.  A Trust-Region Algorithm for Heterogeneous Multiobjective Optimization , 2019, SIAM J. Optim..

[6]  Kalyanmoy Deb,et al.  Trust-Region Based Multi-objective Optimization for Low Budget Scenarios , 2019, EMO.

[7]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point Based Nondominated Sorting Approach, Part II: Handling Constraints and Extending to an Adaptive Approach , 2014, IEEE Transactions on Evolutionary Computation.

[8]  Thomas Bartz-Beielstein,et al.  Open Issues in Surrogate-Assisted Optimization , 2020, High-Performance Simulation-Based Optimization.

[9]  Singiresu S. Rao Engineering Optimization : Theory and Practice , 2010 .

[10]  Heinz Herwig,et al.  Diffuser and Nozzle Design Optimization by Entropy Generation Minimization , 2011, Entropy.

[11]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[12]  Kalyanmoy Deb,et al.  Pymoo: Multi-Objective Optimization in Python , 2020, IEEE Access.

[13]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[14]  Carlos A. Coello Coello,et al.  A Study of the Parallelization of a Coevolutionary Multi-objective Evolutionary Algorithm , 2004, MICAI.

[15]  E. Saff,et al.  Minimal Riesz Energy Point Configurations for Rectifiable d-Dimensional Manifolds , 2003, math-ph/0311024.

[16]  Damir Zarko,et al.  Optimization in design of electric machines: Methodology and workflow , 2015, 2015 Intl Aegean Conference on Electrical Machines & Power Electronics (ACEMP), 2015 Intl Conference on Optimization of Electrical & Electronic Equipment (OPTIM) & 2015 Intl Symposium on Advanced Electromechanical Motion Systems (ELECTROMOTION).

[17]  Kalyanmoy Deb,et al.  A Taxonomy for Metamodeling Frameworks for Evolutionary Multiobjective Optimization , 2019, IEEE Transactions on Evolutionary Computation.

[18]  Kalyanmoy Deb,et al.  Constrained Test Problems for Multi-objective Evolutionary Optimization , 2001, EMO.

[19]  Joshua D. Knowles,et al.  Multiobjective Optimization: When Objectives Exhibit Non-Uniform Latencies , 2015 .

[20]  Vesa Ojalehto,et al.  Surrogate-assisted evolutionary biobjective optimization for objectives with non-uniform latencies , 2018, GECCO.

[21]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[22]  Christine A. Shoemaker,et al.  pySOT and POAP: An event-driven asynchronous framework for surrogate optimization , 2019, ArXiv.

[23]  Yaochu Jin,et al.  Transfer learning for gaussian process assisted evolutionary bi-objective optimization for objectives with different evaluation times , 2020, GECCO.

[24]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[25]  Kaisa Miettinen,et al.  A Surrogate-Assisted Reference Vector Guided Evolutionary Algorithm for Computationally Expensive Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[26]  Kalyanmoy Deb,et al.  A proximity-based surrogate-assisted method for simulation-based design optimization of a cylinder head water jacket , 2020 .