Multiobjective Optimization: When Objectives Exhibit Non-Uniform Latencies

Building on recent work by the authors, we consider the problem of performing multiobjective optimization when the objective functions of a problem have differing evaluation times (or latencies). This has general relevance to applications since objective functions do vary greatly in their latency, and there is no reason to expect equal latencies for the objectives in a single problem. To deal with this issue, we provide a general problem definition and suitable notation for describing algorithm schemes that can use different evaluation budgets for each objective. We propose three schemes for the bi-objective version of the problem, including methods that interleave the evaluations of different objectives. All of these can be instantiated with existing multiobjective evolutionary algorithms (MOEAs). In an empirical study we use an indicator-based evolutionary algorithm (IBEA) as the MOEA platform to study performance on several benchmark test functions. Our findings generally show that the default approach of going at the rate of the slow objective is not competitive with our more advanced ones (interleaving evaluations) for most scenarios.

[1]  Peter Ross,et al.  Improving Evolutionary Timetabling with Delta Evaluation and Directed Mutation , 1994, PPSN.

[2]  Richard Allmendinger,et al.  Tuning evolutionary search for closed-loop optimization , 2012 .

[3]  Sébastien Vérel,et al.  Pareto Local Optima of Multiobjective NK-Landscapes with Correlated Objectives , 2011, EvoCOP.

[4]  M. Repetto,et al.  A parallel simulated annealing algorithm for the design of magnetic structures , 1994 .

[5]  Kok Wai Wong,et al.  Surrogate-Assisted Evolutionary Optimization Frameworks for High-Fidelity Engineering Design Problems , 2005 .

[6]  Joshua D. Knowles,et al.  Policy learning in resource-constrained optimization , 2011, GECCO '11.

[7]  V. L. Anderson Evolutionary Operation : A Method for Increasing Industrial Productivity , 1970 .

[8]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[9]  Hana Teresa Chmielewski Satisfying Multiple Priorities with a Diversity Preserving Evolutionary Algorithm. , 2013 .

[10]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[11]  L. Altenberg The evolution of evolvability in genetic programming , 1994 .

[12]  Mark A. Bedau,et al.  Automated Discovery of Novel Drug Formulations Using Predictive Iterated High Throughput Experimentation , 2010, PloS one.

[13]  Joshua D. Knowles,et al.  'Hang On a Minute': Investigations on the Effects of Delayed Objective Functions in Multiobjective Optimization , 2013, EMO.

[14]  Stuart A. Kauffman,et al.  ORIGINS OF ORDER , 2019, Origins of Order.

[15]  Kiyoshi Tanaka,et al.  Working principles, behavior, and performance of MOEAs on MNK-landscapes , 2007, Eur. J. Oper. Res..

[16]  Eckart Zitzler,et al.  Evolutionary algorithms for multiobjective optimization: methods and applications , 1999 .

[17]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[18]  Ingo Rechenberg,et al.  Case studies in evolutionary experimentation and computation , 2000 .

[19]  Sungho Kim,et al.  An evaluation of parallel simulated annealing strategies with application to standard cell placement , 1997, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[20]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[21]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.

[22]  Marco Laumanns,et al.  Running time analysis of multiobjective evolutionary algorithms on pseudo-Boolean functions , 2004, IEEE Transactions on Evolutionary Computation.

[23]  Thomas Jansen,et al.  Performance analysis of randomised search heuristics operating with a fixed budget , 2014, Theor. Comput. Sci..

[24]  Keiki Takadama,et al.  Asynchronously evolving solutions with excessively different evaluation time by reference-based evaluation , 2014, GECCO.

[25]  Joshua D. Knowles,et al.  Local search for the probabilistic traveling salesman problem: Correction to the 2-p-opt and 1-shift algorithms , 2005, Eur. J. Oper. Res..

[26]  Eckart Zitzler,et al.  Objective Reduction in Evolutionary Multiobjective Optimization: Theory and Applications , 2009, Evolutionary Computation.

[27]  M. Friedman The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[28]  Lothar Thiele,et al.  Quality Assessment of Pareto Set Approximations , 2008, Multiobjective Optimization.

[29]  Walter Alden Tackett,et al.  The unique implications of brood selection for genetic programming , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[30]  Thomas Stützle,et al.  A Two-Phase Local Search for the Biobjective Traveling Salesman Problem , 2003, EMO.

[31]  Peter J. Fleming,et al.  On the Performance Assessment and Comparison of Stochastic Multiobjective Optimizers , 1996, PPSN.

[32]  Tim Walters,et al.  Repair and Brood Selection in the Traveling Salesman Problem , 1998, PPSN.

[33]  Thomas Jansen,et al.  UNIVERSITY OF DORTMUND REIHE COMPUTATIONAL INTELLIGENCE COLLABORATIVE RESEARCH CENTER 531 Design and Management of Complex Technical Processes and Systems by means of Computational Intelligence Methods Upper and Lower Bounds for Randomized Search Heuristics in Black-Box Optimization , 2004 .

[34]  Andrew Lewis,et al.  Asynchronous Multi-Objective Optimisation in Unreliable Distributed Environments , 2009 .

[35]  Antonio J. Nebro,et al.  jMetal: A Java framework for multi-objective optimization , 2011, Adv. Eng. Softw..

[36]  Benjamin Doerr,et al.  Lessons from the black-box: fast crossover-based genetic algorithms , 2013, GECCO '13.

[37]  Joshua D. Knowles,et al.  On Handling Ephemeral Resource Constraints in Evolutionary Search , 2013, Evolutionary Computation.

[38]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[39]  Joshua D. Knowles,et al.  Efficient discovery of anti-inflammatory small molecule combinations using evolutionary computing , 2011, Nature chemical biology.

[40]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[41]  Jonathan E. Fieldsend,et al.  Efficiently identifying pareto solutions when objective values change , 2014, GECCO.