Performance measures for dynamic multi-objective optimisation algorithms

When algorithms solve dynamic multi-objective optimisation problems (DMOOPs), performance measures are required to quantify the performance of the algorithm and to compare one algorithm’s performance against that of othe r algorithms. However, for dynamic multi-objective optimisation (DMOO) there are no standard performance measures. This article provides an overview of the performance measures that have been used so far. In addition, issues with performance measures that are currently being used in the DMOO literature are highlighted.

[1]  Pascal Bouvry,et al.  On dynamic multi-objective optimization, classification and performance measures , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[2]  Enrique Alba,et al.  Quantitative Performance Measures for Dynamic Optimization Problems , 2013, Metaheuristics for Dynamic Optimization.

[3]  David Wallace,et al.  Dynamic multi-objective optimization with evolutionary algorithms: a forward-looking approach , 2006, GECCO '06.

[4]  Bin Li,et al.  Investigation of memory-based multi-objective optimization evolutionary algorithm in dynamic environment , 2009, 2009 IEEE Congress on Evolutionary Computation.

[5]  Julio Ortega Lopera,et al.  A single front genetic algorithm for parallel multi-objective optimization in dynamic environments , 2009, Neurocomputing.

[6]  Mario Cámara Sola,et al.  Parallel processing for dynamic multi-objetive optimization , 2010 .

[7]  Tapabrata Ray,et al.  Development of a memetic algorithm for Dynamic Multi-Objective Optimization and its applications for online neural network modeling of UAVs , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[8]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[9]  Kalyanmoy Deb,et al.  Dynamic Multi-objective Optimization and Decision-Making Using Modified NSGA-II: A Case Study on Hydro-thermal Power Scheduling , 2007, EMO.

[10]  Amir Nakib,et al.  Performance Analysis of Dynamic Optimization Algorithms , 2013, Metaheuristics for Dynamic Optimization.

[11]  Andries Petrus Engelbrecht,et al.  Archive management for dynamic multi-objective optimisation problems using vector evaluated particle swarm optimisation , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[12]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[13]  Nicola Beume,et al.  S-Metric Calculation by Considering Dominated Hypervolume as Klee's Measure Problem , 2009, Evolutionary Computation.

[14]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[15]  Carlos A. Coello Coello,et al.  Improving PSO-Based Multi-objective Optimization Using Crowding, Mutation and epsilon-Dominance , 2005, EMO.

[16]  Michael Kirley,et al.  A Pareto following variation operator for evolutionary dynamic multi-objective optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[17]  Maximino Salazar Lechuga,et al.  Multi-objective optimisation using sharing in swarm optimisation algorithms , 2009 .

[18]  Bojin Zheng,et al.  A New Dynamic Multi-objective Optimization Evolutionary Algorithm , 2007, Third International Conference on Natural Computation (ICNC 2007).

[19]  A. K. M. Khaled Ahsan Talukder,et al.  Towards high speed multiobjective evolutionary optimizers , 2008, GECCO '08.

[20]  Karsten Weicker,et al.  Performance Measures for Dynamic Environments , 2002, PPSN.

[21]  Shengxiang Yang,et al.  Metaheuristics for dynamic combinatorial optimization problems. , 2013 .

[22]  Andries Petrus Engelbrecht,et al.  Issues with performance measures for dynamic multi-objective optimisation , 2013, 2013 IEEE Symposium on Computational Intelligence in Dynamic and Uncertain Environments (CIDUE).

[23]  Kay Chen Tan,et al.  A Coevolutionary Paradigm for Dynamic Multi-Objective Optimization , 2009 .

[24]  Tapabrata Ray,et al.  Memetic algorithm for dynamic bi-objective optimization problems , 2009, 2009 IEEE Congress on Evolutionary Computation.

[25]  Yuhui Shi,et al.  On the Performance Metrics of Multiobjective Optimization , 2012, ICSI.

[26]  Ba-Ngu Vo,et al.  A Consistent Metric for Performance Evaluation of Multi-Object Filters , 2008, IEEE Transactions on Signal Processing.

[27]  Xiaodong Li,et al.  On performance metrics and particle swarm methods for dynamic multiobjective optimization problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[28]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[29]  Qingfu Zhang,et al.  Prediction-Based Population Re-initialization for Evolutionary Dynamic Multi-objective Optimization , 2007, EMO.

[30]  Andries Petrus Engelbrecht,et al.  Dynamic Multi-objective Optimisation Using PSO , 2010, Multi-Objective Swarm Intelligent System.

[31]  Byung Ro Moon,et al.  Multiobjective evolutionary algorithms for dynamic social network clustering , 2010, GECCO '10.

[32]  Steven Guan,et al.  Evolving Dynamic Multi-Objective Optimization Problems with Objective Replacement , 2005, Artificial Intelligence Review.

[33]  E. Thorndike On the Organization of Intellect. , 1921 .

[34]  José Luis Risco-Martín,et al.  On the performance comparison of multi-objective evolutionary UAV path planners , 2013, Inf. Sci..

[35]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[36]  Bin Li,et al.  Multi-strategy ensemble evolutionary algorithm for dynamic multi-objective optimization , 2010, Memetic Comput..

[37]  Rajkumar Buyya,et al.  A pareto following variation operator for fast-converging multiobjective evolutionary algorithms , 2008, GECCO '08.

[38]  Günter Rudolph,et al.  Evolutionary Optimization of Dynamic Multiobjective Functions , 2006 .

[39]  Yuping Wang,et al.  U-measure: a quality measure for multiobjective programming , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[40]  Pinar Çivicioglu,et al.  Artificial cooperative search algorithm for numerical optimization problems , 2013, Inf. Sci..

[41]  Julio Ortega Lopera,et al.  Approaching Dynamic Multi-Objective Optimization Problems by Using Parallel Evolutionary Algorithms , 2010, Advances in Multi-Objective Nature Inspired Computing.

[42]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[43]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[44]  M. Hansen,et al.  Evaluating the quality of approximations to the non-dominated set , 1998 .

[45]  Kalyanmoy Deb,et al.  Dynamic multiobjective optimization problems: test cases, approximations, and applications , 2004, IEEE Transactions on Evolutionary Computation.

[46]  Julio Ortega Lopera,et al.  Parallel Processing for Multi-objective Optimization in Dynamic Environments , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[47]  R. Rosenthal Concepts, Theory, and Techniques PRINCIPLES OF MULTIOBJECTIVE OPTIMIZATION* , 1985 .

[48]  Kay Chen Tan,et al.  A Competitive-Cooperative Coevolutionary Paradigm for Dynamic Multiobjective Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[49]  R. Stephenson A and V , 1962, The British journal of ophthalmology.

[50]  Andries Petrus Engelbrecht,et al.  Particle swarm optimization: Velocity initialization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[51]  Kalyanmoy Deb,et al.  A Computationally Efficient Evolutionary Algorithm for Real-Parameter Optimization , 2002, Evolutionary Computation.

[52]  Hugo de Garis,et al.  A Dynamic Multi-Objective Evolutionary Algorithm Based on an Orthogonal Design , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[53]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[54]  Kalyanmoy Deb,et al.  Dynamic Multiobjective Optimization Problems: Test Cases, Approximation, and Applications , 2003, EMO.

[55]  Jason R. Schott Fault Tolerant Design Using Single and Multicriteria Genetic Algorithm Optimization. , 1995 .

[56]  Zhuhong Zhang,et al.  Artificial immune system in dynamic environments solving time-varying non-linear constrained multi-objective problems , 2011, Soft Comput..

[57]  Chun-an Liu New Dynamic Multiobjective Evolutionary Algorithm with Core Estimation of Distribution , 2010, 2010 International Conference on Electrical and Control Engineering.

[58]  Eckart Zitzler,et al.  Evolutionary algorithms for multiobjective optimization: methods and applications , 1999 .

[59]  Richard E. Rosenthal,et al.  Principles of multiobjective optimization , 1984 .

[60]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[61]  Tapabrata Ray,et al.  A Memetic Algorithm for Dynamic Multiobjective Optimization , 2009 .

[62]  Haluk Topcuoglu,et al.  Performance evaluation of evolutionary heuristics in dynamic environments , 2011, Applied Intelligence.

[63]  Jinhua Zheng,et al.  Achieving balance between proximity and diversity in multi-objective evolutionary algorithm , 2012, Inf. Sci..

[64]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[65]  C. Coello,et al.  Improving PSO-based Multi-Objective Optimization using Crowding , Mutation and �-Dominance , 2005 .

[66]  Zikrija Avdagic,et al.  Evolutionary Approach to Solving Non-stationary Dynamic Multi-Objective Problems , 2009, Foundations of Computational Intelligence.

[67]  Xi Chen,et al.  Using Diversity as an Additional-objective in Dynamic Multi-objective Optimization Algorithms , 2009, 2009 Second International Symposium on Electronic Commerce and Security.

[68]  Yuping Wang,et al.  An evolutionary algorithm for dynamic multi-objective optimization , 2008, Appl. Math. Comput..

[69]  Aluizio F. R. Araújo,et al.  Generalized immigration schemes for dynamic evolutionary multiobjective optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[70]  Lothar Thiele,et al.  The Hypervolume Indicator Revisited: On the Design of Pareto-compliant Indicators Via Weighted Integration , 2007, EMO.

[71]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[72]  Carlos M. Fonseca,et al.  An Improved Dimension-Sweep Algorithm for the Hypervolume Indicator , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[73]  Francisco de Toro,et al.  The Parallel Single Front Genetic Algorithm (PSFGA) in Dynamic Multi-objective Optimization , 2007, IWANN.

[74]  Joshua D. Knowles Local-search and hybrid evolutionary algorithms for Pareto optimization , 2002 .

[75]  Kay Chen Tan,et al.  Handling Uncertainties in Evolutionary Multi-Objective Optimization , 2008, WCCI.

[76]  Kay Chen Tan,et al.  A predictive gradient strategy for multiobjective evolutionary algorithms in a fast changing environment , 2010, Memetic Comput..

[77]  Andries Petrus Engelbrecht,et al.  Solving dynamic multi-objective problems with vector evaluated particle swarm optimisation , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[78]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[79]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .