Coevolutionary Multiobjective Evolutionary Algorithms: Survey of the State-of-the-Art

In the last 20 years, Evolutionary Algorithms (EAs) have shown to be an effective method to solve Multi-objective Optimization Problems (MOPs). Due to their population-based nature, Multi-objective Evolutionary Algorithms (MOEAs) are able to generate a set of trade-off solutions (called nondominated solutions) in a single algorithmic execution instead of having to perform a series of independent executions, as normally done with mathematical programming techniques. Additionally, MOEAs can be successfully applied to problems with difficult features such as multifrontality, discontinuity and disjoint feasible regions, among others. On the other hand, Coevolutionary algorithms (CAs) are extensions of traditional evolutionary algorithms (EAs) which have become subject of numerous studies in the last few years, particularly for dealing with large scale global optimization problems. CAs have also been applied to the solution of MOPs, motivating the development of new algorithmic and analytical formulations that have advanced the state of the art in coevolutionary algorithms research, while simultaneously opening a new research path within MOEAs. This paper presents a critical review of the most representative Coevolutionary MOEAs (CMOEAs) that have been reported in the specialized literature. This survey includes a taxonomy of approaches together with a brief description of their main features. In the final part of the paper, we also identify what we believe to be promising areas of future research in the field of CMOEAs.

[1]  J. Nash.  NON-COOPERATIVE GAMES , 1951, Classics in Game Theory.

[2]  P. Raven,et al.  BUTTERFLIES AND PLANTS: A STUDY IN COEVOLUTION , 1964 .

[3]  W. Daniel Hillis,et al.  Co-evolving parasites improve simulated evolution as an optimization procedure , 1990 .

[4]  Peter J. Fleming,et al.  Genetic Algorithms for Multiobjective Optimization: FormulationDiscussion and Generalization , 1993, ICGA.

[5]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[6]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[7]  Jan Paredis,et al.  Coevolutionary computation , 1995 .

[8]  Jason R. Schott.  Fault Tolerant Design Using Single and Multicriteria Genetic Algorithm Optimization. , 1995 .

[9]  Dave Cliff,et al.  Tracking the Red Queen: Measurements of Adaptive Progress in Co-Evolutionary Simulations , 1995, ECAL.

[10]  Richard K. Belew,et al.  New Methods for Competitive Coevolution , 1997, Evolutionary Computation.

[11]  J. Pollack,et al.  Challenges in coevolutionary learning: arms-race dynamics, open-endedness, and medicocre stable states , 1998 .

[12]  Marco Laumanns,et al.  A Spatial Predator-Prey Approach to Multi-objective Optimization: A Preliminary Study , 1998, PPSN.

[13]  Stefano Nolfi,et al.  Co-evolving predator and prey robots , 1998, Artificial Life.

[14]  Ian C. Parmee,et al.  Preliminary airframe design using co-evolutionary multiobjective genetic algorithms , 1999 .

[15]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithms: classifications, analyses, and new innovations , 1999 .

[16]  David Corne,et al.  The Pareto archived evolution strategy: a new baseline algorithm for Pareto multiobjective optimisation , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[17]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[18]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[19]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[20]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[21]  D.A. Van Veldhuizen,et al.  On measuring multiobjective evolutionary algorithm performance , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[22]  David W. Corne,et al.  Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy , 2000, Evolutionary Computation.

[23]  J. Pollack,et al.  Coevolutionary dynamics in a minimal substrate , 2001 .

[24]  Carlos A. Coello Coello,et al.  A Micro-Genetic Algorithm for Multiobjective Optimization , 2001, EMO.

[25]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[26]  Helio J. C. Barbosa,et al.  An interactive genetic algorithm with co-evolution of weights for multiobjective problems , 2001 .

[27]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[28]  Nachol Chaiyaratana,et al.  Multi-objective Co-operative Co-evolutionary Genetic Algorithm , 2002, PPSN.

[29]  Gary L. Haith,et al.  Comparing a coevolutionary genetic algorithm for multiobjective optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[30]  Carlos A. Coello Coello,et al.  A coevolutionary multi-objective evolutionary algorithm , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[31]  Xiaodong Li,et al.  A Real-Coded Predator-Prey Genetic Algorithm for Multiobjective Optimization , 2003, EMO.

[32]  Tong Heng Lee,et al.  A cooperative coevolutionary algorithm for multiobjective optimization , 2003, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[33]  Carlos A. Coello Coello,et al.  A Study of the Parallelization of a Coevolutionary Multi-objective Evolutionary Algorithm , 2004, MICAI.

[34]  R. Paul Wiegand,et al.  A Sensitivity Analysis of a Cooperative Coevolutionary Algorithm Biased for Optimization , 2004, GECCO.

[35]  Kittipong Boonlong,et al.  Multi-objective Optimisation by Co-operative Co-evolution , 2004, PPSN.

[36]  Edwin D. de Jong,et al.  Intransitivity in Coevolution , 2004, PPSN.

[37]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[38]  Seth Bullock,et al.  Combating Coevolutionary Disengagement by Reducing Parasite Virulence , 2004, Evolutionary Computation.

[39]  Xiaodong Li,et al.  A Cooperative Coevolutionary Multiobjective Algorithm Using Non-dominated Sorting , 2004, GECCO.

[40]  Kwee-Bo Sim,et al.  Game Theory Based Coevolutionary Algorithm: A New Computational Coevolutionary Approach , 2004 .

[41]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[42]  Carlos A. Coello Coello,et al.  Solving Multiobjective Optimization Problems Using an Artificial Immune System , 2005, Genetic Programming and Evolvable Machines.

[43]  Jörn Mehnen,et al.  Using predators and preys in evolution strategies , 2005, GECCO '05.

[44]  Jongsoo Lee,et al.  A method of genetic algorithm based multiobjective optimization via cooperative coevolution , 2006 .

[45]  Christian Grimme,et al.  Inside a predator-prey model for multi-objective optimization: a second study , 2006, GECCO '06.

[46]  Gary B. Lamont,et al.  Coevolutionary Multi-Objective EAs: The Next Frontier? , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[47]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[48]  Kay Chen Tan,et al.  A distributed Cooperative coevolutionary algorithm for multiobjective optimization , 2006, IEEE Transactions on Evolutionary Computation.

[49]  Jason Teo,et al.  Performance Scalability of a Cooperative Coevolution Multiobjective Evolutionary Algorithm , 2007, 2007 International Conference on Computational Intelligence and Security (CIS 2007).

[50]  Jason Teo,et al.  Cooperative Versus Competitive Coevolution for Pareto Multiobjective Optimization , 2007, LSMS.

[51]  Tse Guan Tan,et al.  Cooperative coevolution for pareto multiobjective optimization: An empirical study using SPEA2 , 2007, TENCON 2007 - 2007 IEEE Region 10 Conference.

[52]  Jason Teo,et al.  Competitive Coevolution with K-Random Opponents for Pareto Multiobjective Optimization , 2007, Third International Conference on Natural Computation (ICNC 2007).

[53]  Leszek Siwik,et al.  Co-evolutionary Multi-agent System with Predator-Prey Mechanism for Multi-objective Optimization , 2007, ICANNGA.

[54]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[55]  Sevan G. Ficici,et al.  Multiobjective Optimization and Coevolution , 2008, Multiobjective Problem Solving from Nature.

[56]  Jason Teo,et al.  Evolving Opposition-Based Pareto Solutions: Multiobjective Optimization Using Competitive Coevolution , 2008, Oppositional Concepts in Computational Intelligence.

[57]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[58]  Christian Grimme,et al.  The Parallel Predator-Prey Model: A Step towards Practical Application , 2008, PPSN.

[59]  Janez Brest,et al.  Large Scale Global Optimization using Differential Evolution with self-adaptation and cooperative co-evolution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[60]  George S. Dulikravich,et al.  Modified predator-prey algorithm for constrained and unconstrained multi-objective optimisation , 2009, Int. J. Math. Model. Numer. Optimisation.

[61]  Jason Teo,et al.  Improving the Performance of Multiobjective Evolutionary Optimization Algorithms Using Coevolutionary Learning , 2009, Nature-Inspired Algorithms for Optimisation.

[62]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[63]  Jian-guo Liu.  Competitive Coevolutionary Genetic Algorithms for Multiobjective Optimization Problems , 2009, 2009 International Conference on Artificial Intelligence and Computational Intelligence.

[64]  Jong-Shi Pang,et al.  Foreword: Special issue on nonlinear programming, variational inequalities, and stochastic programming , 2008, Math. Program..

[65]  Kay Chen Tan,et al.  A competitive and cooperative co-evolutionary approach to multi-objective particle swarm optimization algorithm design , 2010, Eur. J. Oper. Res..

[66]  Jianguo Liu,et al.  Multiobjective optimization with competitive coevolutionary genetic algorithms , 2010, Proceedings of the 29th Chinese Control Conference.

[67]  Xiaodong Li,et al.  Cooperative Co-evolution for large scale optimization through more frequent random grouping , 2010, IEEE Congress on Evolutionary Computation.

[68]  Pascal Bouvry,et al.  Multi-objective Cooperative Coevolutionary Evolutionary Algorithms for Continuous and Combinatorial Optimization , 2011, Intelligent Decision Systems in Large-Scale Distributed Environments.

[69]  Yujun Zheng,et al.  Cooperative particle swarm optimization for multiobjective transportation planning , 2012, Applied Intelligence.

[70]  Carlos A. Coello Coello,et al.  Use of cooperative coevolution for solving large scale multiobjective optimization problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[71]  Peter J. Fleming,et al.  Preference-Inspired Coevolutionary Algorithms for Many-Objective Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[72]  Man Leung Wong,et al.  Data Mining Using Parallel Multi-objective Evolutionary Algorithms on Graphics Processing Units , 2013, Massively Parallel Evolutionary Computation on GPGPUs.

[73]  Ziad Kobti,et al.  A new strategy to detect variable interactions in large scale global optimization , 2014, 2014 IEEE Symposium on Swarm Intelligence.

[74]  Hussein A. Abbass,et al.  MOCCA-II: A multi-objective co-operative co-evolutionary algorithm , 2014, Appl. Soft Comput..

[75]  Peter J. Fleming,et al.  Preference-inspired co-evolutionary algorithms using weight vectors , 2015, Eur. J. Oper. Res..

[76]  Yi Liu,et al.  Multiobjective nondominated neighbor coevolutionary algorithm with elite population , 2015, Soft Comput..

[77]  Xin Yao,et al.  Two_Arch2: An Improved Two-Archive Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[78]  Carlos A. Coello Coello,et al.  A non-cooperative game for faster convergence in cooperative coevolution for multi-objective optimization , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[79]  Frederico G. Guimarães,et al.  Competitive coevolutionary algorithm for robust multi-objective optimization: The worst case minimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[80]  Carlos A. Coello Coello,et al.  Indicator-based cooperative coevolution for multi-objective optimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[81]  Shengxiang Yang,et al.  Pareto or Non-Pareto: Bi-Criterion Evolution in Multiobjective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[82]  Weiwei Zhang,et al.  Cooperative Differential Evolution With Multiple Populations for Multiobjective Optimization , 2016, IEEE Transactions on Cybernetics.

[83]  Maoguo Gong,et al.  A Multiobjective Cooperative Coevolutionary Algorithm for Hyperspectral Sparse Unmixing , 2017, IEEE Transactions on Evolutionary Computation.