Multiple Populations for Multiple Objectives: A Coevolutionary Technique for Solving Multiobjective Optimization Problems

Traditional multiobjective evolutionary algorithms (MOEAs) consider multiple objectives as a whole when solving multiobjective optimization problems (MOPs). However, this consideration may cause difficulty to assign fitness to individuals because different objectives often conflict with each other. In order to avoid this difficulty, this paper proposes a novel coevolutionary technique named multiple populations for multiple objectives (MPMO) when developing MOEAs. The novelty of MPMO is that it provides a simple and straightforward way to solve MOPs by letting each population correspond with only one objective. This way, the fitness assignment problem can be addressed because the individuals' fitness in each population can be assigned by the corresponding objective. MPMO is a general technique that each population can use existing optimization algorithms. In this paper, particle swarm optimization (PSO) is adopted for each population, and coevolutionary multiswarm PSO (CMPSO) is developed based on the MPMO technique. Furthermore, CMPSO is novel and effective by using an external shared archive for different populations to exchange search information and by using two novel designs to enhance the performance. One design is to modify the velocity update equation to use the search information found by different populations to approximate the whole Pareto front (PF) fast. The other design is to use an elitist learning strategy for the archive update to bring in diversity to avoid local PFs. CMPSO is comprehensively tested on different sets of benchmark problems with different characteristics and is compared with some state-of-the-art algorithms. The results show that CMPSO has superior performance in solving these different sets of MOPs.

[1]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[2]  Didier Dubois,et al.  Fuzzy sets and systems ' . Theory and applications , 2007 .

[3]  Ronald R. Yager,et al.  A procedure for ordering fuzzy subsets of the unit interval , 1981, Inf. Sci..

[4]  G. Owen,et al.  Game Theory (2nd Ed.). , 1983 .

[5]  J. D. Schaffer,et al.  Multiple Objective Optimization with Vector Evaluated Genetic Algorithms , 1985, ICGA.

[6]  J. Ramík,et al.  Inequality relation between fuzzy numbers and its use in fuzzy optimization , 1985 .

[7]  Peter J. Fleming,et al.  Genetic Algorithms for Multiobjective Optimization: FormulationDiscussion and Generalization , 1993, ICGA.

[8]  C. Fonseca,et al.  GENETIC ALGORITHMS FOR MULTI-OBJECTIVE OPTIMIZATION: FORMULATION, DISCUSSION, AND GENERALIZATION , 1993 .

[9]  M. Sakawa,et al.  Max-min solutions for fuzzy multiobjective matrix games , 1994 .

[10]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[11]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[12]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[13]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[14]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[15]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[16]  M. N. Vrahatis,et al.  Particle swarm optimization method in multiobjective problems , 2002, SAC '02.

[17]  Russell C. Eberhart,et al.  Multiobjective optimization using dynamic neighborhood particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[18]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[19]  Konstantinos E. Parsopoulos,et al.  MULTIOBJECTIVE OPTIMIZATION USING PARALLEL VECTOR EVALUATED PARTICLE SWARM OPTIMIZATION , 2003 .

[20]  Eugene P. W. Tam,et al.  Pseudo-coevolutionary genetic algorithms for power electronic circuits optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[21]  David W. Corne,et al.  Properties of an adaptive archiving algorithm for storing nondominated vectors , 2003, IEEE Trans. Evol. Comput..

[22]  Xiaodong Li,et al.  A Non-dominated Sorting Particle Swarm Optimizer for Multiobjective Optimization , 2003, GECCO.

[23]  Jürgen Teich,et al.  Strategies for finding good local guides in multi-objective particle swarm optimization (MOPSO) , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[24]  Yang Yang,et al.  A distributed cooperative coevolutionary algorithm for multiobjective optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[25]  Hung-Tat Tsui,et al.  Autonomous agent response learning by a multi-species particle swarm optimization , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[26]  Suresh Chandra,et al.  Duality in linear programming with fuzzy parameters and matrix games with fuzzy pay-offs , 2004, Fuzzy Sets Syst..

[27]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[28]  Kalyanmoy Deb,et al.  Dynamic multiobjective optimization problems: test cases, approximations, and applications , 2004, IEEE Transactions on Evolutionary Computation.

[29]  Kalyanmoy Deb,et al.  Parallelizing multi-objective evolutionary algorithms: cone separation , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[30]  Carlos A. Coello Coello,et al.  Improving PSO-Based Multi-objective Optimization Using Crowding, Mutation and epsilon-Dominance , 2005, EMO.

[31]  P. Hingston,et al.  A Scalable Multi-objective Test Problem Toolkit ( corrected version : 22 June 2005 ) , 2005 .

[32]  C. Coello,et al.  Improving PSO-based Multi-Objective Optimization using Crowding , Mutation and �-Dominance , 2005 .

[33]  Leandro dos Santos Coelho,et al.  Coevolutionary Particle Swarm Optimization Using Gaussian Distribution for Solving Constrained Optimization Problems , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  M Reyes Sierra,et al.  Multi-Objective Particle Swarm Optimizers: A Survey of the State-of-the-Art , 2006 .

[35]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[36]  Henry Shu-Hung Chung,et al.  Pseudocoevolutionary genetic algorithms for power electronic circuits optimization , 2006 .

[37]  Jürgen Branke,et al.  About Selecting the Personal Best in Multi-Objective Particle Swarm Optimization , 2006, PPSN.

[38]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for solving multiobjective optimization problems , 2006, Int. J. Intell. Syst..

[39]  Kay Chen Tan,et al.  An Investigation on Noisy Environments in Evolutionary Multiobjective Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[40]  M. Wade The co-evolutionary genetics of ecological communities , 2007, Nature Reviews Genetics.

[41]  Jun Zhang,et al.  Clustering-Based Adaptive Crossover and Mutation Probabilities for Genetic Algorithms , 2007, IEEE Transactions on Evolutionary Computation.

[42]  Rafael Caballero,et al.  SSPMO: A Scatter Tabu Search Procedure for Non-Linear Multiobjective Optimization , 2007, INFORMS J. Comput..

[43]  Yuren Zhou,et al.  Multiobjective Optimization and Hybrid Evolutionary Algorithm to Solve Constrained Optimization Problems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[44]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[45]  Ling Wang,et al.  A Hybrid Quantum-Inspired Genetic Algorithm for Multiobjective Flow Shop Scheduling , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[46]  Chiang Kao,et al.  Solution of fuzzy matrix games: An application of the extension principle , 2007, Int. J. Intell. Syst..

[47]  Kay Chen Tan,et al.  A Multiobjective Memetic Algorithm Based on Particle Swarm Optimization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[48]  Manuel P. Cuéllar,et al.  Multiobjective Hybrid Optimization and Training of Recurrent Neural Networks , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[49]  Gary G. Yen,et al.  PSO-Based Multiobjective Optimization With Dynamic Population Size and Adaptive Local Archives , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[50]  Mietek A. Brdys,et al.  Grid Implementation of a Parallel Multiobjective Genetic Algorithm for Optimized Allocation of Chlorination Stations in Drinking Water Distribution Systems: Chojnice Case Study , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[51]  Deng-Feng Li,et al.  Lexicographic Method for Matrix Games with Payoffs of Triangular Fuzzy Numbers , 2008, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[52]  Ronald R. Yager,et al.  Using trapezoids for representing granular objects: Applications to learning and OWA aggregation , 2008, Inf. Sci..

[53]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[54]  Chenyi Hu,et al.  Studying interval valued matrix games with fuzzy logic , 2008, Soft Comput..

[55]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, ANTS Conference.

[56]  Jouni Lampinen,et al.  Performance assessment of Generalized Differential Evolution 3 with a given set of constrained multi-objective test problems , 2009, 2009 IEEE Congress on Evolutionary Computation.

[57]  Byoung-Tak Zhang,et al.  EvoOligo: Oligonucleotide Probe Design With Multiobjective Evolutionary Algorithms , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[58]  Kay Chen Tan,et al.  A Coevolutionary Paradigm for Dynamic Multi-Objective Optimization , 2009 .

[59]  Jain-Shing Wu,et al.  Wireless Heterogeneous Transmitter Placement Using Multiobjective Variable-Length Genetic Algorithm , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[60]  Madhumangal Pal,et al.  Linear Programming Technique to Solve Two Person Matrix Games with Interval Pay-Offs , 2009, Asia Pac. J. Oper. Res..

[61]  Carlos A. Coello Coello,et al.  Multi-Objective Particle Swarm Optimizers: An Experimental Comparison , 2009, EMO.

[62]  Jun Zhang,et al.  An Ant Colony Optimization Approach to a Grid Workflow Scheduling Problem With Various QoS Requirements , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[63]  Gideon Avigad,et al.  Interactive Evolutionary Multiobjective Search and Optimization of Set-Based Concepts , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[64]  Kalyanmoy Deb,et al.  Reliability-Based Optimization Using Evolutionary Algorithms , 2009, IEEE Transactions on Evolutionary Computation.

[65]  Gary G. Yen,et al.  Dynamic Multiple Swarms in Multiobjective Particle Swarm Optimization , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[66]  P. Fleming,et al.  Convergence Acceleration Operator for Multiobjective Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[67]  Chiang Kao,et al.  Matrix games with interval data , 2009, Comput. Ind. Eng..

[68]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[69]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[70]  Moussa Larbani,et al.  Non cooperative fuzzy games in normal form: A survey , 2009, Fuzzy Sets Syst..

[71]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[72]  Lily Rachmawati,et al.  Incorporating the Notion of Relative Importance of Objectives in Evolutionary Multiobjective Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[73]  Andrew Kusiak,et al.  Multiobjective Optimization of Temporal Processes Minimum and Maximum Values of Sets D , 2022 .

[74]  Murat Köksalan,et al.  A Territory Defining Multiobjective Evolutionary Algorithms and Preference Incorporation , 2010, IEEE Transactions on Evolutionary Computation.

[75]  Jun Zhang,et al.  Self-adaptive differential evolution based on PSO learning strategy , 2010, GECCO '10.

[76]  Kay Chen Tan,et al.  A competitive and cooperative co-evolutionary approach to multi-objective particle swarm optimization algorithm design , 2010, Eur. J. Oper. Res..

[77]  Jun Zhang,et al.  A Novel Set-Based Particle Swarm Optimization Method for Discrete Optimization Problems , 2010, IEEE Transactions on Evolutionary Computation.

[78]  Maoguo Gong,et al.  Natural and Remote Sensing Image Segmentation Using Memetic Computing , 2010, IEEE Computational Intelligence Magazine.

[79]  Donald C. Wunsch,et al.  Memetic Mission Management [Application Notes] , 2010, IEEE Computational Intelligence Magazine.

[80]  Yew-Soon Ong,et al.  Memetic Computation—Past, Present & Future [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[81]  Ferrante Neri,et al.  Memetic Compact Differential Evolution for Cartesian Robot Control , 2010, IEEE Computational Intelligence Magazine.

[82]  Carlos A. Coello Coello,et al.  HCS: A New Local Search Strategy for Memetic Multiobjective Evolutionary Algorithms , 2010, IEEE Transactions on Evolutionary Computation.

[83]  Deng-Feng Li,et al.  Mathematical-Programming Approach to Matrix Games With Payoffs Represented by Atanassov's Interval-Valued Intuitionistic Fuzzy Sets , 2010, IEEE Transactions on Fuzzy Systems.

[84]  Jun Zhang,et al.  An Efficient Ant Colony System Based on Receding Horizon Control for the Aircraft Arrival Sequencing and Scheduling Problem , 2010, IEEE Transactions on Intelligent Transportation Systems.

[85]  Pramod K. Varshney,et al.  A Multiobjective Optimization Approach to Obtain Decision Thresholds for Distributed Detection in Wireless Sensor Networks , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[86]  Lothar Thiele,et al.  On Set-Based Multiobjective Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[87]  Zhen Ji,et al.  Towards a Memetic Feature Selection Paradigm [Application Notes] , 2010, IEEE Computational Intelligence Magazine.

[88]  Jun Zhang,et al.  Hybrid Genetic Algorithm Using a Forward Encoding Scheme for Lifetime Maximization of Wireless Sensor Networks , 2010, IEEE Transactions on Evolutionary Computation.

[89]  Yang Liu,et al.  An Approach to Solve Group-Decision-Making Problems With Ordinal Interval Numbers , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[90]  Qingfu Zhang,et al.  Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model , 2010, IEEE Transactions on Evolutionary Computation.

[91]  Snehasis Mukhopadhyay,et al.  Decentralized Indirect Methods for Learning Automata Games , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[92]  Dengfeng Li Linear programming approach to solve interval-valued matrix games , 2011 .

[93]  M. Dufwenberg Game theory. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[94]  Dongbing Gu,et al.  A Game Theory Approach to Target Tracking in Sensor Networks , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[95]  Jun Zhang,et al.  Evolutionary Computation Meets Machine Learning: A Survey , 2011, IEEE Computational Intelligence Magazine.

[96]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[97]  Jun Zhang,et al.  Co-evolutionary differential evolution with dynamic population size and adaptive migration strategy , 2011, GECCO '11.

[98]  Jun Zhang,et al.  Enhance differential evolution with random walk , 2012, GECCO '12.

[99]  Jun Zhang,et al.  An Ant Colony Optimization Approach for Maximizing the Lifetime of Heterogeneous Wireless Sensor Networks , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[100]  Zhi-Hui Zhan,et al.  An Efficient Resource Allocation Scheme Using Particle Swarm Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[101]  Xiaodong Li,et al.  Cooperatively Coevolving Particle Swarms for Large Scale Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[102]  Meie Shen,et al.  A Differential Evolution Algorithm With Dual Populations for Solving Periodic Railway Timetable Scheduling Problem , 2013, IEEE Transactions on Evolutionary Computation.

[103]  Ying Lin,et al.  Particle Swarm Optimization With an Aging Leader and Challengers , 2013, IEEE Transactions on Evolutionary Computation.