High-Dimensional Multi-Objective Optimization Using Co-operative Vector-Evaluated Particle Swarm Optimization with Random Variable Grouping

Vector-evaluated particle swarm optimization (VEPSO) is a particle swarm optimization (PSO) variant which employs multiple swarms to solve multi-objective optimization problems (MOPs). Each swarm optimizes a single objective and information is passed between swarms using a knowledge transfer strategy (KTS). The recently proposed co-operative VEPSO (CVEPSO) algorithm has been shown to improve the performance of VEPSO by decomposing the search space into subspaces of lower dimensionality. However, the effectiveness of CVEPSO is heavily dependent on the strategy used to group variables together, because isolating dependent variables leads to performance degradation. This paper explores the use of a random grouping technique within CVEPSO to increase the probability of allocating interacting variables to the same subcomponent. The results demonstrate that random grouping significantly improves performance of the CVEPSO algorithm, especially in high-dimensional environments. Additionally, CVEPSO with random grouping is shown to perform competitively with other top multi-objective optimization algorithms.

[1]  Xin Yao,et al.  Differential evolution for high-dimensional function optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[2]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[3]  Andries Petrus Engelbrecht,et al.  Co-operative Vector-Evaluated Particle Swarm Optimization for Multi-objective Optimization , 2015, 2015 IEEE Symposium Series on Computational Intelligence.

[4]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[5]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[6]  Andries Petrus Engelbrecht,et al.  Knowledge Transfer Strategies for Vector Evaluated Particle Swarm Optimization , 2013, EMO.

[7]  Kay Chen Tan,et al.  An Investigation on Noisy Environments in Evolutionary Multiobjective Optimization , 2007, IEEE Transactions on Evolutionary Computation.

[8]  H. B. Mann,et al.  On a Test of Whether one of Two Random Variables is Stochastically Larger than the Other , 1947 .

[9]  Xiaodong Li,et al.  Tackling high dimensional nonseparable optimization problems by cooperatively coevolving particle swarms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[10]  Winston Khoon Guan Seah,et al.  A performance study on synchronous and asynchronous updates in particle swarm optimization , 2011, GECCO '11.

[11]  Tad Hogg,et al.  Cooperative Problem solving , 1992, Computation: The Micro and the Macro View.

[12]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[13]  Konstantinos E. Parsopoulos,et al.  Parallel cooperative micro-particle swarm optimization: A master-slave model , 2012, Appl. Soft Comput..

[14]  Mohammed El-Abd,et al.  Discrete cooperative particle swarm optimization for FPGA placement , 2010, Appl. Soft Comput..

[15]  C.A. Coello Coello,et al.  MOPSO: a proposal for multiple objective particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[16]  Mohammed El-Abd,et al.  Cooperative models of particle swarm optimizers , 2008 .

[17]  R. Lyndon While,et al.  A Scalable Multi-objective Test Problem Toolkit , 2005, EMO.

[18]  Andries Petrus Engelbrecht,et al.  Multi-objective DE and PSO strategies for production scheduling , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[19]  Andries Petrus Engelbrecht,et al.  Cooperative learning in neural networks using particle swarm optimizers , 2000, South Afr. Comput. J..

[20]  Andries Petrus Engelbrecht,et al.  Particle swarm optimization: Velocity initialization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[21]  Yaochu Jin,et al.  Dynamic Weighted Aggregation for evolutionary multi-objective optimization: why does it work and how? , 2001 .

[22]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[23]  Andries Petrus Engelbrecht,et al.  Analysis of stagnation behavior of vector evaluated particle swarm optimization , 2013, 2013 IEEE Symposium on Swarm Intelligence (SIS).

[24]  Tim Hendtlass,et al.  Particle Swarm Optimisation and high dimensional problem spaces , 2009, 2009 IEEE Congress on Evolutionary Computation.

[25]  Mark Fleischer,et al.  The measure of pareto optima: Applications to multi-objective metaheuristics , 2003 .

[26]  R. W. Dobbins,et al.  Computational intelligence PC tools , 1996 .

[27]  Andries Petrus Engelbrecht,et al.  Cooperative particle swarm optimization in dynamic environments , 2013, 2013 IEEE Symposium on Swarm Intelligence (SIS).

[28]  Enrique Alba,et al.  SMPSO: A new PSO-based metaheuristic for multi-objective optimization , 2009, 2009 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making(MCDM).

[29]  M. N. Vrahatis,et al.  Particle swarm optimization method in multiobjective problems , 2002, SAC '02.

[30]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[31]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .