Ensemble particle swarm optimizer

Display Omitted Ensemble of particle swarm optimization algorithms with self-adaptive mechanism called EPSO is proposed in this paper.In EPSO, the population is divided into small and large subpopulations to enhance population diversity.In small subpopulation, comprehensive learning PSO (CLPSO) is used to preserve the population diversity.In large subpopulation, inertia weight PSO, CLPSO, FDR-PSO, HPSO-TVAC and LIPS are hybridized together as an ensemble approach.Self-adaptive mechanism is employed to identify the best algorithm by learning from their previous experiences so that best-performing algorithm is assigned to individuals in the large subpopulation. According to the No Free Lunch (NFL) theorem, there is no single optimization algorithm to solve every problem effectively and efficiently. Different algorithms possess capabilities for solving different types of optimization problems. It is difficult to predict the best algorithm for every optimization problem. However, the ensemble of different optimization algorithms could be a potential solution and more efficient than using one single algorithm for solving complex problems. Inspired by this, we propose an ensemble of different particle swarm optimization algorithms called the ensemble particle swarm optimizer (EPSO) to solve real-parameter optimization problems. In each generation, a self-adaptive scheme is employed to identify the top algorithms by learning from their previous experiences in generating promising solutions. Consequently, the best-performing algorithm can be determined adaptively for each generation and assigned to individuals in the population. The performance of the proposed ensemble particle swarm optimization algorithm is evaluated using the CEC2005 real-parameter optimization benchmark problems and compared with each individual algorithm and other state-of-the-art optimization algorithms to show the superiority of the proposed ensemble particle swarm optimization (EPSO) algorithm.

[1]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[2]  Andries Petrus Engelbrecht,et al.  An analysis of heterogeneous cooperative algorithms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[3]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[4]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[5]  Kenli Li,et al.  A Hybrid Chemical Reaction Optimization Scheme for Task Scheduling on Heterogeneous Computing Systems , 2015, IEEE Transactions on Parallel and Distributed Systems.

[6]  Russell C. Eberhart,et al.  Recent advances in particle swarm , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[7]  Subhabrata Chakraborti,et al.  Nonparametric Statistical Inference , 2011, International Encyclopedia of Statistical Science.

[8]  Graham Kendall,et al.  A Tabu-Search Hyperheuristic for Timetabling and Rostering , 2003, J. Heuristics.

[9]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[10]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[11]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2011, IEEE Trans. Evol. Comput..

[12]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[13]  Ponnuthurai N. Suganthan,et al.  Ensemble strategies with adaptive evolutionary programming , 2010, Inf. Sci..

[14]  James Kennedy,et al.  Bare bones particle swarms , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[15]  Zhijian Wu,et al.  Multi-strategy ensemble artificial bee colony algorithm , 2014, Inf. Sci..

[16]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[17]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[18]  Bruce A. Robinson,et al.  Self-Adaptive Multimethod Search for Global Optimization in Real-Parameter Spaces , 2009, IEEE Transactions on Evolutionary Computation.

[19]  Andries Petrus Engelbrecht,et al.  Alternative hyper-heuristic strategies for multi-method global optimization , 2010, IEEE Congress on Evolutionary Computation.

[20]  Andries Petrus Engelbrecht,et al.  A self-adaptive heterogeneous pso for real-parameter optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[21]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[22]  P. Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2010 Competition on Constrained Real- Parameter Optimization , 2010 .

[23]  Michael N. Vrahatis,et al.  Particle Swarm Optimization and Intelligence: Advances and Applications , 2010 .

[24]  Ponnuthurai N. Suganthan,et al.  A Distance-Based Locally Informed Particle Swarm Model for Multimodal Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[25]  William M. Spears,et al.  Adapting Crossover in Evolutionary Algorithms , 1995, Evolutionary Programming.

[26]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[27]  James Kennedy,et al.  The particle swarm: social adaptation of knowledge , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[28]  Byung Ro Moon,et al.  An empirical study on the synergy of multiple crossover operators , 2002, IEEE Trans. Evol. Comput..

[29]  Narasimhan Sundararajan,et al.  Dynamic mentoring and self-regulation based particle swarm optimization algorithm for solving complex real-world optimization problems , 2016, Inf. Sci..

[30]  Min-Yuan Cheng,et al.  Two-Phase Differential Evolution for the Multiobjective Optimization of Time–Cost Tradeoffs in Resource-Constrained Construction Projects , 2014, IEEE Transactions on Engineering Management.

[31]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[32]  Andries P. Engelbrecht.  Heterogeneous Particle Swarm Optimization , 2010, ANTS Conference.

[33]  Paulo Cesar Marques de Carvalho,et al.  Particle Swarm Optimization method for estimation of Weibull parameters: A case study for the Brazilian northeast region , 2016 .

[34]  Mitchell A. Potter,et al.  The design and analysis of a computational model of cooperative coevolution , 1997 .

[35]  Wenjun Wang,et al.  Multi-strategy ensemble artificial bee colony algorithm for large-scale production scheduling problem , 2015 .

[36]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[37]  Kalyan Veeramachaneni,et al.  Fitness-distance-ratio based particle swarm optimization , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[38]  Chukwudi Anyakoha,et al.  A review of particle swarm optimization. Part I: background and development , 2007, Natural Computing.

[39]  Andries Petrus Engelbrecht,et al.  Particle swarm optimization: an introduction and its recent developments , 2007, Annual Conference on Genetic and Evolutionary Computation.

[40]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[41]  James E. Baker,et al.  Reducing Bias and Inefficienry in the Selection Algorithm , 1987, ICGA.

[42]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[43]  Bin Li,et al.  Multi-strategy ensemble particle swarm optimization for dynamic optimization , 2008, Inf. Sci..

[44]  Thomas Stützle,et al.  Heterogeneous particle swarm optimizers , 2009, 2009 IEEE Congress on Evolutionary Computation.

[45]  Kenli Li,et al.  A genetic algorithm for task scheduling on heterogeneous computing systems using multiple priority queues , 2014, Inf. Sci..

[46]  Xu Zhou,et al.  Parallel hybrid PSO with CUDA for lD heat conduction equation , 2015 .