An improved particle swarm optimizer with difference mean based perturbation

Concept of the particle swarms emerged from a simulation of the collective behavior of social creatures and gradually evolved into a powerful global optimization technique, now well-known as the Particle Swarm Optimization (PSO). PSO is arguably one of the most popular nature-inspired algorithms for real parameter optimization at present. The very basic PSO model does not ensure convergence to an optimal solution and it also suffers from its dependency on external parameters like acceleration parameters and inertia weight. Owing to its comparatively poor efficiency, a multitude of measures has been taken by the researchers to improve the performance of PSO. This paper presents a scheme to modify the very basic framework of PSO by the introduction of a novel dimensional mean based perturbation strategy, a simple aging guideline, and a set of nonlinearly time-varying acceleration coefficients to achieve a better tradeoff between explorative and exploitative tendencies and thus to avoid premature convergence on multimodal fitness landscapes. The aging guideline is used to introduce fresh solutions in the swarm when particles show no further improvement. A systematically rendered comparison between the proposed PSO framework and several other state-of-the-art PSO-variants as well as evolutionary algorithms on a test-suite comprising 16 standard numerical benchmarks and two real world problems indicates that the proposed algorithm can enjoy a statistically superior performance on a wide variety of problems.

[1]  Salman Mohagheghi,et al.  Particle Swarm Optimization: Basic Concepts, Variants and Applications in Power Systems , 2008, IEEE Transactions on Evolutionary Computation.

[2]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[3]  Russell C. Eberhart,et al.  Multiobjective optimization using dynamic neighborhood particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[4]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[5]  Riccardo Poli,et al.  Analysis of the publications on the applications of particle swarm optimisation , 2008 .

[6]  Jiuyue Xu,et al.  Blade layers optimization of wind turbines using FAST and improved PSO Algorithm , 2012 .

[7]  H. Shayeghi,et al.  Discrete PSO algorithm based optimization of transmission lines loading in TNEP problem , 2010 .

[8]  Yuping Wang,et al.  An orthogonal genetic algorithm with quantization for global numerical optimization , 2001, IEEE Trans. Evol. Comput..

[9]  Jie Chen,et al.  Hybridizing Differential Evolution and Particle Swarm Optimization to Design Powerful Optimizers: A Review and Taxonomy , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2011, IEEE Trans. Evol. Comput..

[11]  Ponnuthurai N. Suganthan,et al.  Modified differential evolution with local search algorithm for real world optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[12]  Chukwudi Anyakoha,et al.  A review of particle swarm optimization. Part I: background and development , 2007, Natural Computing.

[13]  Andries Petrus Engelbrecht,et al.  Locating multiple optima using particle swarm optimization , 2007, Appl. Math. Comput..

[14]  Ruhul A. Sarker,et al.  Differential evolution with multiple strategies for solving CEC2011 real-world numerical optimization problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[15]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[16]  Amit Konar,et al.  Improving particle swarm optimization with differentially perturbed velocity , 2005, GECCO '05.

[17]  Li Li,et al.  A novel PSO with piecewise-varied inertia weight , 2010, 2010 2nd IEEE International Conference on Information and Financial Engineering.

[18]  Cheng-Chien Kuo,et al.  A Novel Coding Scheme for Practical Economic Dispatch by Modified Particle Swarm Approach , 2008, IEEE Transactions on Power Systems.

[19]  Tapabrata Ray,et al.  An adaptive differential evolution algorithm and its performance on real world optimization problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[20]  R. Eberhart,et al.  Fuzzy adaptive particle swarm optimization , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[21]  Martin Middendorf,et al.  A hierarchical particle swarm optimizer and its adaptive variant , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[23]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[24]  Russell C. Eberhart,et al.  Tracking and optimizing dynamic systems with particle swarms , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[25]  Kevin M. Passino,et al.  Bacterial Foraging Optimization , 2010, Int. J. Swarm Intell. Res..

[26]  P. J. Angeline,et al.  Using selection to improve particle swarm optimization , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[27]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[28]  T. Krink,et al.  Extending particle swarm optimisers with self-organized criticality , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[29]  J. Ford,et al.  Hybrid estimation of distribution algorithm for global optimization , 2004 .

[30]  Russell C. Eberhart,et al.  Guest Editorial Special Issue on Particle Swarm Optimization , 2004, IEEE Trans. Evol. Comput..

[31]  MendesR.,et al.  The fully informed particle swarm , 2004 .

[32]  Michael N. Vrahatis,et al.  On the computation of all global minimizers through particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[33]  Peter J. Bentley,et al.  Don't push me! Collision-avoiding swarms , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[34]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[35]  P. N. Suganthan,et al.  A dynamic neighborhood learning based particle swarm optimizer for global numerical optimization , 2012, Inf. Sci..

[36]  Patrick Siarry,et al.  Particle swarm and ant colony algorithms hybridized for improved continuous optimization , 2007, Appl. Math. Comput..

[37]  Jurij Silc,et al.  The Continuous Differential Ant-Stigmergy Algorithm applied to real-world optimization problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[38]  Rui Mendes,et al.  Neighborhood topologies in fully informed and best-of-neighborhood particle swarms , 2006 .

[39]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[40]  Thomas Kiel Rasmussen,et al.  Hybrid Particle Swarm Optimiser with breeding and subpopulations , 2001 .

[41]  Hitoshi Iba,et al.  Particle swarm optimization with Gaussian mutation , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[42]  Shinn-Ying Ho,et al.  OPSO: Orthogonal Particle Swarm Optimization and Its Application to Task Assignment Problems , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[43]  Rajib Mall,et al.  Particles with Age for Data Clustering , 2006, 9th International Conference on Information Technology (ICIT'06).

[44]  Kalyanmoy Deb,et al.  Modified SBX and adaptive mutation for real world single objective optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[45]  Ponnuthurai N. Suganthan,et al.  Ensemble differential evolution algorithm for CEC2011 problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[46]  Bijaya Ketan Panigrahi,et al.  Bacterial foraging optimisation: Nelder-Mead hybrid algorithm for economic load dispatch , 2008 .

[47]  Tapabrata Ray,et al.  How does the good old Genetic Algorithm fare at real world optimization? , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[48]  BanksAlec,et al.  A review of particle swarm optimization. Part II , 2007 .

[49]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[50]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[51]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[52]  Paul S. Andrews,et al.  An Investigation into Mutation Operators for Particle Swarm Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[53]  Suganthan [IEEE 1999. Congress on Evolutionary Computation-CEC99 - Washington, DC, USA (6-9 July 1999)] Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406) - Particle swarm optimiser with neighbourhood operator , 1999 .

[54]  Qidi Wu,et al.  A novel ecological particle swarm optimization algorithm and its population dynamics analysis , 2008, Appl. Math. Comput..

[55]  Ruhul A. Sarker,et al.  GA with a new multi-parent crossover for solving IEEE-CEC2011 competition problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[56]  Vladimiro Miranda,et al.  NEW EVOLUTIONARY PARTICLE SWARM ALGORITHM (EPSO) APPLIED TO VOLTAGE/VAR CONTROL , 2002 .

[57]  James Kennedy,et al.  The particle swarm: social adaptation of knowledge , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[58]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[59]  Bijaya Ketan Panigrahi,et al.  Adaptive particle swarm optimization approach for static and dynamic economic load dispatch , 2008 .

[60]  Wen-Chih Peng,et al.  Particle Swarm Optimization With Recombination and Dynamic Linkage Discovery , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[61]  Xiaojun Wu,et al.  Quantum-behaved particle swarm optimization with Gaussian distributed local attractor point , 2011, Appl. Math. Comput..

[62]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[63]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[64]  Shafaatunnur Hasan,et al.  MPSO: Median-oriented Particle Swarm Optimization , 2013, Appl. Math. Comput..

[65]  P. N. Suganthan,et al.  Problem Definitions and Evaluation Criteria for CEC 2011 Competition on Testing Evolutionary Algorithms on Real World Optimization Problems , 2011 .

[66]  Zwe-Lee Gaing,et al.  Particle swarm optimization to solving the economic dispatch considering the generator constraints , 2003 .

[67]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[68]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[69]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[70]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[71]  Ponnuthurai N. Suganthan,et al.  A Distance-Based Locally Informed Particle Swarm Model for Multimodal Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[72]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[73]  Shaojie Qiao,et al.  The fitness evaluation strategy in particle swarm optimization , 2011, Appl. Math. Comput..

[74]  Tilo Strutz,et al.  Data Fitting and Uncertainty: A practical introduction to weighted least squares and beyond , 2010 .

[75]  Alessandro Giua,et al.  Guest Editorial , 2001, Discrete event dynamic systems.

[76]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[77]  Manoj Kumar Tiwari,et al.  A clonal algorithm to solve economic load dispatch , 2007 .

[78]  M. Pandit,et al.  Self-Organizing Hierarchical Particle Swarm Optimization for Nonconvex Economic Dispatch , 2008, IEEE Transactions on Power Systems.

[79]  Ying Lin,et al.  Particle Swarm Optimization With an Aging Leader and Challengers , 2013, IEEE Transactions on Evolutionary Computation.

[80]  Xiao-Feng Xie,et al.  DEPSO: hybrid particle swarm with differential evolution operator , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[81]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[82]  Raghuveer M. Rao,et al.  Darwinian Particle Swarm Optimization , 2005, IICAI.