Democracy-inspired particle swarm optimizer with the concept of peer groups

This article proposes to integrate the concept of governance in human society with the nature-inspired particle swarm optimization (PSO) algorithm. A population-based iterative global optimization algorithm, called Democracy-inspired particle swarm optimization with the concept of peer groups (DPG-PSO) has been developed for solving multidimensional, non-linear, non-convex, and multimodal optimization problems by exploiting the concept of the new peer-influenced topology. Here the particles, each of which model a candidate solution of the problem under consideration, are given a choice to follow two possible leaders who have been selected on the basis of a voting mechanism. The leader and the opposition have their influences proportional to the total number of votes polled in their favor. A detailed empirical study comprising tuning of DPG-PSO parameters and its optimizing mechanism has been presented in the paper. The algorithm is tested in a standard benchmark suite consisting of unimodal, multimodal, shifted and rotated functions. DPG-PSO is found to statistically outperform seven other well-known PSO variants in terms of final accuracy and robustness over majority of the test cases, thus, proving itself as an efficient algorithm.

[1]  T. Krink,et al.  Extending particle swarm optimisers with self-organized criticality , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[2]  Peter J. Bentley,et al.  Don't push me! Collision-avoiding swarms , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[3]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[4]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[5]  Derek T. Green,et al.  Biases in Particle Swarm Optimization , 2010 .

[6]  James S. Fishkin,et al.  Experimenting with a Democratic Ideal: Deliberative Polling and Public Opinion , 2005 .

[7]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[8]  Raghuveer M. Rao,et al.  Darwinian Particle Swarm Optimization , 2005, IICAI.

[9]  Andries Petrus Engelbrecht,et al.  Using the Ring Neighborhood Topology with Self-adaptive Differential Evolution , 2006, ICNC.

[10]  Salman Mohagheghi,et al.  Particle Swarm Optimization: Basic Concepts, Variants and Applications in Power Systems , 2008, IEEE Transactions on Evolutionary Computation.

[11]  Wen-Chih Peng,et al.  Particle Swarm Optimization With Recombination and Dynamic Linkage Discovery , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  A. Kaveh,et al.  Democratic PSO for truss layout and size optimization with frequency constraints , 2014 .

[13]  Vladimiro Miranda,et al.  NEW EVOLUTIONARY PARTICLE SWARM ALGORITHM (EPSO) APPLIED TO VOLTAGE/VAR CONTROL , 2002 .

[14]  James Kennedy,et al.  The particle swarm: social adaptation of knowledge , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[15]  Jiuyue Xu,et al.  Blade layers optimization of wind turbines using FAST and improved PSO Algorithm , 2012 .

[16]  R. Eberhart,et al.  Fuzzy adaptive particle swarm optimization , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[17]  Martin Middendorf,et al.  A hierarchical particle swarm optimizer and its adaptive variant , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  Shu-Kai S. Fan,et al.  A hybrid simplex search and particle swarm optimization for unconstrained optimization , 2007, Eur. J. Oper. Res..

[19]  Rui Mendes,et al.  Neighborhood topologies in fully informed and best-of-neighborhood particle swarms , 2006 .

[20]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[21]  Hitoshi Iba,et al.  Particle swarm optimization with Gaussian mutation , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[22]  Seth D. Guikema,et al.  Enhanced speciation in particle swarm optimization for multi-modal problems , 2011, Eur. J. Oper. Res..

[23]  Jaroslaw Sobieszczanski-Sobieski,et al.  Particle swarm optimization , 2002 .

[24]  Thomas Kiel Rasmussen,et al.  Hybrid Particle Swarm Optimiser with breeding and subpopulations , 2001 .

[25]  Patrick Siarry,et al.  Particle swarm and ant colony algorithms hybridized for improved continuous optimization , 2007, Appl. Math. Comput..

[26]  Ponnuthurai N. Suganthan,et al.  A Distance-Based Locally Informed Particle Swarm Model for Multimodal Optimization , 2013, IEEE Transactions on Evolutionary Computation.

[27]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[28]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[29]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[30]  Bo Yang,et al.  Improving particle swarm optimization using multi-layer searching strategy , 2014, Inf. Sci..

[31]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[32]  M. Clerc,et al.  Particle Swarm Optimization , 2006 .

[33]  Xiao-Feng Xie,et al.  DEPSO: hybrid particle swarm with differential evolution operator , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[34]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[35]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[36]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2011, IEEE Trans. Evol. Comput..

[37]  Li Li,et al.  A novel PSO with piecewise-varied inertia weight , 2010, 2010 2nd IEEE International Conference on Information and Financial Engineering.

[38]  Rajib Mall,et al.  Particles with Age for Data Clustering , 2006, 9th International Conference on Information Technology (ICIT'06).

[39]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[40]  Russell C. Eberhart,et al.  Tracking and optimizing dynamic systems with particle swarms , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[41]  Nor Ashidi Mat Isa,et al.  An adaptive two-layer particle swarm optimization with elitist learning strategy , 2014, Inf. Sci..

[42]  P. J. Angeline,et al.  Using selection to improve particle swarm optimization , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[43]  Riccardo Poli,et al.  Analysis of the publications on the applications of particle swarm optimisation , 2008 .

[44]  A. Kaveh,et al.  Comparison of nine meta-heuristic algorithms for optimal design of truss structures with frequency constraints , 2014, Adv. Eng. Softw..

[45]  Russell C. Eberhart,et al.  Multiobjective optimization using dynamic neighborhood particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[46]  H. Shayeghi,et al.  Discrete PSO algorithm based optimization of transmission lines loading in TNEP problem , 2010 .

[47]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[48]  Jie Chen,et al.  Hybridizing Differential Evolution and Particle Swarm Optimization to Design Powerful Optimizers: A Review and Taxonomy , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[49]  Chukwudi Anyakoha,et al.  A review of particle swarm optimization. Part I: background and development , 2007, Natural Computing.

[50]  Amit Konar,et al.  Improving particle swarm optimization with differentially perturbed velocity , 2005, GECCO '05.

[51]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[52]  Kevin D. Seppi,et al.  Exposing origin-seeking bias in PSO , 2005, GECCO '05.

[53]  P. N. Suganthan,et al.  A dynamic neighborhood learning based particle swarm optimizer for global numerical optimization , 2012, Inf. Sci..

[54]  Ying Lin,et al.  Particle Swarm Optimization With an Aging Leader and Challengers , 2013, IEEE Transactions on Evolutionary Computation.

[55]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[56]  Paul S. Andrews,et al.  An Investigation into Mutation Operators for Particle Swarm Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[57]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[58]  Russell C. Eberhart,et al.  Guest Editorial Special Issue on Particle Swarm Optimization , 2004, IEEE Trans. Evol. Comput..

[59]  Michael N. Vrahatis,et al.  On the computation of all global minimizers through particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.