An adaptive particle swarm optimization algorithm based on optimal parameter regions

The performance of the particle swarm optimization (PSO) algorithm is known to be sensitive to the values of its control parameters. Parameter tuning is thus an important aspect in optimizing PSO performance. While many studies have examined a variety of PSO parameters and have provided general-purpose parameter suggestions, a recent study has shown that the best parameters to employ are, in fact, time-dependent. Furthermore, a priori parameter tuning is a time-consuming procedure and assumes that the best parameters to employ do not change over time. This study proposes a new PSO variant which randomly samples its control parameter values from a region known to contain promising parameter configurations, thereby eliminating the need to specify (and tune) values for the traditional PSO control parameters. The new PSO variant is compared to PSO employing 14 different parametrizations suggested in the literature. Results indicate that the performance of the proposed variant is on par with the best parameter configurations suggested in the literature.

[1]  Andries Petrus Engelbrecht,et al.  Particle swarm convergence: An empirical investigation , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[2]  Thomas Stützle,et al.  Heterogeneous particle swarm optimizers , 2009, 2009 IEEE Congress on Evolutionary Computation.

[3]  Qunfeng Liu,et al.  Order-2 Stability Analysis of Particle Swarm Optimization , 2015, Evolutionary Computation.

[4]  Andries Petrus Engelbrecht,et al.  Particle swarm optimization: Velocity initialization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[5]  Andries Petrus Engelbrecht,et al.  The sad state of self-adaptive particle swarm optimizers , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[6]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[7]  Andries Petrus Engelbrecht,et al.  Self-adaptive particle swarm optimization: a review and analysis of convergence , 2017, Swarm Intelligence.

[8]  Andries Petrus Engelbrecht,et al.  Comparison of self-adaptive particle swarm optimizers , 2014, 2014 IEEE Symposium on Swarm Intelligence.

[9]  Michael N. Vrahatis,et al.  Tuning PSO Parameters Through Sensitivity Analysis , 2002 .

[10]  M. Clerc.  Stagnation Analysis in Particle Swarm Optimisation or What Happens When Nothing Happens , 2006 .

[11]  Zbigniew Michalewicz,et al.  Stability Analysis of the Particle Swarm Optimization Without Stagnation Assumption , 2016, IEEE Transactions on Evolutionary Computation.

[12]  Narasimhan Sundararajan,et al.  Self regulating particle swarm optimization algorithm , 2015, Inf. Sci..

[13]  M. Clerc,et al.  The swarm and the queen: towards a deterministic and adaptive particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[14]  Wei Zhang,et al.  A parameter selection strategy for particle swarm optimization based on particle positions , 2014, Expert Syst. Appl..

[15]  Gang Xu,et al.  An adaptive parameter tuning of particle swarm optimization algorithm , 2013, Appl. Math. Comput..

[16]  Veysel Gazi,et al.  Stochastic stability analysis of the particle dynamics in the PSO algorithm , 2012, 2012 IEEE International Symposium on Intelligent Control.

[17]  D. Broomhead,et al.  Exact analysis of the sampling distribution for the canonical particle swarm optimiser and its convergence during stagnation , 2007, GECCO '07.

[18]  Zbigniew Michalewicz,et al.  Analysis of Stability, Local Convergence, and Transformation Sensitivity of a Variant of the Particle Swarm Optimization Algorithm , 2016, IEEE Transactions on Evolutionary Computation.

[19]  Andries Petrus Engelbrecht,et al.  Analysis and classification of optimisation benchmark functions and benchmark suites , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[20]  Shiyuan Yang,et al.  Stochastic convergence analysis and parameter selection of the standard particle swarm optimization algorithm , 2007, Inf. Process. Lett..

[21]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[22]  Andries Petrus Engelbrecht,et al.  A generalized theoretical deterministic particle swarm model , 2014, Swarm Intelligence.

[23]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[24]  Riccardo Poli,et al.  Mean and Variance of the Sampling Distribution of Particle Swarm Optimizers During Stagnation , 2009, IEEE Transactions on Evolutionary Computation.

[25]  Zbigniew Michalewicz,et al.  Impacts of Coefficients on Movement Patterns in the Particle Swarm Optimization Algorithm , 2017, IEEE Transactions on Evolutionary Computation.

[26]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[27]  M. Jiang,et al.  Particle Swarm Optimization - Stochastic Trajectory Analysis and Parameter Selection , 2007 .

[28]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[29]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[30]  Andries Petrus Engelbrecht,et al.  Optimal parameter regions for particle swarm optimization algorithms , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[31]  Changhe Li,et al.  A Self-Learning Particle Swarm Optimizer for Global Optimization Problems , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[32]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, ANTS Conference.

[33]  Andries Petrus Engelbrecht,et al.  On the optimality of particle swarm parameters in dynamic environments , 2013, 2013 IEEE Congress on Evolutionary Computation.

[34]  M. Friedman.  A Comparison of Alternative Tests of Significance for the Problem of $m$ Rankings , 1940 .

[35]  Andries Petrus Engelbrecht,et al.  Inertia weight control strategies for particle swarm optimization , 2016, Swarm Intelligence.

[36]  A. P. Engelbrecht,et al.  Particle Swarm Optimization: Global Best or Local Best? , 2013, 2013 BRICS Congress on Computational Intelligence and 11th Brazilian Congress on Computational Intelligence.

[37]  J. Shaffer.  Modified Sequentially Rejective Multiple Test Procedures , 1986 .

[38]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[39]  Yu Wang,et al.  Self-adaptive learning based particle swarm optimization , 2011, Inf. Sci..

[40]  Andries Petrus Engelbrecht,et al.  A study of particle swarm optimization particle trajectories , 2006, Inf. Sci..

[41]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[42]  Andries Petrus Engelbrecht,et al.  Optimal parameter regions and the time-dependence of control parameter values for the particle swarm optimization algorithm , 2018, Swarm Evol. Comput..

[43]  Andries Petrus Engelbrecht,et al.  A self-adaptive heterogeneous pso for real-parameter optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[44]  M. Friedman.  The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[45]  Visakan Kadirkamanathan,et al.  Stability analysis of the particle dynamics in particle swarm optimizer , 2006, IEEE Transactions on Evolutionary Computation.

[46]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..