Impacts of Coefficients on Movement Patterns in the Particle Swarm Optimization Algorithm

In this paper, we investigate movement patterns of a particle in the particle swarm optimization (PSO) algorithm. We characterize movement patterns of the particle by two factors: 1) the correlation between its consecutive positions and 2) its range of movement. We introduce the base frequency of movement as a measure for the correlation between positions and the variance of movement as a measure for the range of movement. We determine the base frequency and the variance of movement theoretically and we show how they change with the values of coefficients. We extract a system of equations that enables practitioners to find coefficients’ values to guarantee achieving a given base frequency and variance of movement, i.e., control the movement pattern of particles. We also show that if the base frequency of movement for a particle is small, mid range, or large then the particle’s position at each iteration is positively correlated (smooth movement), uncorrelated (chaotic movement), or negatively correlated (jumping at each iteration) with its previous positions, respectively. We test the effects of the base frequency and variance of movement on the search ability of particles and we show that small base frequencies (i.e., smooth movement) are more effective when the maximum number of function evaluations is large. We found that the most frequently-used coefficient values in PSO literature impose mid-range base frequencies that correspond with a chaotic movement. We also provide new sets of coefficients that outperform existing ones on a set of benchmark functions.

[1]  Thomas Stützle,et al.  Frankenstein's PSO: A Composite Particle Swarm Optimization Algorithm , 2009, IEEE Transactions on Evolutionary Computation.

[2]  A. Edelman,et al.  Polynomial roots from companion matrix eigenvalues , 1995 .

[3]  Andries Petrus Engelbrecht,et al.  A survey of techniques for characterising fitness landscapes and some possible ways forward , 2013, Inf. Sci..

[4]  Zbigniew Michalewicz,et al.  Analysis of Stability, Local Convergence, and Transformation Sensitivity of a Variant of the Particle Swarm Optimization Algorithm , 2016, IEEE Transactions on Evolutionary Computation.

[5]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[6]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[7]  E. Ozcan,et al.  Particle swarm optimization: surfing the waves , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[8]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[9]  Zbigniew Michalewicz,et al.  A locally convergent rotationally invariant particle swarm optimization algorithm , 2014, Swarm Intelligence.

[10]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[11]  Riccardo Poli,et al.  Analysis of the publications on the applications of particle swarm optimisation , 2008 .

[12]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[13]  Zbigniew Michalewicz,et al.  Particle Swarm Optimization for Single Objective Continuous Space Problems: A Review , 2017, Evolutionary Computation.

[14]  Qunfeng Liu,et al.  Order-2 Stability Analysis of Particle Swarm Optimization , 2015, Evolutionary Computation.

[15]  M. Clerc,et al.  Particle Swarm Optimization , 2006 .

[16]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[17]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[18]  M. Jiang,et al.  Particle Swarm Optimization - Stochastic Trajectory Analysis and Parameter Selection , 2007 .

[19]  James Kennedy,et al.  Bare bones particle swarms , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[20]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[21]  Zbigniew Michalewicz,et al.  Stability Analysis of the Particle Swarm Optimization Without Stagnation Assumption , 2016, IEEE Transactions on Evolutionary Computation.

[22]  Shiyuan Yang,et al.  Stochastic convergence analysis and parameter selection of the standard particle swarm optimization algorithm , 2007, Inf. Process. Lett..

[23]  Riccardo Poli,et al.  Mean and Variance of the Sampling Distribution of Particle Swarm Optimizers During Stagnation , 2009, IEEE Transactions on Evolutionary Computation.

[24]  Katherine M. Malan Characterising continuous optimisation problems for particle swarm optimisation performance prediction , 2014 .