Particle swarm stability: a theoretical extension using the non-stagnate distribution assumption

This paper presents an extension of the state of the art theoretical model utilized for understanding the stability criteria of the particles in particle swarm optimization algorithms. Conditions for order-1 and order-2 stability are derived by modeling, in the simplest case, the expected value and variance of a particle’s personal and neighborhood best positions as convergent sequences of random variables. Furthermore, the condition that the expected value and variance of a particle’s personal and neighborhood best positions are convergent sequences is shown to be a necessary condition for order-1 and order-2 stability. The theoretical analysis presented is applicable to a large class of particle swarm optimization variants.

[1]  Visakan Kadirkamanathan,et al.  Stability analysis of the particle dynamics in particle swarm optimizer , 2006, IEEE Transactions on Evolutionary Computation.

[2]  Veysel Gazi,et al.  Stochastic stability analysis of the particle dynamics in the PSO algorithm , 2012, 2012 IEEE International Symposium on Intelligent Control.

[3]  Vladimiro Miranda,et al.  NEW EVOLUTIONARY PARTICLE SWARM ALGORITHM (EPSO) APPLIED TO VOLTAGE/VAR CONTROL , 2002 .

[4]  P. Suganthan.  Particle swarm optimiser with neighbourhood operator , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[5]  E. Ozcan,et al.  Particle swarm optimization: surfing the waves , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[6]  Yoshikazu Fukuyama,et al.  Practical distribution state estimation using hybrid particle swarm optimization , 2001, 2001 IEEE Power Engineering Society Winter Meeting. Conference Proceedings (Cat. No.01CH37194).

[7]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[8]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[9]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[10]  Andries Petrus Engelbrecht,et al.  Particle swarm optimizer: The impact of unstable particles on performance , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[11]  Andries Petrus Engelbrecht,et al.  Particle swarm variants: standardized convergence analysis , 2015, Swarm Intelligence.

[12]  Saman K. Halgamuge,et al.  Particle Swarm Optimization with Self-Adaptive Acceleration Coefficients , 2002, FSKD.

[13]  Shiyuan Yang,et al.  Stochastic convergence analysis and parameter selection of the standard particle swarm optimization algorithm , 2007, Inf. Process. Lett..

[14]  D. Broomhead,et al.  Exact analysis of the sampling distribution for the canonical particle swarm optimiser and its convergence during stagnation , 2007, GECCO '07.

[15]  Gyan C. Agarwal,et al.  Linear Control Systems , 2001 .

[16]  Andries Petrus Engelbrecht,et al.  A study of particle swarm optimization particle trajectories , 2006, Inf. Sci..

[17]  Chilukuri K. Mohan,et al.  Analysis of a simple particle swarm optimization system , 1998 .

[18]  Andries Petrus Engelbrecht,et al.  A generalized theoretical deterministic particle swarm model , 2014, Swarm Intelligence.

[19]  Lea Fleischer,et al.  Theoretical Numerical Analysis A Functional Analysis Framework , 2016 .

[20]  Tim Blackwell,et al.  A Study of Collapse in Bare Bones Particle Swarm Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[21]  Maurice Clerc,et al.  Standard Particle Swarm Optimisation , 2012 .

[22]  E. Kreyszig.  Introductory Functional Analysis With Applications , 1978 .

[23]  Zbigniew Michalewicz,et al.  Particle Swarm Optimization for Single Objective Continuous Space Problems: A Review , 2017, Evolutionary Computation.

[24]  Qunfeng Liu,et al.  Order-2 Stability Analysis of Particle Swarm Optimization , 2015, Evolutionary Computation.

[25]  Riccardo Poli,et al.  Mean and Variance of the Sampling Distribution of Particle Swarm Optimizers During Stagnation , 2009, IEEE Transactions on Evolutionary Computation.

[26]  Riccardo Poli,et al.  Dynamics and stability of the sampling distribution of particle swarm optimisers via moment analysis , 2008 .

[27]  Andries Petrus Engelbrecht,et al.  Inertia weight control strategies for particle swarm optimization , 2016, Swarm Intelligence.

[28]  Zbigniew Michalewicz,et al.  Stability Analysis of the Particle Swarm Optimization Without Stagnation Assumption , 2016, IEEE Transactions on Evolutionary Computation.

[29]  Riccardo Poli,et al.  Analysis of the publications on the applications of particle swarm optimisation , 2008 .

[30]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[31]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[32]  Hirotaka Yoshida,et al.  A particle swarm optimization for reactive power and voltage control in electric power systems considering voltage security assessment , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[33]  Gyan C. Agarwal,et al.  Linear Control Systems: With Solved Problems and MATLAB Examples , 2001 .

[34]  Esperanza García Gonzalo,et al.  Convergence and stochastic stability analysis of particle swarm optimization variants with generic parameter distributions , 2014, Appl. Math. Comput..

[35]  A. P. Engelbrecht,et al.  Particle Swarm Optimization: Global Best or Local Best? , 2013, 2013 BRICS Congress on Computational Intelligence and 11th Brazilian Congress on Computational Intelligence.

[36]  Zbigniew Michalewicz,et al.  An analysis of the velocity updating rule of the particle swarm optimization algorithm , 2014, Journal of Heuristics.

[37]  J. Fernández-Martínez,et al.  Stochastic Stability Analysis of the Linear Continuous and Discrete PSO Models , 2011, IEEE Transactions on Evolutionary Computation.

[38]  Kalyan Veeramachaneni,et al.  Fitness-distance-ratio based particle swarm optimization , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[39]  Konstantinos E. Parsopoulos,et al.  UPSO: A Unified Particle Swarm Optimization Scheme , 2019, International Conference of Computational Methods in Sciences and Engineering 2004 (ICCMSE 2004).

[40]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[41]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[42]  J. Kennedy,et al.  Neighborhood topologies in fully informed and best-of-neighborhood particle swarms , 2003, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).