A generalized theoretical deterministic particle swarm model

A number of theoretical studies of particle swarm optimization (PSO) have been done to gain a better understanding of the dynamics of the algorithm and the behavior of the particles under different conditions. These theoretical analyses have been performed for both the deterministic PSO model and more recently for the stochastic model. However, all current theoretical analyses of the PSO algorithm were based on the stagnation assumption, in some form or another. The analysis done under the stagnation assumption is one where the personal best and neighborhood best positions are assumed to be non-changing. While analysis under the stagnation assumption is very informative, it could never provide a complete description of a PSO’s behavior. Furthermore, the assumption implicitly removes the notion of a social network structure from the analysis. This paper presents a generalization to the theoretical deterministic PSO model. Under the generalized model, conditions for particle convergence to a point are derived. The model used in this paper greatly weakens the stagnation assumption, by instead assuming that each particle’s personal best and neighborhood best can occupy an arbitrarily large number of unique positions. It was found that the conditions derived in previous theoretical deterministic PSO research could be obtained as a specialization of the new generalized model proposed. Empirical results are presented to support the theoretical findings.

[1]  Visakan Kadirkamanathan,et al.  Stability analysis of the particle dynamics in particle swarm optimizer , 2006, IEEE Transactions on Evolutionary Computation.

[2]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[3]  Andries Petrus Engelbrecht.  Particle swarm optimization , 2014, GECCO.

[4]  Juan Luis Fernández-Martínez,et al.  Theoretical analysis of particle swarm trajectories through a mechanical analogy , 2008 .

[5]  Saman K. Halgamuge,et al.  Particle Swarm Optimization with Self-Adaptive Acceleration Coefficients , 2002, FSKD.

[6]  M. Clerc,et al.  The swarm and the queen: towards a deterministic and adaptive particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[7]  Yongling Zheng,et al.  On the convergence analysis and parameter selection in particle swarm optimization , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[8]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[9]  D.L. Elliott,et al.  Feedback systems: Input-output properties , 1976, Proceedings of the IEEE.

[10]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[11]  Shiyuan Yang,et al.  Stochastic convergence analysis and parameter selection of the standard particle swarm optimization algorithm , 2007, Inf. Process. Lett..

[12]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[13]  Veysel Gazi,et al.  Stochastic stability analysis of the particle dynamics in the PSO algorithm , 2012, 2012 IEEE International Symposium on Intelligent Control.

[14]  C. A. Desoer,et al.  Nonlinear Systems Analysis , 1978 .

[15]  Gyan C. Agarwal,et al.  Linear Control Systems , 2001 .

[16]  Andries Petrus Engelbrecht,et al.  A study of particle swarm optimization particle trajectories , 2006, Inf. Sci..

[17]  László Máté.  On infinite composition of affine mappings , 1999 .

[18]  P. Suganthan.  Particle swarm optimiser with neighbourhood operator , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[19]  J. Douglas Faires,et al.  Numerical Analysis , 1981 .

[20]  Riccardo Poli,et al.  Mean and Variance of the Sampling Distribution of Particle Swarm Optimizers During Stagnation , 2009, IEEE Transactions on Evolutionary Computation.

[21]  Christian Posthoff,et al.  Randomized directed neighborhoods with edge migration in particle swarm optimization , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[22]  A. P. Engelbrecht,et al.  Particle Swarm Optimization: Global Best or Local Best? , 2013, 2013 BRICS Congress on Computational Intelligence and 11th Brazilian Congress on Computational Intelligence.

[23]  Albert A. Groenwold,et al.  Sizing design of truss structures using particle swarms , 2003 .

[24]  Kalyan Veeramachaneni,et al.  Fitness-distance-ratio based particle swarm optimization , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[25]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[26]  R. Eberhart,et al.  Fuzzy adaptive particle swarm optimization , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[27]  J. Miller.  Numerical Analysis , 1966, Nature.

[28]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[29]  R. W. Dobbins,et al.  Computational intelligence PC tools , 1996 .

[30]  D. Broomhead,et al.  Exact analysis of the sampling distribution for the canonical particle swarm optimiser and its convergence during stagnation , 2007, GECCO '07.

[31]  H. Fan.  A modification to particle swarm optimization algorithm , 2002 .

[32]  A. P. Engelbrecht.  Particle Swarm Optimization: Iteration Strategies Revisited , 2013, 2013 BRICS Congress on Computational Intelligence and 11th Brazilian Congress on Computational Intelligence.

[33]  Yaobin Chen,et al.  Battery pack state of charge estimator design using computational intelligence approaches , 2000, Fifteenth Annual Battery Conference on Applications and Advances (Cat. No.00TH8490).

[34]  Chilukuri K. Mohan,et al.  Analysis of a simple particle swarm optimization system , 1998 .

[35]  Jaroslaw Sobieszczanski-Sobieski,et al.  Multidisciplinary optimization of a transport aircraft wing using particle swarm optimization , 2002 .

[36]  Yoshikazu Fukuyama,et al.  Practical distribution state estimation using hybrid particle swarm optimization , 2001, 2001 IEEE Power Engineering Society Winter Meeting. Conference Proceedings (Cat. No.01CH37194).

[37]  C. Desoer,et al.  Feedback Systems: Input-Output Properties , 1975 .

[38]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[39]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[40]  E. Ozcan,et al.  Particle swarm optimization: surfing the waves , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[41]  Gyan C. Agarwal,et al.  Linear Control Systems: With Solved Problems and MATLAB Examples , 2001 .

[42]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[43]  Andries Petrus Engelbrecht,et al.  Using neighbourhoods with the guaranteed convergence PSO , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).