Inertia weight control strategies for particle swarm optimization

Particle swarm optimization (PSO) is a population-based, stochastic optimization technique inspired by the social dynamics of birds. The PSO algorithm is rather sensitive to the control parameters, and thus, there has been a significant amount of research effort devoted to the dynamic adaptation of these parameters. The focus of the adaptive approaches has largely revolved around adapting the inertia weight as it exhibits the clearest relationship with the exploration/exploitation balance of the PSO algorithm. However, despite the significant amount of research efforts, many inertia weight control strategies have not been thoroughly examined analytically nor empirically. Thus, there are a plethora of choices when selecting an inertia weight control strategy, but no study has been comprehensive enough to definitively guide the selection. This paper addresses these issues by first providing an overview of 18 inertia weight control strategies. Secondly, conditions required for the strategies to exhibit convergent behaviour are derived. Finally, the inertia weight control strategies are empirically examined on a suite of 60 benchmark problems. Results of the empirical investigation show that none of the examined strategies, with the exception of a randomly selected inertia weight, even perform on par with a constant inertia weight.

[1]  Ponnuthurai N. Suganthan,et al.  Heterogeneous comprehensive learning particle swarm optimization with enhanced exploration and exploitation , 2015, Swarm Evol. Comput..

[2]  Andries Petrus Engelbrecht,et al.  Particle Swarm Convergence: Standardized Analysis and Topological Influence , 2014, ANTS Conference.

[3]  Bo Liu,et al.  Improved particle swarm optimization combined with chaos , 2005 .

[4]  A. P. Engelbrecht.  Roaming Behavior of Unconstrained Particles , 2013, 2013 BRICS Congress on Computational Intelligence and 11th Brazilian Congress on Computational Intelligence.

[5]  Junyan Wang,et al.  Nonlinear Inertia Weight Variation for Dynamic Adaptation in Particle Swarm Optimization , 2011, ICSI.

[6]  A. P. Engelbrecht,et al.  Particle Swarm Optimization: Global Best or Local Best? , 2013, 2013 BRICS Congress on Computational Intelligence and 11th Brazilian Congress on Computational Intelligence.

[7]  Andries Petrus Engelbrecht,et al.  Particle swarm optimization: Velocity initialization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[8]  Xinbo Huang,et al.  Natural Exponential Inertia Weight Strategy in Particle Swarm Optimization , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[9]  Thomas Stützle,et al.  An analysis of parameter adaptation in reactive tabu search , 2014, Int. Trans. Oper. Res..

[10]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[11]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[12]  Kusum Deep,et al.  A new fine grained inertia weight Particle Swarm Optimization , 2011, 2011 World Congress on Information and Communication Technologies.

[13]  Reza Safabakhsh,et al.  A novel stability-based adaptive inertia weight for particle swarm optimization , 2016, Appl. Soft Comput..

[14]  Yong Feng,et al.  Chaotic Inertia Weight in Particle Swarm Optimization , 2007, Second International Conference on Innovative Computing, Informatio and Control (ICICIC 2007).

[15]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[16]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[17]  Zhi-hui Zhan,et al.  Topology selection for particle swarm optimization , 2016, Inf. Sci..

[18]  Andries Petrus Engelbrecht,et al.  On the optimality of particle swarm parameters in dynamic environments , 2013, 2013 IEEE Congress on Evolutionary Computation.

[19]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[20]  Xingsheng Gu,et al.  A dynamic inertia weight particle swarm optimization algorithm , 2008 .

[21]  Zbigniew Michalewicz,et al.  Particle Swarm Optimization for Single Objective Continuous Space Problems: A Review , 2017, Evolutionary Computation.

[22]  Ajith Abraham,et al.  Inertia Weight strategies in Particle Swarm Optimization , 2011, 2011 Third World Congress on Nature and Biologically Inspired Computing.

[23]  Yuelin Gao,et al.  A Particle Swarm Optimization Algorithm with Logarithm Decreasing Inertia Weight and Chaos Mutation , 2008, 2008 International Conference on Computational Intelligence and Security.

[24]  Changhe Li,et al.  A Self-Learning Particle Swarm Optimizer for Global Optimization Problems , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Andries Petrus Engelbrecht,et al.  Particle swarm variants: standardized convergence analysis , 2015, Swarm Intelligence.

[26]  Gang Xu,et al.  An adaptive parameter tuning of particle swarm optimization algorithm , 2013, Appl. Math. Comput..

[27]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[28]  Yuhui Qiu,et al.  A new adaptive well-chosen inertia weight strategy to automatically harmonize global and local search ability in particle swarm optimization , 2006, 2006 1st International Symposium on Systems and Control in Aerospace and Astronautics.

[29]  Yu Wang,et al.  Self-adaptive learning based particle swarm optimization , 2011, Inf. Sci..

[30]  D. Broomhead,et al.  Exact analysis of the sampling distribution for the canonical particle swarm optimiser and its convergence during stagnation , 2007, GECCO '07.

[31]  Kyriakos Kentzoglanakis,et al.  Particle swarm optimization with an oscillating inertia weight , 2009, GECCO.

[32]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[33]  Andries Petrus Engelbrecht,et al.  A study of particle swarm optimization particle trajectories , 2006, Inf. Sci..

[34]  Andries Petrus Engelbrecht,et al.  Comparison of self-adaptive particle swarm optimizers , 2014, 2014 IEEE Symposium on Swarm Intelligence.

[35]  Narasimhan Sundararajan,et al.  Self regulating particle swarm optimization algorithm , 2015, Inf. Sci..

[36]  Andries Petrus Engelbrecht,et al.  The sad state of self-adaptive particle swarm optimizers , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[37]  Michael N. Vrahatis,et al.  Tuning PSO Parameters Through Sensitivity Analysis , 2002 .

[38]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[39]  Shu-Kai S. Fan,et al.  A decreasing inertia weight particle swarm optimizer , 2007 .

[40]  Guoqing Li,et al.  A Self-Adaptive Improved Particle Swarm Optimization Algorithm and Its Application in Available Transfer Capability Calculation , 2009, 2009 Fifth International Conference on Natural Computation.

[41]  Mohammad Mehdi Ebadzadeh,et al.  A novel particle swarm optimization algorithm with adaptive inertia weight , 2011, Appl. Soft Comput..

[42]  Kusum Deep,et al.  Novel inertia weight strategies for particle swarm optimization , 2013, Memetic Comput..

[43]  R. Salomon.  Re-evaluating genetic algorithm performance under coordinate rotation of benchmark functions. A survey of some theoretical and practical aspects of genetic algorithms. , 1996, Bio Systems.

[44]  Thomas Stützle,et al.  A critical analysis of parameter adaptation in ant colony optimization , 2011, Swarm Intelligence.

[45]  Andries Petrus Engelbrecht,et al.  A self-adaptive heterogeneous pso for real-parameter optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[46]  Wei Gao,et al.  Low-discrepancy sequence initialized particle swarm optimization algorithm with high-order nonlinear time-varying inertia weight , 2015, Appl. Soft Comput..

[47]  Bijaya Ketan Panigrahi,et al.  Adaptive particle swarm optimization approach for static and dynamic economic load dispatch , 2008 .

[48]  Russell C. Eberhart,et al.  Tracking and optimizing dynamic systems with particle swarms , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[49]  Andries Petrus Engelbrecht,et al.  Analysis and classification of optimisation benchmark functions and benchmark suites , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[50]  Guojun Tan,et al.  A Self-Adaptive Mutation-Particle Swarm Optimization Algorithm , 2008, 2008 Fourth International Conference on Natural Computation.

[51]  Andries Petrus Engelbrecht,et al.  Particle swarm convergence: An empirical investigation , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[52]  Thomas Stützle,et al.  Heterogeneous particle swarm optimizers , 2009, 2009 IEEE Congress on Evolutionary Computation.

[53]  Jin-zhu Hu,et al.  Research on Particle Swarm Optimization with Dynamic Inertia Weight , 2009, 2009 International Conference on Management and Service Science.

[54]  Riccardo Poli,et al.  Mean and Variance of the Sampling Distribution of Particle Swarm Optimizers During Stagnation , 2009, IEEE Transactions on Evolutionary Computation.