Particle swarm optimization with a modified learning strategy and blending crossover

Particle Swarm Optimization (PSO) is a simple yet elegant derivative-free algorithm for solving continuous, multi-modal, non-convex and multi-dimensional optimization problems of widely different nature. However, one concern about the conventional PSO is that, it suffers from premature convergence, due to quick loss of diversity. In this paper, we propose an improvised version of the standard PSO (PSO-ML), which integrates a novel learning strategy with a genetic crossover scheme to circumvent this limitation. The suggested novel learning strategy generates a single robust exemplar vector by dynamically learning from individual dimensions of three guiding solutions: personal best, global best, and local best for each particle. A genetic crossover scheme, the blending crossover is also integrated with the PSO model, to enhance exploration through rapid search of the function space between and around each pair of particles in the swarm. PSO-ML is tested on 25 standard benchmark functions of the IEEE CEC (Congress on Evolutionary Computation) 2013. The results are then compared against other state-of-the-art algorithms, thus illustrating the advantages of PSO-ML in terms of accuracy and computational cost.

[1]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[2]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[3]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[4]  Ponnuthurai N. Suganthan,et al.  Heterogeneous comprehensive learning particle swarm optimization with enhanced exploration and exploitation , 2015, Swarm Evol. Comput..

[5]  Hao Yin,et al.  Accelerating particle swarm optimization using crisscross search , 2016, Inf. Sci..

[6]  Amit Konar,et al.  Static learning particle swarm optimization with enhanced exploration and exploitation using adaptive swarm size , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[7]  István Erlich,et al.  Testing MVMO on learning-based real-parameter single objective benchmark optimization problems , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[8]  Hiroshi Kinjo,et al.  Particle swarm optimization with genetic recombination: a hybrid evolutionary algorithm , 2010, Artificial Life and Robotics.

[9]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[10]  Narasimhan Sundararajan,et al.  Dynamic mentoring and self-regulation based particle swarm optimization algorithm for solving complex real-world optimization problems , 2016, Inf. Sci..

[11]  Ying Lin,et al.  Particle Swarm Optimization With an Aging Leader and Challengers , 2013, IEEE Transactions on Evolutionary Computation.

[12]  Narasimhan Sundararajan,et al.  Directionally Driven Self-Regulating Particle Swarm Optimization algorithm , 2016, Swarm Evol. Comput..

[13]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search , 2005, 2005 IEEE Congress on Evolutionary Computation.

[14]  Zbigniew Michalewicz,et al.  Particle Swarm Optimization for Single Objective Continuous Space Problems: A Review , 2017, Evolutionary Computation.

[15]  Jun Zhang,et al.  Genetic Learning Particle Swarm Optimization , 2016, IEEE Transactions on Cybernetics.

[16]  Andries Petrus Engelbrecht,et al.  Particle swarm optimization with crossover: a review and empirical analysis , 2015, Artificial Intelligence Review.

[17]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[18]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[19]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[20]  MengChu Zhou,et al.  Composite Particle Swarm Optimizer With Historical Memory for Function Optimization , 2015, IEEE Transactions on Cybernetics.

[21]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[22]  Alfredo Milani,et al.  Particle Swarm Optimization in the EDAs Framework , 2011 .

[23]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.