Genetic Learning Particle Swarm Optimization

Social learning in particle swarm optimization (PSO) helps collective efficiency, whereas individual reproduction in genetic algorithm (GA) facilitates global effectiveness. This observation recently leads to hybridizing PSO with GA for performance enhancement. However, existing work uses a mechanistic parallel superposition and research has shown that construction of superior exemplars in PSO is more effective. Hence, this paper first develops a new framework so as to organically hybridize PSO with another optimization technique for “learning.” This leads to a generalized “learning PSO” paradigm, the *L-PSO. The paradigm is composed of two cascading layers, the first for exemplar generation and the second for particle updates as per a normal PSO algorithm. Using genetic evolution to breed promising exemplars for PSO, a specific novel *L-PSO algorithm is proposed in the paper, termed genetic learning PSO (GL-PSO). In particular, genetic operators are used to generate exemplars from which particles learn and, in turn, historical search information of particles provides guidance to the evolution of the exemplars. By performing crossover, mutation, and selection on the historical information of particles, the constructed exemplars are not only well diversified, but also high qualified. Under such guidance, the global search ability and search efficiency of PSO are both enhanced. The proposed GL-PSO is tested on 42 benchmark functions widely adopted in the literature. Experimental results verify the effectiveness, efficiency, robustness, and scalability of the GL-PSO.

[1]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[2]  Nick Craddock,et al.  Terence J. Bazzett: An introduction to behavior genetics , 2009, Human Genetics.

[3]  Jing Zhang,et al.  Coevolutionary Particle Swarm Optimization Using AIS and its Application in Multiparameter Estimation of PMSM , 2013, IEEE Transactions on Cybernetics.

[4]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[5]  J. Lawton,et al.  POSITIVE AND NEGATIVE EFFECTS OF ORGANISMS AS PHYSICAL ECOSYSTEM ENGINEERS , 1997 .

[6]  Chun Lu,et al.  An improved GA and a novel PSO-GA-based hybrid algorithm , 2005, Inf. Process. Lett..

[7]  Ganesh K. Venayagamoorthy,et al.  Particle Swarm Optimization in Wireless-Sensor Networks: A Brief Survey , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[9]  Hao Gao,et al.  A New Particle Swarm Algorithm and Its Globally Convergent Modifications , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  L S Penrose,et al.  Hereditary genius. , 1951, The Eugenics review.

[11]  Robert E. Page,et al.  Genetic determination of nectar foraging, pollen foraging, and nest-site scouting in honey bee colonies , 1989, Behavioral Ecology and Sociobiology.

[12]  M. Senthil Arumugam,et al.  On the improved performances of the particle swarm optimization algorithms with adaptive parameters, cross-over operators and root mean square (RMS) variants for computing optimal control of a class of hybrid systems , 2008, Appl. Soft Comput..

[13]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[14]  Tim Blackwell,et al.  A Study of Collapse in Bare Bones Particle Swarm Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[15]  Zuren Feng,et al.  A Scatter Learning Particle Swarm Optimization Algorithm for Multimodal Problems , 2014, IEEE Transactions on Cybernetics.

[16]  Mohamed E. El-Hawary,et al.  A Survey of Particle Swarm Optimization Applications in Electric Power Systems , 2009, IEEE Transactions on Evolutionary Computation.

[17]  Donald A. Dewsbury,et al.  Animal Behavior: An Evolutionary Approach (4th ed.). , 1989 .

[18]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[19]  Meie Shen,et al.  Differential Evolution With Two-Level Parameter Adaptation , 2014, IEEE Transactions on Cybernetics.

[20]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[21]  Ivor W. Tsang,et al.  A Hybrid PSO-BFGS Strategy for Global Optimization of Multimodal Functions , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[23]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[24]  K. Premalatha,et al.  Hybrid PSO and GA for Global Maximization , 2009 .

[25]  Martin Middendorf,et al.  A hierarchical particle swarm optimizer and its adaptive variant , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  F. Grimaccia,et al.  Genetical Swarm Optimization: Self-Adaptive Hybrid Evolutionary Algorithm for Electromagnetics , 2007, IEEE Transactions on Antennas and Propagation.

[27]  Hak-Keung Lam,et al.  Hybrid Particle Swarm Optimization With Wavelet Mutation and Its Industrial Applications , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  Changhe Li,et al.  A Self-Learning Particle Swarm Optimizer for Global Optimization Problems , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[30]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[31]  P. Berthold,et al.  Heritability of migratory activity in a natural bird population , 1994, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[32]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[33]  Marco Dorigo,et al.  Ant colony optimization for continuous domains , 2008, Eur. J. Oper. Res..

[34]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[35]  M. B. Jones,et al.  Behavior genetics. , 1965, International psychiatry clinics.

[36]  A. Dornhaus,et al.  Adaptation, Genetic Drift, Pleiotropy, and History in the Evolution of Bee Foraging Behavior , 2006 .

[37]  Jiang Zhu,et al.  A Hybrid Optimization Algorithm and Its Application for Conformal Array Pattern Synthesis , 2010, IEEE Transactions on Antennas and Propagation.

[38]  Oscar Castillo,et al.  A New Evolutionary Method with a Hybrid Approach Combining Particle Swarm Optimization and Genetic Algorithms using Fuzzy Logic for Decision Making , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[39]  Pedro Larrañaga,et al.  Optimization in Continuous Domains by Learning and Simulation of Gaussian Networks , 2000 .

[40]  John Alcock Animal behavior: An evolutionary approach, 4th ed. , 1989 .

[41]  Chia-Feng Juang,et al.  A hybrid of genetic algorithm and particle swarm optimization for recurrent network design , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[42]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[43]  Stephen M. Stigler,et al.  Darwin, Galton and the Statistical Enlightenment , 2010 .

[45]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[46]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[47]  Xiaolin Hu,et al.  An Improved Dual Neural Network for Solving a Class of Quadratic Programming Problems and Its $k$-Winners-Take-All Application , 2008, IEEE Transactions on Neural Networks.

[48]  L. Shao,et al.  From Heuristic Optimization to Dictionary Learning: A Review and Comprehensive Comparison of Image Denoising Algorithms , 2014, IEEE Transactions on Cybernetics.

[49]  Erwie Zahara,et al.  A hybrid genetic algorithm and particle swarm optimization for multimodal functions , 2008, Appl. Soft Comput..

[50]  Salman Mohagheghi,et al.  Particle Swarm Optimization: Basic Concepts, Variants and Applications in Power Systems , 2008, IEEE Transactions on Evolutionary Computation.

[51]  Dan Simon,et al.  Mathematical and Experimental Analyses of Oppositional Algorithms , 2014, IEEE Transactions on Cybernetics.

[52]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[53]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[54]  Shigeru Obayashi,et al.  Development and investigation of efficient GA/PSO-hybrid algorithm applicable to real-world design optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[55]  Alexander G. Loukianov,et al.  Particle Swarm Optimization for Discrete-Time Inverse Optimal Control of a Doubly Fed Induction Generator , 2013, IEEE Transactions on Cybernetics.

[56]  Dantong Ouyang,et al.  A novel hybrid differential evolution and particle swarm optimization algorithm for unconstrained optimization , 2009, Oper. Res. Lett..

[57]  Mengjie Zhang,et al.  Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach , 2013, IEEE Transactions on Cybernetics.

[58]  Kim Sterelny,et al.  Made By Each Other: Organisms and Their Environment , 2005 .