The Particle Swarm as Collaborative Sampling of the Search Space

The particle swarm algorithm uses principles derived from social psychology to find optimal points in a search space. The present paper decomposes and reinterprets the particle swarm in order to discover new ways of implementing the algorithm. Some essential characteristics of the method are illuminated, and some inessential features are discarded. Various new forms are tested and found to perform well on a suite of test functions. In particular, it is shown that the traditional trajectory formulas can be replaced with random number generators sampling from various symmetrical probability distributions. The excellent performance of these new versions demonstrates that the strength of the algorithm is in the interactions of the particles, rather than in their behavior as individuals.

[1]  James Kennedy.  In Search of the Essential Particle Swarm , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[2]  James Kennedy,et al.  Probability and dynamics in the particle swarm , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[3]  James Kennedy,et al.  Dynamic-probabilistic particle swarms , 2005, GECCO '05.

[4]  B. Latané,et al.  From private attitude to public opinion: A dynamic theory of social impact. , 1990 .

[5]  Suganthan.  [IEEE 1999. Congress on Evolutionary Computation-CEC99 - Washington, DC, USA (6-9 July 1999)] Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406) - Particle swarm optimiser with neighbourhood operator , 1999 .

[6]  R. Nisbett.  The geography of thought : how Asians and Westerners think differently--and why , 2003 .

[7]  Paul Smolensky,et al.  Information processing in dynamical systems: foundations of harmony theory , 1986 .

[8]  Andres Upegui,et al.  Particle Swarm Optimization with Discrete Recombination: An Online Optimizer for Evolvable Hardware , 2006, First NASA/ESA Conference on Adaptive Hardware and Systems (AHS'06).

[9]  L. Festinger.  A Theory of Cognitive Dissonance , 1957 .

[10]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[11]  Eliot R. Smith,et al.  Situating Social Influence Processes: Dynamic, Multidirectional Flows of Influence Within Social Networks , 2007, Personality and social psychology review : an official journal of the Society for Personality and Social Psychology, Inc.

[12]  B. Latané.  The psychology of social impact. , 1981 .

[13]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[14]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[15]  J. Stevenson.  The cultural origins of human cognition , 2001 .

[16]  D. Campbell.  Blind variation and selective retention in creative thought as in other knowledge processes. , 1960, Psychological review.

[17]  L. Resnick,et al.  Social foundations of cognition. , 1993, Annual review of psychology.

[18]  James Kennedy,et al.  Bare bones particle swarms , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[19]  M. Gorges-Schleuter.  Asparagos96 and the traveling salesman problem , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[20]  F. Heider.  The psychology of interpersonal relations , 1958 .

[21]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[22]  M. Clerc,et al.  Particle Swarm Optimization , 2006 .

[23]  M. Tomasello.  The Cultural Origins of Human Cognition , 2000 .

[24]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[25]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[26]  A. Bandura.  Social Foundations of Thought and Action , 1986 .

[27]  P. Suganthan.  Particle swarm optimiser with neighbourhood operator , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[28]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[29]  P. Thagard,et al.  Coherence in Thought and Action , 2000 .

[30]  Marco Dorigo,et al.  Swarm intelligence: from natural to artificial systems , 1999 .

[31]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[32]  Edward L. Fink,et al.  Oscillation in Beliefs and Decisions , 2002 .

[33]  M. Minsky.  The Society of Mind , 1986 .