On the computation of all global minimizers through particle swarm optimization

This paper presents approaches for effectively computing all global minimizers of an objective function. The approaches include transformations of the objective function through the recently proposed deflection and stretching techniques, as well as a repulsion source at each detected minimizer. The aforementioned techniques are incorporated in the context of the particle swarm optimization (PSO) method, resulting in an efficient algorithm which has the ability to avoid previously detected solutions and, thus, detect all global minimizers of a function. Experimental results on benchmark problems originating from the fields of global optimization, dynamical systems, and game theory, are reported, and conclusions are derived.

[1]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[2]  M. A. Abido Optimal des'ign of Power System Stabilizers Using Particle Swarm Opt'imization , 2002, IEEE Power Engineering Review.

[3]  A. Cockshott,et al.  Improving the fermentation medium for Echinocandin B production part II: Particle swarm optimization , 2001 .

[4]  Konstantinos E. Parsopoulos,et al.  Initializing the Particle Swarm Optimizer Using the Nonlinear Simplex Method , 2002 .

[5]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[6]  M. N. Vrahatis,et al.  Particle swarm optimization method in multiobjective problems , 2002, SAC '02.

[7]  Peter J. Angeline,et al.  Evolutionary Optimization Versus Particle Swarm Optimization: Philosophy and Performance Differences , 1998, Evolutionary Programming.

[8]  Michael N. Vrahatis,et al.  Investigating the existence of function roots using particle swarm optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[9]  Russell C. Eberhart,et al.  Tracking and optimizing dynamic systems with particle swarms , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[10]  Michael N. Vrahatis,et al.  Computing periodic orbits of nondifferentiable/discontinuous mappings through particle swarm optimization , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[11]  Gerry Dozier,et al.  Applying the particle swarm optimizer to non-stationary environments , 2002 .

[12]  Michael N. Vrahatis,et al.  Structure and Breakdown of Invariant Tori in a 4-D Mapping Model of Accelerator Dynamics , 1997 .

[13]  Michael N. Vrahatis,et al.  Modification of the Particle Swarm Optimizer for Locating All the Global Minima , 2001 .

[14]  R. Ge,et al.  A class of filled functions for finding global minimizers of a function of several variables , 1987 .

[15]  Russell C. Eberhart,et al.  Comparison between Genetic Algorithms and Particle Swarm Optimization , 1998, Evolutionary Programming.

[16]  Renpu Ge,et al.  A Filled Function Method for Finding a Global Minimizer of a Function of Several Variables , 1990, Math. Program..

[17]  D. Agrafiotis,et al.  Feature selection for structure-activity correlation using binary particle swarms. , 2002, Journal of medicinal chemistry.

[18]  Konstantinos E. Parsopoulos,et al.  PARTICLE SWARM OPTIMIZER IN NOISY AND CONTINUOUSLY CHANGING ENVIRONMENTS , 2001 .

[19]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[20]  Jürgen Teich,et al.  Strategies for finding good local guides in multi-objective particle swarm optimization (MOPSO) , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[21]  Imtiaz Ahmad,et al.  Particle swarm optimization for task assignment problem , 2002, Microprocess. Microsystems.

[22]  Wolfgang Banzhaf,et al.  Genetic Programming: An Introduction , 1997 .

[23]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[24]  Thomas Bäck,et al.  Evolutionary computation: Toward a new philosophy of machine intelligence , 1997, Complex..

[25]  Michael N. Vrahatis,et al.  On the Complexity of Isolating Real Roots and Computing with Certainty the Topological Degree , 2002, J. Complex..

[26]  William H. Press,et al.  Numerical Recipes in Fortran 77 , 1992 .

[27]  Vassilis P. Plagianakos,et al.  Improving the Particle Swarm Optimizer by Function “Stretching” , 2001 .

[28]  Michael N. Vrahatis,et al.  An efficient method for locating and computing periodic orbits of nonlinear mappings , 1995 .

[29]  Raghuveer M. Rao,et al.  Particle swarm optimization for the clustering of wireless sensors , 2003, SPIE Defense + Commercial Sensing.

[30]  Michael N. Vrahatis,et al.  Particle swarm optimization for minimax problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[31]  R. McKelvey,et al.  Computation of equilibria in finite games , 1996 .

[32]  M. N. Vrahatis,et al.  Objective function “stretching” to alleviate convergence to local minima , 2001 .

[33]  Hans-Georg Beyer,et al.  The Theory of Evolution Strategies , 2001, Natural Computing Series.

[34]  Michael N. Vrahatis,et al.  Recent approaches to global optimization problems through Particle Swarm Optimization , 2002, Natural Computing.

[35]  Xiaodong Li,et al.  A Non-dominated Sorting Particle Swarm Optimizer for Multiobjective Optimization , 2003, GECCO.

[36]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[37]  J. F. Price,et al.  On descent from local minima , 1971 .

[38]  Benjamin W. Wah,et al.  Global Optimization for Neural Network Training , 1996, Computer.

[39]  Tapabrata Ray,et al.  A Swarm Metaphor for Multiobjective Design Optimization , 2002 .

[40]  David B. Fogel,et al.  Evolutionary algorithms in theory and practice , 1997, Complex.

[41]  John M. Greene,et al.  A method for determining a stochastic transition , 1979, Hamiltonian Dynamical Systems.

[42]  Russell C. Eberhart,et al.  Multiobjective optimization using dynamic neighborhood particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[43]  Zhao Hui,et al.  Optimal Design of Power System Stabilizer Using Particle Swarm Optimization , 2006 .

[44]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[45]  Hazim El-Mounayri,et al.  NC end milling optimiza-tion using evolutionary computation , 2002 .

[46]  Michael N. Vrahatis,et al.  PERIODIC ORBITS AND INVARIANT SURFACES OF 4D NONLINEAR MAPPINGS , 1996 .

[47]  Yuhui Shi,et al.  Co-evolutionary particle swarm optimization to solve min-max problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[48]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[49]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[50]  Michael N. Vrahatis,et al.  On the alleviation of the problem of local minima in back-propagation , 1997 .

[51]  E. Biscaia,et al.  The use of particle swarm optimization for dynamical analysis in chemical processes , 2002 .

[52]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[53]  C.A. Coello Coello,et al.  MOPSO: a proposal for multiple objective particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[54]  M. Hénon Numerical study of quadratic area-preserving mappings , 1969 .

[55]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[56]  R. W. Dobbins,et al.  Computational intelligence PC tools , 1996 .

[57]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[58]  William H. Press,et al.  Numerical Recipes: FORTRAN , 1988 .

[59]  Ch. Skokos,et al.  On the stability of periodic orbits of high dimensional autonomous Hamiltonian systems , 2001 .

[60]  Michael N. Vrahatis,et al.  Particle swarm optimization for integer programming , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[61]  W. Pinebrook The evolution of strategy. , 1990, Case studies in health administration.

[62]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[63]  W Z Lu,et al.  Analysis of Pollutant Levels in Central Hong Kong Applying Neural Network Method with Particle Swarm Optimization , 2002, Environmental monitoring and assessment.

[64]  S. Easter Selvan,et al.  Novel Technique for PID Tuning by Particle Swarm Optimization , 2003 .

[65]  James Kennedy,et al.  The Behavior of Particles , 1998, Evolutionary Programming.

[66]  R. Horst,et al.  Global Optimization: Deterministic Approaches , 1992 .

[67]  P. Fourie,et al.  The particle swarm optimization algorithm in size and shape optimization , 2002 .

[68]  Hans-Paul Schwefel,et al.  Evolution and optimum seeking , 1995, Sixth-generation computer technology series.

[69]  K. Parsopoulos,et al.  Stretching technique for obtaining global minimizers through Particle Swarm Optimization , 2001 .

[70]  Michael N. Vrahatis,et al.  A first study of fuzzy cognitive maps learning using particle swarm optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[71]  Michael N. Vrahatis,et al.  A procedure to compute the fixed points and visualize the orbits of a 2D map , 1993 .

[72]  Tassos Bountis,et al.  On the stability of periodic orbits of two-dimensional mappings , 1981 .

[73]  G D Birkhoff,et al.  Dynamical Systems with Two Degrees of Freedom. , 1917, Proceedings of the National Academy of Sciences of the United States of America.

[74]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[75]  Susana Gómez,et al.  The tunnelling method for solving the constrained global optimization problem with several non-connected feasible regions , 1982 .

[76]  Jonathan E. Fieldsend,et al.  A Multi-Objective Algorithm based upon Particle Swarm Optimisation, an Efficient Data Structure and , 2002 .