Locating Potentially Disjoint Feasible Regions of a Search Space with a Particle Swarm Optimizer

In constraint optimization problems set in continuous spaces, a feasible search space may consist of many disjoint regions and the global optimal solution might be within any of them. Thus, locating these feasible regions (as many as possible, ideally all of them) is of great importance. In this chapter, we introduce niching techniques that have been studied in connection with multimodal optimization for locating feasible regions, rather than for finding different local optima. One of the successful niching techniques was based on the particle swarm optimizer (PSO) with a specific topology, called nonoverlapping topology, where the swarm was divided into several nonoverlapping sub-swarms. Earlier studies have shown that PSO with such nonoverlapping topology, with a small number of particles in each sub-swarm, is quite effective in locating different local optima if the number of dimensions is small (up to 8). However, its performance drops rapidly when the number of dimensions grows. First, a new PSO, called mutation linear PSO, MLPSO, is proposed. This algorithm is effective in locating different local optima when the number of dimensions grows. MLPSO is applied to optimization problems with up to 50 dimensions, and its results in locating different local optima are compared with earlier algorithms. Second, we incorporate a constraint handling technique into MLPSO; this variant is called EMLPSO. We test different topologies of EMLPSO and evaluate them in terms of locating feasible regions when they are applied to constraint optimization problems with up to 30 dimensions. The results of this test show that the new method with nonoverlapping topology with small swarm size in each sub-swarm performs better in terms of locating different feasible regions in comparison to other topologies, such as the global best topology and the ring topology.

[1]  Xiaodong Li,et al.  Erratum to "Niching Without Niching Parameters: Particle Swarm Optimization Using a Ring Topology" [Feb 10 150-169] , 2010, IEEE Trans. Evol. Comput..

[2]  Jorge Nocedal,et al.  Global Convergence Properties of Conjugate Gradient Methods for Optimization , 1992, SIAM J. Optim..

[3]  Edward P. K. Tsang,et al.  Foundations of constraint satisfaction , 1993, Computation in cognitive science.

[4]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[5]  Andries Petrus Engelbrecht,et al.  Niching ability of basic particle swarm optimization algorithms , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[6]  A. Groenwold,et al.  Comparison of linear and classical velocity update rules in particle swarm optimization: notes on scale and frame invariance , 2007 .

[7]  Zhigang Shang,et al.  Coevolutionary Comprehensive Learning Particle Swarm Optimizer , 2010, IEEE Congress on Evolutionary Computation.

[8]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[9]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[10]  Zbigniew Michalewicz,et al.  An analysis of the velocity updating rule of the particle swarm optimization algorithm , 2014, Journal of Heuristics.

[11]  A. Engelbrecht,et al.  A new locally convergent particle swarm optimiser , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[12]  George B. Dantzig,et al.  Linear programming and extensions , 1965 .

[13]  Xiaodong Li,et al.  Niching Without Niching Parameters: Particle Swarm Optimization Using a Ring Topology , 2010, IEEE Transactions on Evolutionary Computation.

[14]  Andries Petrus Engelbrecht,et al.  Particle Swarms for Linearly Constrained Optimisation , 2007, Fundam. Informaticae.

[15]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[16]  L. Darrell Whitley,et al.  Lamarckian Evolution, The Baldwin Effect and Function Optimization , 1994, PPSN.

[17]  Andries Petrus Engelbrecht,et al.  A study of particle swarm optimization particle trajectories , 2006, Inf. Sci..

[18]  Xiang Li,et al.  A hybrid particle swarm with velocity mutation for constraint optimization problems , 2013, GECCO '13.

[19]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms for Constrained Parameter Optimization Problems , 1996, Evolutionary Computation.

[20]  John W. Chinneck,et al.  Constraint consensus concentration for identifying disjoint feasible regions in nonlinear programmes , 2013, Optim. Methods Softw..

[21]  R. A. Jabr,et al.  Solution to Economic Dispatching With Disjoint Feasible Regions Via Semidefinite Programming , 2012, IEEE Transactions on Power Systems.

[22]  Shengxiang Yang,et al.  A particle swarm optimization based memetic algorithm for dynamic optimization problems , 2010, Natural Computing.

[23]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[24]  Andries Petrus Engelbrecht,et al.  A Convergence Proof for the Particle Swarm Optimiser , 2010, Fundam. Informaticae.

[25]  Zbigniew Michalewicz,et al.  A locally convergent rotationally invariant particle swarm optimization algorithm , 2014, Swarm Intelligence.

[26]  Rolf Wanka,et al.  Particle Swarm Optimization in High-Dimensional Bounded Search Spaces , 2007, 2007 IEEE Swarm Intelligence Symposium.

[27]  Julian F. Miller,et al.  Genetic and Evolutionary Computation — GECCO 2003 , 2003, Lecture Notes in Computer Science.

[28]  Leon S. Lasdon,et al.  Multistart algorithms for seeking feasibility , 2008, Comput. Oper. Res..

[29]  A. Groenwold,et al.  Comparison of linear and classical velocity update rules in particle swarm optimization: notes on diversity , 2007 .

[30]  Andries Petrus Engelbrecht,et al.  Locating multiple optima using particle swarm optimization , 2007, Appl. Math. Comput..

[31]  Tetsuyuki Takahama,et al.  Constrained Optimization by epsilon Constrained Particle Swarm Optimizer with epsilon-level Control , 2005, WSTST.

[32]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[33]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[34]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[35]  Tetsuyuki Takahama,et al.  Constrained optimization by the ε constrained differential evolution with an archive and gradient-based mutation , 2010, IEEE Congress on Evolutionary Computation.

[36]  Derek T. Green,et al.  Biases in Particle Swarm Optimization , 2010 .

[37]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Comparing Review , 2006, Towards a New Evolutionary Computation.