Multimodal optimization by artificial weed colonies enhanced with localized group search optimizers

Multimodal optimization aims at finding multiple global and local optima (as opposed to a single solution) of a function, so that the user can have a better knowledge about different optimal solutions in the search space and as and when needed, the current solution may be switched to another suitable one while still maintaining the optimal system performance. Evolutionary Algorithms (EAs) due to their population-based approach are able to detect multiple solutions within a population in a single simulation run and have a clear advantage over the classical optimization techniques, which need multiple restarts and multiple runs in the hope that a different solution may be discovered every run, with no guarantee however. This article proposes a hybrid two-stage optimization technique that firstly employs Invasive Weed Optimization (IWO), an ecologically inspired algorithm to find the promising Euclidean sub-regions surrounding multiple global and local optima. IWO is run for 80% of the total budget of function evaluations (FEs), and consecutively the search is intensified by using a modified Group Search Optimizer (GSO), in each detected sub-region. GSO, invoked in each sub-region discovered with IWO, is continued for 20% of the total budget of FEs. Both IWO and GSO have been modified from their original forms to meet the demands of the multimodal problems used in this work. Performance of the proposed algorithm is compared with a number of state-of-the-art multimodal optimization algorithms over a benchmark-suite comprising of 21 basic multimodal problems and 7 composite multimodal problems. A practical multimodal optimization problem concerning the design of dielectric composites has also been used to test the performance of the algorithm. Experimental results suggest that the proposed technique is able to provide better and more consistent performance over the existing well-known multimodal algorithms for majority of the test problems without incurring any serious computational burden.

[1]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[2]  Liu Feng,et al.  A Quick Group Search Optimizer and Its Application to the Optimal Design of Double Layer Grid Shells , 2010 .

[3]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[4]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[5]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[6]  A.A. Kishk,et al.  Invasive Weed Optimization and its Features in Electromagnetics , 2010, IEEE Transactions on Antennas and Propagation.

[7]  Kevin Warwick,et al.  A Variable Radius Niching Technique for Speciation in Genetic Algorithms , 2000, GECCO.

[8]  Aghil Yousefi-Koma,et al.  Optimal positioning of piezoelectric actuators on a smart fin using bio-inspired algorithms , 2007 .

[9]  Patrick Siarry,et al.  Island Model Cooperating with Speciation for Multimodal Optimization , 2000, PPSN.

[10]  Mohammad Mehdi Ebadzadeh,et al.  DNPSO: A Dynamic Niching Particle Swarm Optimizer for multi-modal optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[11]  Caro Lucas,et al.  A novel numerical optimization algorithm inspired from weed colonization , 2006, Ecol. Informatics.

[12]  F. Wilcoxon.  Individual Comparisons by Ranking Methods , 1945 .

[13]  Ponnuthurai N. Suganthan,et al.  Real-parameter evolutionary multimodal optimization - A survey of the state-of-the-art , 2011, Swarm Evol. Comput..

[14]  Q. Henry Wu,et al.  Group Search Optimizer: An Optimization Algorithm Inspired by Animal Searching Behavior , 2009, IEEE Transactions on Evolutionary Computation.

[15]  Xiaodong Li,et al.  Adaptively Choosing Neighbourhood Bests Using Species in a Particle Swarm Optimizer for Multimodal Function Optimization , 2004, GECCO.

[16]  Andries Petrus Engelbrecht,et al.  Niching for Dynamic Environments Using Particle Swarm Optimization , 2006, SEAL.

[17]  Ofer M. Shir,et al.  Adaptive Niche Radii and Niche Shapes Approaches for Niching with the CMA-ES , 2010, Evolutionary Computation.

[18]  Alireza Mallahzadeh,et al.  DESIGN OF AN E-SHAPED MIMO ANTENNA USING IWO ALGORITHM FOR WIRELESS APPLICATION AT 5.8 GHZ , 2009 .

[19]  Zachary V. Hendershot.  A Differential Evolution Algorithm for Automatically Discovering Multiple Global Optima in Multidimensional, Discontinuous Spaces , 2004, MAICS.

[20]  Xiaodong Li,et al.  Niching Without Niching Parameters: Particle Swarm Optimization Using a Ring Topology , 2010, IEEE Transactions on Evolutionary Computation.

[21]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[22]  L. Benameur,et al.  A Fuzzy Clustering based Particle Swarms for Multimodal Function Optimization , 2009 .

[23]  Jin Xu,et al.  Application of a novel IWO to the design of encoding sequences for DNA computing , 2009, Comput. Math. Appl..

[24]  Abdelhakim Ameur El Imrani,et al.  Dielectric composite multimodal optimization using a multipopulation cultural algorithm , 2008, Intell. Data Anal..

[25]  Samir W. Mahfoud.  Niching methods for genetic algorithms , 1996 .

[26]  R. K. Ursem.  Multinational evolutionary algorithms , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[27]  Xiaodong Li,et al.  A multimodal particle swarm optimizer based on fitness Euclidean-distance ratio , 2007, GECCO '07.

[28]  Jie Yao,et al.  Bi-Objective Multipopulation Genetic Algorithm for Multimodal Function Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[29]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[30]  Xiaodong Li,et al.  This article has been accepted for inclusion in a future issue. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 Locating and Tracking Multiple Dynamic Optima by a Particle Swarm Model Using Speciation , 2022 .

[31]  Ralph R. Martin,et al.  A Sequential Niche Technique for Multimodal Function Optimization , 1993, Evolutionary Computation.

[32]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[33]  Kalyanmoy Deb,et al.  Comparison of multi-modal optimization algorithms based on evolutionary algorithms , 2006, GECCO.

[34]  P. John Clarkson,et al.  Erratum: A Species Conserving Genetic Algorithm for Multimodal Function Optimization , 2003, Evolutionary Computation.

[35]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[36]  Chang-Hwan Im,et al.  A novel algorithm for multimodal function optimization based on evolution strategy , 2004 .

[37]  Bruno Sareni,et al.  Fitness sharing and niching methods revisited , 1998, IEEE Trans. Evol. Comput..

[38]  Xiaodong Yin,et al.  A Fast Genetic Algorithm with Sharing Scheme Using Cluster Analysis Methods in Multimodal Function Optimization , 1993 .

[39]  Bijaya K. Panigrahi,et al.  On population variance and explorative power of invasive weed optimization algorithm , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[40]  René Thomsen,et al.  Multimodal optimization using crowding-based differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[41]  Xiaodong Li,et al.  Adaptively choosing niching parameters in a PSO , 2006, GECCO.

[42]  Ponnuthurai N. Suganthan,et al.  Novel multimodal problems and differential evolution with ensemble of restricted tournament selection , 2010, IEEE Congress on Evolutionary Computation.

[43]  Q. Henry Wu,et al.  A Group Search Optimizer for Neural Network Training , 2006, ICCSA.

[44]  Andries Petrus Engelbrecht,et al.  Enhancing the NichePSO , 2007, 2007 IEEE Congress on Evolutionary Computation.

[45]  Michael N. Vrahatis,et al.  Modification of the Particle Swarm Optimizer for Locating All the Global Minima , 2001 .

[46]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[47]  Ofer M. Shir,et al.  Niching in evolution strategies , 2005, GECCO '05.

[48]  B. Dadalipour,et al.  Application of the invasive weed optimization technique for antenna configurations , 2008, 2008 Loughborough Antennas and Propagation Conference.

[49]  Qinghua Wu,et al.  An improved group search optimizer for mechanical design optimization problems , 2009 .

[50]  Xiaodong Li,et al.  A particle swarm model for tracking multiple peaks in a dynamic environment using speciation , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[51]  A. Mallahzadeh,et al.  Application of the Invasive Weed Optimization Technique for Antenna Configurations , 2008 .

[52]  Xiaodong Li,et al.  Efficient differential evolution using speciation for multimodal function optimization , 2005, GECCO '05.

[53]  Alireza Mallahzadeh,et al.  Compact U-array MIMO antenna designs using IWO algorithm , 2009 .

[54]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[55]  Caro Lucas,et al.  A recommender system based on invasive weed optimization algorithm , 2007, 2007 IEEE Congress on Evolutionary Computation.

[56]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[57]  Michael N. Vrahatis,et al.  On the computation of all global minimizers through particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.