A differential invasive weed optimization algorithm for improved global numerical optimization

Hybridization in context to Evolutionary Computation (EC) aims at combining the operators and methodologies from different EC paradigms to form a single algorithm that may enjoy a statistically superior performance on a wide variety of optimization problems. In this article we propose a simple but very efficient hybrid evolutionary algorithm that embeds the difference vector based mutation scheme of Differential Evolution (DE) into another recently developed global optimization algorithm known as Invasive Weed Optimization (IWO). IWO emulates the ecological behavior of the colonizing weeds. The hybrid algorithm, referred by us as Differential Invasive Weed Optimization (DIWO), is shown to possess greater explorative power as compared to the original DE and original IWO, through an analysis of the change of population-variance of these algorithms over successive generations and also through empirical simulations. We compare DIWO with original IWO, a modified IWO, two best known DE-variants: SaDE and JADE, and two state-of-the-art real optimizers: G-CMA-ES (Restart Covariance Matrix Adaptation Evolution Strategy with increasing population size) and DMS-PSO (Dynamic Multi Swarm Particle Swarm Optimization) over a test-suite of 25 shifted, rotated, and compositional benchmark functions and also one engineering optimization problem. Our comparative study indicates that although the hybridization scheme does not impose any serious burden on DIWO in terms of number of Function Evaluations (FEs), DIWO still enjoys a statistically superior performance over most of the tested benchmarks and especially over the multi-modal, rotated, and compositional ones in comparison to the other algorithms considered here.

[1]  A. Dickson On Evolution , 1884, Science.

[2]  Hisao Ishibuchi,et al.  Hybrid Evolutionary Algorithms , 2007 .

[3]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[4]  Liang Gao,et al.  A differential evolution algorithm with intersect mutation operator , 2013, Appl. Soft Comput..

[5]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[6]  Xin Yao,et al.  Benchmark Generator for CEC'2009 Competition on Dynamic Optimization , 2008 .

[7]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[8]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[9]  R. Storn,et al.  Differential evolution a simple and efficient adaptive scheme for global optimization over continu , 1997 .

[10]  Ajith Abraham,et al.  New mutation schemes for differential evolution algorithm and their application to the optimization of directional over-current relay settings , 2010, Appl. Math. Comput..

[11]  Alireza Mallahzadeh,et al.  DESIGN OF AN E-SHAPED MIMO ANTENNA USING IWO ALGORITHM FOR WIRELESS APPLICATION AT 5.8 GHZ , 2009 .

[12]  A. E. Eiben,et al.  On Evolutionary Exploration and Exploitation , 1998, Fundam. Informaticae.

[13]  A. C. Martínez-Estudillo,et al.  Hybridization of evolutionary algorithms and local search by means of a clustering method , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[15]  Jin Xu,et al.  Application of a novel IWO to the design of encoding sequences for DNA computing , 2009, Comput. Math. Appl..

[16]  Aghil Yousefi-Koma,et al.  Optimal positioning of piezoelectric actuators on a smart fin using bio-inspired algorithms , 2007 .

[17]  Leandro dos Santos Coelho,et al.  A hybrid shuffled complex evolution approach based on differential evolution for unconstrained optimization , 2011, Appl. Math. Comput..

[18]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[19]  Caro Lucas,et al.  A recommender system based on invasive weed optimization algorithm , 2007, 2007 IEEE Congress on Evolutionary Computation.

[20]  D. Zaharie Statistical Properties of Differential Evolution and Related Random Search Algorithms , 2008 .

[21]  Jing J. Liang,et al.  Novel composition test functions for numerical global optimization , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[22]  Mirjana Cangalovic,et al.  Solving spread spectrum radar polyphase code design problem by tabu search and variable neighbourhood search , 2003, Eur. J. Oper. Res..

[23]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[24]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[25]  C. Lucas,et al.  A novel numerical optimization algorithm inspired from weed colonization , 2006, Ecol. Informatics.

[26]  P. Preux,et al.  Towards hybrid evolutionary algorithms , 1999 .

[27]  Ville Tirronen,et al.  A study on scale factor in distributed differential evolution , 2011, Inf. Sci..

[28]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[29]  Pablo Moscato,et al.  On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts : Towards Memetic Algorithms , 1989 .

[30]  Ling Wang,et al.  An effective co-evolutionary differential evolution for constrained optimization , 2007, Appl. Math. Comput..

[31]  A. Mallahzadeh,et al.  Application of the Invasive Weed Optimization Technique for Antenna Configurations , 2008 .

[32]  Alireza Mallahzadeh,et al.  Compact U-array MIMO antenna designs using IWO algorithm , 2009 .

[33]  Leandro dos Santos Coelho,et al.  A tuning strategy for multivariable PI and PID controllers using differential evolution combined with chaotic Zaslavskii map , 2011, Expert Syst. Appl..

[34]  Chunmei Zhang,et al.  Distributed memetic differential evolution with the synergy of Lamarckian and Baldwinian learning , 2013, Appl. Soft Comput..

[35]  Wenyin Gong,et al.  Enhancing the performance of differential evolution using orthogonal design method , 2008, Appl. Math. Comput..

[37]  A.A. Kishk,et al.  Invasive Weed Optimization and its Features in Electromagnetics , 2010, IEEE Transactions on Antennas and Propagation.

[38]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[39]  Leandro dos Santos Coelho,et al.  Improved differential evolution approach based on cultural algorithm and diversity measure applied to solve economic load dispatch problems , 2009, Math. Comput. Simul..

[40]  Ajith Abraham,et al.  Hybrid Evolutionary Algorithms: Methodologies, Architectures, and Reviews , 2007 .

[41]  Miroslav L. Dukic,et al.  A Method of a Spread-Spectrum Radar Polyphase Code Design , 1990, IEEE J. Sel. Areas Commun..

[42]  Swagatam Das,et al.  Design of Non-Uniform Circular Antenna Arrays Using a Modified Invasive Weed Optimization Algorithm , 2011, IEEE Transactions on Antennas and Propagation.

[43]  Bijaya K. Panigrahi,et al.  On population variance and explorative power of invasive weed optimization algorithm , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[44]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[45]  Bijaya K. Panigrahi,et al.  A Hybrid Differential Invasive Weed Algorithm for Congestion Management , 2010, SEMCCO.

[46]  Alireza Mallahzadeh,et al.  Compact U-array MIMO antenna designs using IWO algorithm: U-Array MIMO Antenna Designs Using IWO Algorithm , 2009 .

[47]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[48]  Swagatam Das,et al.  Linear antenna array synthesis with modified invasive weed optimisation algorithm , 2011, Int. J. Bio Inspired Comput..

[49]  Leandro dos Santos Coelho,et al.  Solution of Jiles-Atherton vector hysteresis parameters estimation by modified Differential Evolution approaches , 2012, Expert Syst. Appl..

[50]  Ajith Abraham,et al.  On stability and convergence of the population-dynamics in differential evolution , 2009, AI Commun..

[51]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[52]  Ponnuthurai N. Suganthan,et al.  Differential Evolution Algorithm with Ensemble of Parameters and Mutation and Crossover Strategies , 2010, SEMCCO.

[53]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.