Modified Differential Evolution with Locality induced Genetic Operators for dynamic optimization

This article presents a modified version of the Differential Evolution (DE) algorithm for solving Dynamic Optimization Problems (DOPs) efficiently. The algorithm, referred as Modified DE with Locality induced Genetic Operators (MDE-LiGO) incorporates changes in the three basic stages of a standard DE framework. The mutation phase has been entrusted to a locality-induced operation that retains traits of Euclidean distance-based closest individuals around a potential solution. Diversity maintenance is further enhanced by inclusion of a local-best crossover operation that empowers the algorithm with an explorative ability without directional bias. An exhaustive dynamic detection technique has been introduced to effectively sense the changes in the landscape. An even distribution of solutions over different regions of the landscape calls for a solution retention technique that adapts this algorithm to dynamism by using the previously stored information in diverse search domains. MDE-LiGO has been compared with seven state-of-the-art evolutionary dynamic optimizers on a set of benchmarks known as the Generalized Dynamic Benchmark Generator (GDBG) used in competition on evolutionary computation in dynamic and uncertain environments held under the 2009 IEEE Congress on Evolutionary Computation (CEC). The experimental results clearly indicate that MDE-LiGO can outperform other algorithms for most of the tested DOP instances in a statistically meaningful way.

[1]  Dumitru Dumitrescu,et al.  A collaborative model for tracking optima in dynamic environments , 2007, 2007 IEEE Congress on Evolutionary Computation.

[2]  Zbigniew Michalewicz,et al.  Searching for optima in non-stationary environments , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[3]  Joshua D. Knowles,et al.  On-Line Purchasing Strategies for an Evolutionary Algorithm Performing Resource-Constrained Optimization , 2010, PPSN.

[4]  John J. Grefenstette,et al.  Genetic Algorithms for Changing Environments , 1992, PPSN.

[5]  Dimitris K. Tasoulis,et al.  Parallel differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[6]  Janez Brest,et al.  Dynamic optimization using Self-Adaptive Differential Evolution , 2009, 2009 IEEE Congress on Evolutionary Computation.

[7]  Kok Cheong Wong,et al.  A New Diploid Scheme and Dominance Change Mechanism for Non-Stationary Function Optimization , 1995, ICGA.

[8]  Xiaodong Li,et al.  This article has been accepted for inclusion in a future issue. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 Locating and Tracking Multiple Dynamic Optima by a Particle Swarm Model Using Speciation , 2022 .

[9]  T. Shores.  Applied Linear Algebra And Matrix Analysis , 1999 .

[10]  Shengxiang Yang,et al.  A comparative study of immune system based genetic algorithms in dynamic environments , 2006, GECCO '06.

[11]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[12]  Fabrício Olivetti de França,et al.  An artificial immune network for multimodal function optimization on dynamic environments , 2005, GECCO.

[13]  Arvind S. Mohais,et al.  DynDE: a differential evolution for dynamic optimization problems , 2005, 2005 IEEE Congress on Evolutionary Computation.

[14]  Swagatam Das,et al.  An Adaptive Differential Evolution Algorithm for Global Optimization in Dynamic Environments , 2014, IEEE Transactions on Cybernetics.

[15]  Dumitru Dumitrescu,et al.  Evolutionary swarm cooperative optimization in dynamic environments , 2009, Natural Computing.

[16]  Jürgen Branke,et al.  Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[17]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[18]  W. Cedeno,et al.  On the use of niching for dynamic landscapes , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[19]  Ming Yang,et al.  Multi-population methods in unconstrained continuous dynamic environments: The challenges , 2015, Inf. Sci..

[20]  Emma Hart,et al.  A Comparison of Dominance Mechanisms and Simple Mutation on Non-stationary Problems , 1998, PPSN.

[21]  Jing Hu,et al.  A Diversity-Guided Particle Swarm Optimizer for Dynamic Environments , 2007, LSMS.

[22]  Rasmus K. Ursem,et al.  Multinational GAs: Multimodal Optimization Techniques in Dynamic Environments , 2000, GECCO.

[23]  Don Coppersmith,et al.  Matrix multiplication via arithmetic progressions , 1987, STOC.

[24]  Steven Orla Kimbrough,et al.  On a Feasible-Infeasible Two-Population (FI-2Pop) genetic algorithm for constrained optimization: Distance tracing and no free lunch , 2008, Eur. J. Oper. Res..

[25]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[26]  D. A. Lind.  Perturbations of Shifts of Finite Type , 1989, SIAM J. Discret. Math..

[27]  Jiang-She Zhang,et al.  A dynamic clustering based differential evolution algorithm for global optimization , 2007, Eur. J. Oper. Res..

[28]  Helen G. Cobb,et al.  An Investigation into the Use of Hypermutation as an Adaptive Operator in Genetic Algorithms Having Continuous, Time-Dependent Nonstationary Environments , 1990 .

[29]  Dimitris K. Tasoulis,et al.  Enhancing Differential Evolution Utilizing Proximity-Based Mutation Operators , 2011, IEEE Transactions on Evolutionary Computation.

[30]  Shengxiang Yang,et al.  Associative Memory Scheme for Genetic Algorithms in Dynamic Environments , 2006, EvoWorkshops.

[31]  Mark Wineberg,et al.  Enhancing the GA's Ability to Cope with Dynamic Environments , 2000, GECCO.

[32]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[33]  Rakesh Angira,et al.  Optimization of dynamic systems: A trigonometric differential evolution approach , 2007, Comput. Chem. Eng..

[34]  Shengxiang Yang,et al.  Particle Swarm Optimization With Composite Particles in Dynamic Environments , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[35]  Stefano Nolfi,et al.  Two is better than one: A diploid genotype for neural networks , 1996, Neural Processing Letters.

[36]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[37]  Hartmut Schmeck,et al.  Designing evolutionary algorithms for dynamic optimization problems , 2003 .

[38]  Changhe Li,et al.  A General Framework of Multipopulation Methods With Clustering in Undetectable Dynamic Environments , 2012, IEEE Transactions on Evolutionary Computation.

[39]  Tom Lenaerts,et al.  Dynamic optimization using evolutionary algorithms with a case-based memory , 2002 .

[40]  Shengxiang Yang,et al.  Compound Particle Swarm Optimization in Dynamic Environments , 2008, EvoWorkshops.

[41]  Ponnuthurai N. Suganthan,et al.  Crowding-based local differential evolution with speciation-based memory archive for dynamic multimodal optimization , 2013, GECCO '13.

[42]  Ming Yang,et al.  An Adaptive Multi-Swarm Optimizer for Dynamic Optimization Problems , 2014, Evolutionary Computation.

[43]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[44]  Shengxiang Yang,et al.  Evolutionary dynamic optimization: A survey of the state of the art , 2012, Swarm Evol. Comput..

[45]  Swagatam Das,et al.  A Cluster-Based Differential Evolution Algorithm With External Archive for Optimization in Dynamic Environments , 2013, IEEE Transactions on Cybernetics.

[46]  Tim Blackwell,et al.  Particle Swarm Optimization in Dynamic Environments , 2007, Evolutionary Computation in Dynamic and Uncertain Environments.

[47]  Changhe Li,et al.  A Clustering Particle Swarm Optimizer for Locating and Tracking Multiple Optima in Dynamic Environments , 2010, IEEE Transactions on Evolutionary Computation.

[48]  L.N. de Castro,et al.  An artificial immune network for multimodal function optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[49]  R.W. Morrison,et al.  Triggered hypermutation revisited , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[50]  P. Suganthan.  Particle swarm optimiser with neighbourhood operator , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[51]  Francisco Herrera,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power , 2010, Inf. Sci..

[52]  Ling Wang,et al.  A hybrid Differential Evolution with double populations for constrained optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[53]  Cécile Murat,et al.  Recent advances in robust optimization: An overview , 2014, Eur. J. Oper. Res..

[54]  Janez Brest,et al.  Differential evolution and differential ant-stigmergy on dynamic optimisation problems , 2013, Int. J. Syst. Sci..

[55]  Shengxiang Yang,et al.  Memory-based immigrants for genetic algorithms in dynamic environments , 2005, GECCO '05.

[56]  Ponnuthurai N. Suganthan,et al.  Adaptive Differential Evolution with Locality based Crossover for Dynamic Optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[57]  F. Wilcoxon.  Individual Comparisons by Ranking Methods , 1945 .

[58]  Jing J. Liang,et al.  Differential Evolution With Neighborhood Mutation for Multimodal Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[59]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[60]  Anabela Simões,et al.  An Immune System-Based Genetic Algorithm to Deal with Dynamic Environments: Diversity and Memory , 2003, ICANNGA.

[61]  Peter J. Bentley,et al.  Dynamic Search With Charged Swarms , 2002, GECCO.

[62]  Xin Yao,et al.  Benchmark Generator for CEC'2009 Competition on Dynamic Optimization , 2008 .

[63]  Changhe Li,et al.  A clustering particle swarm optimizer for dynamic optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[64]  Russell C. Eberhart,et al.  Tracking and optimizing dynamic systems with particle swarms , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[65]  Jürgen Branke,et al.  A Multi-population Approach to Dynamic Optimization Problems , 2000 .

[66]  Andries Petrus Engelbrecht,et al.  Using Competitive Population Evaluation in a differential evolution algorithm for dynamic environments , 2012, Eur. J. Oper. Res..

[67]  Terence C. Fogarty,et al.  Adaptive Combustion Balancing in Multiple Burner Boiler Using a Genetic Algorithm with Variable Range of Local Search , 1997, ICGA.

[68]  Fabrício Olivetti de França,et al.  A dynamic artificial immune algorithm applied to challenging benchmarking problems , 2009, IEEE Congress on Evolutionary Computation.

[69]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[70]  John J. Grefenstette,et al.  Case-Based Initialization of Genetic Algorithms , 1993, ICGA.