Differential Evolution: A Survey of the State-of-the-Art

Differential evolution (DE) is arguably one of the most powerful stochastic real-parameter optimization algorithms in current use. DE operates through similar computational steps as employed by a standard evolutionary algorithm (EA). However, unlike traditional EAs, the DE-variants perturb the current-generation population members with the scaled differences of randomly selected and distinct population members. Therefore, no separate probability distribution has to be used for generating the offspring. Since its inception in 1995, DE has drawn the attention of many researchers all over the world resulting in a lot of variants of the basic algorithm with improved performance. This paper presents a detailed review of the basic concepts of DE and a survey of its major variants, its application to multiobjective, constrained, large scale, and uncertain optimization problems, and the theoretical studies conducted on DE so far. Also, it provides an overview of the significant engineering applications that have benefited from the powerful nature of DE.

[1]  Jean-Philippe Thiran,et al.  Extraction of Audio Features Specific to Speech Production for Multimodal Speaker Detection , 2008, IEEE Transactions on Multimedia.

[2]  Qing Wu,et al.  A novel combination method of electrical impedance tomography inverse problem for brain imaging , 2005 .

[3]  Mikhail A. Semenov Analysis of Convergence of an Evolutionary Algorithm with Self-Adaptation using a Stochastic Lyapunov function , 2003, Evolutionary Computation.

[4]  S. Subramanian,et al.  Applications of Differential Evolution in Power System Optimization , 2008 .

[5]  Joni-Kristian Kämäräinen,et al.  Differential Evolution Training Algorithm for Feed-Forward Neural Networks , 2004, Neural Processing Letters.

[6]  Bogdan Filipic,et al.  DEMO: Differential Evolution for Multiobjective Optimization , 2005, EMO.

[7]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[8]  Ling Wang,et al.  An effective co-evolutionary differential evolution for constrained optimization , 2007, Appl. Math. Comput..

[9]  G. van Straten,et al.  Optimal control of nitrate in lettuce by a hybrid approach: differential evolution and adjustable control weight gradient algorithms , 2003 .

[10]  Dimitris K. Tasoulis,et al.  Vector evaluated differential evolution for multiobjective optimization , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[11]  Rainer Storn,et al.  Differential Evolution-A simple evolution strategy for fast optimization , 1997 .

[12]  Mehmet Fatih Tasgetiren,et al.  A Discrete Differential Evolution Algorithm for the Total Earliness and Tardiness Penalties with a Common Due Date on a Single-Machine , 2007, 2007 IEEE Symposium on Computational Intelligence in Scheduling.

[13]  W. Vent,et al.  Rechenberg, Ingo, Evolutionsstrategie — Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. 170 S. mit 36 Abb. Frommann‐Holzboog‐Verlag. Stuttgart 1973. Broschiert , 1975 .

[14]  Hitoshi Iba,et al.  Enhancing differential evolution performance with local search for high dimensional function optimization , 2005, GECCO '05.

[15]  H. Yousefi,et al.  Application of Differential Evolution in system identification of a servo-hydraulic system with a flexible load , 2008 .

[16]  Robert Michael Lewis,et al.  Pattern Search Algorithms for Bound Constrained Minimization , 1999, SIAM J. Optim..

[17]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[18]  Daniela Zaharie Influence of crossover on the behavior of Differential Evolution Algorithms , 2009, Appl. Soft Comput..

[19]  Samir W. Mahfoud Niching methods for genetic algorithms , 1996 .

[20]  Godfrey C. Onwubolu Design of hybrid differential evolution and group method of data handling networks for modeling and prediction , 2008, Inf. Sci..

[21]  Gade Pandu Rangaiah,et al.  A study of differential evolution and tabu search for benchmark, phase equilibrium and phase stability problems , 2007, Comput. Chem. Eng..

[22]  Jongrae Kim,et al.  Clearance of Nonlinear Flight Control Laws Using Hybrid Evolutionary Optimization , 2006, IEEE Transactions on Evolutionary Computation.

[23]  Xin Yao,et al.  Drift analysis and average time complexity of evolutionary algorithms , 2001, Artif. Intell..

[24]  René Thomsen Multimodal optimization using crowding-based differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[25]  Arthur C. Sanderson,et al.  Minimal representation multisensor fusion using differential evolution , 1999, IEEE Trans. Syst. Man Cybern. Part A.

[26]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[27]  Dominique Lesselier,et al.  Hybrid Differential Evolution and Retrieval of Buried Spheres in Subsoil , 2008, IEEE Geoscience and Remote Sensing Letters.

[28]  Amit Konar,et al.  Differential Evolution Using a Neighborhood-Based Mutation Operator , 2009, IEEE Transactions on Evolutionary Computation.

[29]  Chin-Teng Lin,et al.  Nonlinear System Control Using Adaptive Neural Fuzzy Networks Based on a Modified Differential Evolution , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[30]  Nurhan Karaboga,et al.  Digital IIR Filter Design Using Differential Evolution Algorithm , 2005, EURASIP J. Adv. Signal Process..

[31]  Hakan Temeltas,et al.  Fuzzy-differential evolution algorithm for planning time-optimal trajectories of a unicycle mobile robot on a predefined path , 2004, Adv. Robotics.

[32]  H. Abbass The self-adaptive Pareto differential evolution algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[33]  Krzysztof A. Michalski Electromagnetic imaging of circular–cylindrical conductors and tunnels using a differential evolution algorithm , 2000 .

[34]  M. Yamamura,et al.  Multi-parent recombination with simplex crossover in real coded genetic algorithms , 1999 .

[35]  Yanbin Yuan,et al.  A hybrid differential evolution method for dynamic economic dispatch with valve-point effects , 2009, Expert Syst. Appl..

[36]  Heinz Mühlenbein,et al.  Fuzzy Recombination for the Breeder Genetic Algorithm , 1995, ICGA.

[37]  Garrison W. Greenwood,et al.  Convergence in Evolutionary Programs with Self-Adaptation , 2001, Evolutionary Computation.

[38]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[39]  Mehmet Fatih Tasgetiren,et al.  An ensemble of discrete differential evolution algorithms for solving the generalized traveling salesman problem , 2010, Appl. Math. Comput..

[40]  Amit Konar,et al.  Improved differential evolution algorithms for handling noisy optimization problems , 2005, 2005 IEEE Congress on Evolutionary Computation.

[41]  Konstantinos E. Parsopoulos Cooperative micro-differential evolution for high-dimensional problems , 2009, GECCO '09.

[42]  Xin Yao,et al.  Benchmark Generator for CEC'2009 Competition on Dynamic Optimization , 2008 .

[43]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[44]  Mehmet Fatih Tasgetiren,et al.  A discrete differential evolution algorithm for the permutation flowshop scheduling problem , 2008, Comput. Ind. Eng..

[45]  Rakesh Angira,et al.  Optimization of dynamic systems: A trigonometric differential evolution approach , 2007, Comput. Chem. Eng..

[46]  Christian Blum,et al.  Metaheuristics in combinatorial optimization: Overview and conceptual comparison , 2003, CSUR.

[47]  Ponnuthurai N. Suganthan,et al.  A novel hybrid discrete differential evolution algorithm for blocking flow shop scheduling problems , 2010, Comput. Oper. Res..

[48]  Yu Gao,et al.  A Memetic Differential Evolutionary Algorithm for High Dimensional Functions' Optimization , 2007, Third International Conference on Natural Computation (ICNC 2007).

[49]  R. Storn,et al.  Differential evolution a simple and efficient adaptive scheme for global optimization over continu , 1997 .

[50]  Ponnuthurai N. Suganthan,et al.  Ensemble of Constraint Handling Techniques , 2010, IEEE Transactions on Evolutionary Computation.

[51]  Ujjwal Maulik,et al.  Modified differential evolution based fuzzy clustering for pixel classification in remote sensing imagery , 2009, Pattern Recognit..

[52]  Ji-Pyng Chiou,et al.  Robust searching hybrid differential evolution method for optimal reactive power planning in large-scale distribution systems , 2007 .

[53]  Darren Robinson,et al.  A hybrid CMA-ES and HDE optimisation algorithm with application to solar energy potential , 2009, Appl. Soft Comput..

[54]  Ville Tirronen,et al.  An Enhanced Memetic Differential Evolution in Filter Design for Defect Detection in Paper Production , 2008, Evolutionary Computation.

[55]  L. I. Bialyi Optimal synthesis of linear antenna arrays , 1979 .

[56]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[57]  Ponnuthurai N. Suganthan,et al.  Multi-objective evolutionary algorithms based on the summation of normalized objectives and diversified selection , 2010, Inf. Sci..

[58]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[59]  Rainer Laur,et al.  Constrained Single-Objective Optimization Using Differential Evolution , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[60]  M. M. Ali,et al.  Differential evolution algorithms using hybrid mutation , 2007, Comput. Optim. Appl..

[61]  Arthur C. Sanderson,et al.  Modeling and convergence analysis of a continuous multi-objective differential evolution algorithm , 2005, 2005 IEEE Congress on Evolutionary Computation.

[62]  Ponnuthurai N. Suganthan,et al.  Multi-objective optimization using self-adaptive differential evolution algorithm , 2009, 2009 IEEE Congress on Evolutionary Computation.

[63]  James Kennedy Bare bones particle swarms , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).

[64]  LUIS VICENTE SANTANA-QUINTERO,et al.  1 AN ALGORITHM BASED ON DIFFERENTIAL EVOLUTION FOR MULTIOBJECTIVE PROBLEMS , 2005 .

[65]  Isao Ono,et al.  A Real Coded Genetic Algorithm for Function Optimization Using Unimodal Normal Distributed Crossover , 1997, International Conference on Genetic Algorithms.

[66]  Kenneth de Jong,et al.  Evolutionary computation: a unified approach , 2007, GECCO.

[67]  Chinyao Low,et al.  An ant direction hybrid differential evolution heuristic for the large-scale passive harmonic filters planning problem , 2008, Expert Syst. Appl..

[68]  Andries Petrus Engelbrecht,et al.  Bare bones differential evolution , 2009, Eur. J. Oper. Res..

[69]  Kalyanmoy Deb,et al.  Simulated Binary Crossover for Continuous Search Space , 1995, Complex Syst..

[70]  Riccardo Poli,et al.  Evolving Problems to Learn About Particle Swarm Optimizers and Other Search Algorithms , 2007, IEEE Transactions on Evolutionary Computation.

[71]  Haibin Duan,et al.  DEACO: Hybrid Ant Colony Optimization with Differential Evolution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[72]  Peter J. Fleming,et al.  Evolutionary many-objective optimisation: an exploratory analysis , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[73]  Xiaohui Yuan,et al.  Application of enhanced discrete differential evolution approach to unit commitment problem , 2009 .

[74]  R. Galar,et al.  Evolutionary search with soft selection , 2004, Biological Cybernetics.

[75]  Amit Konar,et al.  Automatic image pixel clustering with an improved differential evolution , 2009, Appl. Soft Comput..

[76]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[77]  Dexian Huang,et al.  An effective hybrid DE-based algorithm for multi-objective flow shop scheduling with limited buffers , 2009, Comput. Oper. Res..

[78]  J. Lampinen A constraint handling approach for the differential evolution algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[79]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[80]  Andries Petrus Engelbrecht,et al.  Self-adaptive Differential Evolution , 2005, CIS.

[81]  B. Polajzer,et al.  Determining Magnetically Nonlinear Characteristics of Transformers and Iron Core Inductors by Differential Evolution , 2008, IEEE Transactions on Magnetics.

[82]  Xin Yao,et al.  Making a Difference to Differential Evolution , 2008, Advances in Metaheuristics for Hard Optimization.

[83]  Anyong Qing Electromagnetic inverse scattering of multiple perfectly conducting cylinders by differential evolution strategy with individuals in groups (GDES) , 2004 .

[84]  Rainer Storn System design by constraint adaptation and differential evolution , 1999, IEEE Trans. Evol. Comput..

[85]  Ponnuthurai N. Suganthan,et al.  Multi-objective differential evolution with diversity enhancement , 2010, Journal of Zhejiang University SCIENCE C.

[86]  Amit Konar,et al.  Cooperative multi-robot path planning using differential evolution , 2009, J. Intell. Fuzzy Syst..

[87]  Alain Pétrowski A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[88]  M. F. Tasgetiren,et al.  A differential evolution algorithm for the no-idle flowshop scheduling problem with total tardiness criterion , 2011 .

[89]  Colin R. Reeves,et al.  Genetic Algorithms: Principles and Perspectives: A Guide to Ga Theory , 2002 .

[90]  S. Baskar,et al.  Evolutionary algorithms based design of multivariable PID controller , 2009, Expert Syst. Appl..

[91]  R. Storn Designing nonstandard filters with differential evolution , 2005 .

[92]  D. Lowther,et al.  Differential Evolution Strategy for Constrained Global Optimization and Application to Practical Engineering Problems , 2006, IEEE Transactions on Magnetics.

[93]  Veysel Aslantas An optimal robust digital image watermarking based on SVD using differential evolution algorithm , 2009 .

[94]  Ji-Pyng Chiou,et al.  Ant direction hybrid differential evolution for solving large capacitor placement problems , 2004 .

[95]  Mehmet Fatih Tasgetiren,et al.  A Discrete Differential Evolution Algorithm for the No-Wait Flowshop Scheduling Problem with Total Flowtime Criterion , 2007, 2007 IEEE Symposium on Computational Intelligence in Scheduling.

[96]  Ponnuthurai N. Suganthan,et al.  Empirical study on the effect of population size on Differential evolution Algorithm , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[97]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Trans. Evol. Comput..

[98]  Ferrante Neri,et al.  Memetic Compact Differential Evolution for Cartesian Robot Control , 2010, IEEE Computational Intelligence Magazine.

[99]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[100]  S. Mishra Bacteria foraging based solution to optimize both real power loss and voltage stability limit , 2007, 2007 IEEE Power Engineering Society General Meeting.

[101]  Shiwen Yang,et al.  Mutual coupling compensation in time modulated linear antenna arrays , 2005 .

[102]  Stefan Janaqi,et al.  Generalization of the strategies in differential evolution , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[103]  Mehmet Fatih Tasgetiren,et al.  A discrete differential evolution algorithm for single machine total weighted tardiness problem with sequence dependent setup times , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[104]  Andries Petrus Engelbrecht,et al.  Binary Differential Evolution , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[105]  G. Stumberger,et al.  Parameter Identification of the Jiles–Atherton Hysteresis Model Using Differential Evolution , 2008, IEEE Transactions on Magnetics.

[106]  Amit Konar,et al.  Improving particle swarm optimization with differentially perturbed velocity , 2005, GECCO '05.

[107]  Mehmet Sevkli,et al.  Differential Evolution Algorithm for Permutation Flowshop Sequencing Problem with Makespan Criterion , 2004 .

[108]  Leandro dos Santos Coelho,et al.  B-spline neural network design using improved differential evolution for identification of an experimental nonlinear process , 2008, Appl. Soft Comput..

[109]  Dimitris K. Tasoulis,et al.  Parallel differential evolution , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[110]  Janez Brest,et al.  Dynamic optimization using Self-Adaptive Differential Evolution , 2009, 2009 IEEE Congress on Evolutionary Computation.

[111]  Jouni Lampinen,et al.  Constrained Real-Parameter Optimization with Generalized Differential Evolution , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[112]  Arthur C. Sanderson,et al.  Multi-objective differential evolution - algorithm, convergence analysis, and applications , 2005, 2005 IEEE Congress on Evolutionary Computation.

[113]  Bo Liu,et al.  Hybrid differential evolution for noisy optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[114]  Godfrey C. Onwubolu,et al.  Scheduling flow shops using differential evolution algorithm , 2006, Eur. J. Oper. Res..

[115]  Ville Tirronen,et al.  Scale factor inheritance mechanism in distributed differential evolution , 2010, Soft Comput..

[116]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[117]  Jürgen Branke Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[118]  Ajith Abraham,et al.  On stability and convergence of the population-dynamics in differential evolution , 2009, AI Commun..

[119]  Amit Konar,et al.  Two improved differential evolution schemes for faster global search , 2005, GECCO '05.

[120]  Suteaki Shioya,et al.  Application of a mathematical model and Differential Evolution algorithm approach to optimization of bacteriocin production by Lactococcus lactis C7 , 2005, Bioprocess and biosystems engineering.

[121]  M. Montaz Ali,et al.  Population set-based global optimization algorithms: some modifications and numerical studies , 2004, Computers & Operations Research.

[122]  L. Wang,et al.  A DE-based approach to no-wait flow-shop scheduling , 2009, Comput. Ind. Eng..

[123]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[124]  Swagatam Das,et al.  Automatic Clustering Using an Improved Differential Evolution Algorithm , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[125]  Amit Konar,et al.  Annealed Differential Evolution , 2007, 2007 IEEE Congress on Evolutionary Computation.

[126]  Rainer Storn Differential evolution design of an IIR-filter , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[127]  Carlos A. Coello Coello,et al.  Solving Hard Multiobjective Optimization Problems Using epsilon-Constraint with Cultured Differential Evolution , 2006, PPSN.

[128]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2009, Artificial Intelligence Review.

[129]  A. Massa,et al.  Optimization of the Directivity of a Monopulse Antenna With a Subarray Weighting by a Hybrid Differential Evolution Method , 2006, IEEE Antennas and Wireless Propagation Letters.

[130]  Ganesh K. Venayagamoorthy,et al.  Evolving Digital Circuits Using Hybrid Particle Swarm Optimization and Differential Evolution , 2006, Int. J. Neural Syst..

[131]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[132]  W. Price Global optimization by controlled random search , 1983 .

[133]  Hamid R. Tizhoosh Opposition-Based Learning: A New Scheme for Machine Intelligence , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[134]  Chyi Hwang,et al.  Optimal approximation of linear systems by a differential evolution algorithm , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[135]  Janez Brest,et al.  Differential evolution for multiobjective optimization with self adaptation , 2007, 2007 IEEE Congress on Evolutionary Computation.

[136]  George D. Magoulas,et al.  Neural network-based colonoscopic diagnosis using on-line learning and differential evolution , 2004, Appl. Soft Comput..

[137]  Z. Dong,et al.  A Modified Differential Evolution Algorithm With Fitness Sharing for Power System Planning , 2008, IEEE Transactions on Power Systems.

[138]  Kenneth V. Price,et al.  An introduction to differential evolution , 1999 .

[139]  P. Suganthan,et al.  Differential evolution algorithm with ensemble of populations for global numerical optimization , 2009 .

[140]  Janez Brest,et al.  History mechanism supported differential evolution for chess evaluation function tuning , 2010, Soft Comput..

[141]  Donald C. Wunsch,et al.  Modeling of gene regulatory networks with hybrid differential evolution and particle swarm optimization , 2007, Neural Networks.

[142]  Ivanoe De Falco,et al.  Differential Evolution as a viable tool for satellite image registration , 2008, Appl. Soft Comput..

[143]  Marco Laumanns,et al.  Combining Convergence and Diversity in Evolutionary Multiobjective Optimization , 2002, Evolutionary Computation.

[144]  P. Suganthan,et al.  Constrained multi-objective optimization algorithm with an ensemble of constraint handling methods , 2011 .

[145]  Ryszard S. Michalski,et al.  The LEM3 implementation of learnable evolution model and its testing on complex function optimization problems , 2006, GECCO '06.

[146]  Sandra Paterlini,et al.  Differential evolution and particle swarm optimisation in partitional clustering , 2006, Comput. Stat. Data Anal..

[147]  Andrew M. Sutton,et al.  Differential evolution and non-separability: using selective pressure to focus search , 2007, GECCO '07.

[148]  Hans-Georg Beyer,et al.  The Theory of Evolution Strategies , 2001, Natural Computing Series.

[149]  Nikolaus Hansen,et al.  Evaluating the CMA Evolution Strategy on Multimodal Test Functions , 2004, PPSN.

[150]  Heitor Silvério Lopes,et al.  A Differential Evolution Approach for Protein Folding Using a Lattice Model , 2007, Journal of Computer Science and Technology.

[151]  Janez Brest,et al.  Population size reduction for the differential evolution algorithm , 2007, Applied Intelligence.

[152]  Jason Teo Exploring dynamic self-adaptive populations in differential evolution , 2006, Soft Comput..

[153]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[154]  Carlos A. Coello Coello,et al.  Simple Feasibility Rules and Differential Evolution for Constrained Optimization , 2004, MICAI.

[155]  Günter Rudolph Convergence of evolutionary algorithms in general search spaces , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[156]  Iwona Karcz-Duleba Dynamics of infinite populations evolving in a landscape of uni and bimodal fitness functions , 2001, IEEE Trans. Evol. Comput..

[157]  Qingfu Zhang,et al.  A Multiobjective Differential Evolution Based on Decomposition for Multiobjective Optimization with Variable Linkages , 2006, PPSN.

[158]  Hussein A. Abbass,et al.  The Pareto Differential Evolution Algorithm , 2002, Int. J. Artif. Intell. Tools.

[159]  Ivan Zelinka,et al.  MIXED INTEGER-DISCRETE-CONTINUOUS OPTIMIZATION BY DIFFERENTIAL EVOLUTION Part 2 : a practical example , 1999 .

[160]  Arvind S. Mohais,et al.  DynDE: a differential evolution for dynamic optimization problems , 2005, 2005 IEEE Congress on Evolutionary Computation.

[161]  D. Dasgupta Artificial Immune Systems and Their Applications , 1998, Springer Berlin Heidelberg.

[162]  Georges R. Harik Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[163]  Wei-Der Chang Parameter identification of Chen and Lü systems: A differential evolution approach , 2007 .

[164]  Janez Brest,et al.  High-dimensional real-parameter optimization using Self-Adaptive Differential Evolution algorithm with population size reduction , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[165]  K.P. Wong,et al.  Parallel Optimal Reactive Power Flow Based on Cooperative Co-Evolutionary Differential Evolution and Power System Decomposition , 2007, IEEE Transactions on Power Systems.

[166]  Janez Brest,et al.  Performance comparison of self-adaptive and adaptive differential evolution algorithms , 2007, Soft Comput..

[167]  Ville Tirronen,et al.  Super-fit control adaptation in memetic differential evolution frameworks , 2009, Soft Comput..

[168]  Kalyanmoy Deb,et al.  Self-Adaptive Genetic Algorithms with Simulated Binary Crossover , 2001, Evolutionary Computation.

[169]  Uday K. Chakraborty,et al.  Advances in Differential Evolution , 2010 .

[170]  Mehmet Fatih Tasgetiren,et al.  Multi-objective optimization based on self-adaptive differential evolution algorithm , 2007, 2007 IEEE Congress on Evolutionary Computation.

[171]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[172]  A. Kai Qin,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[173]  Vadlamani Ravi,et al.  Differential evolution trained wavelet neural networks: Application to bankruptcy prediction in banks , 2009, Expert Syst. Appl..

[174]  Jouni Lampinen,et al.  GDE3: the third evolution step of generalized differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[175]  Z. Nie,et al.  The Application of a Modified Differential Evolution Strategy to Some Array Pattern Synthesis Problems , 2008, IEEE Transactions on Antennas and Propagation.

[176]  Taïcir Loukil,et al.  Differential evolution for solving multi-mode resource-constrained project scheduling problems , 2009, Comput. Oper. Res..

[177]  John H. Holland,et al.  Adaptation in natural and artificial systems , 1975 .

[178]  Swagatam Das,et al.  LINEAR ANTENNA ARRAY SYNTHESIS WITH CONSTRAINED MULTI-OBJECTIVE DIFFERENTIAL EVOLUTION , 2010, Progress In Electromagnetics Research B.

[179]  P. N. Suganthan,et al.  Ensemble of niching algorithms , 2010, Inf. Sci..

[180]  Andries Petrus Engelbrecht Fundamentals of Computational Swarm Intelligence , 2005 .

[181]  Amit Konar,et al.  Swarm Intelligence Algorithms in Bioinformatics , 2008, Computational Intelligence in Bioinformatics.

[182]  Amitava Chatterjee Differential evolution tuned fuzzy supervisor adapted extended Kalman filtering for SLAM problems in mobile robots , 2009, Robotica.

[183]  B. V. Babu,et al.  Modified differential evolution (MDE) for optimization of non-linear chemical processes , 2006, Comput. Chem. Eng..

[184]  C. Su,et al.  Variable scaling hybrid differential evolution for solving network reconfiguration of distribution systems , 2005 .

[185]  Anyong Qing,et al.  Anisotropy of composite materials with inclusion with orientation preference , 2005, IEEE Transactions on Antennas and Propagation.

[186]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[187]  Xiaodong Li,et al.  Solving Rotated Multi-objective Optimization Problems Using Differential Evolution , 2004, Australian Conference on Artificial Intelligence.

[188]  R. Storn On the usage of differential evolution for function optimization , 1996, Proceedings of North American Fuzzy Information Processing.

[189]  Mohamed E. El-Hawary,et al.  A Survey of Particle Swarm Optimization Applications in Electric Power Systems , 2009, IEEE Transactions on Evolutionary Computation.

[190]  Ponnuthurai Nagaratnam Suganthan,et al.  Fiber Bragg grating sensor array interrogation using differential evolution , 2008 .

[191]  Amit Konar,et al.  Two-Dimensional IIR Filter Design with Modern Search Heuristics: a Comparative Study , 2006, Int. J. Comput. Intell. Appl..

[192]  B. V. Babu,et al.  Multiobjective differential evolution (MODE) for optimization of adiabatic styrene reactor , 2005 .

[193]  Dr. Zbigniew Michalewicz,et al.  How to Solve It: Modern Heuristics , 2004, Springer Berlin Heidelberg.

[194]  Feng-Sheng Wang,et al.  Hybrid method of evolutionary algorithms for static and dynamic optimization problems with application to a fed-batch fermentation process , 1999 .

[195]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[196]  Carlos A. Coello Coello,et al.  DEMORS: A hybrid multi-objective optimization algorithm using differential evolution and rough set theory for constrained problems , 2010, Comput. Oper. Res..

[197]  A. Kai Qin,et al.  Robust growing neural gas algorithm with application in cluster analysis , 2004, Neural Networks.

[198]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[199]  Janez Brest,et al.  Large Scale Global Optimization using Differential Evolution with self-adaptation and cooperative co-evolution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[200]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[201]  L. G. van Willigenburg,et al.  Efficient Differential Evolution algorithms for multimodal optimal control problems , 2003, Appl. Soft Comput..

[202]  K. Price Differential evolution vs. the functions of the 2/sup nd/ ICEO , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[203]  Swagatam Das,et al.  SYNTHESIS OF DIFFERENCE PATTERNS FOR MONOPULSE ANTENNAS WITH OPTIMAL COMBINATION OF ARRAY-SIZE AND NUMBER OF SUBARRAYS --- A MULTI-OBJECTIVE OPTIMIZATION APPROACH , 2010, Progress In Electromagnetics Research B.

[204]  Carlos A. Coello Coello,et al.  Modified Differential Evolution for Constrained Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[205]  Ajith Abraham,et al.  The population dynamics of Differential Evolution: A mathematical model , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[206]  Ajith Abraham,et al.  A Synergy of Differential Evolution and Bacterial Foraging Algorithm for Global Optimization , 2007 .

[207]  Wenjian Luo,et al.  Differential evolution with dynamic stochastic selection for constrained optimization , 2008, Inf. Sci..

[208]  H. Iba,et al.  Inferring Gene Regulatory Networks using Differential Evolution with Local Search Heuristics , 2007, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[209]  Biao Yang,et al.  Computing Nonlinear $\tau$-Estimation Based on Dynamic Differential Evolution Strategy , 2006, IEEE Signal Processing Letters.

[210]  L. Coelho Reliability–redundancy optimization by means of a chaotic differential evolution approach , 2009 .

[211]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[212]  Enrique Alba,et al.  Parallelism and evolutionary algorithms , 2002, IEEE Trans. Evol. Comput..

[213]  Dimitris K. Tasoulis,et al.  A Review of Major Application Areas of Differential Evolution , 2008 .

[214]  Ivan Zelinka,et al.  ON STAGNATION OF THE DIFFERENTIAL EVOLUTION ALGORITHM , 2000 .

[215]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[216]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, International Conference on Genetic Algorithms.

[217]  Chi-Jui Wu,et al.  Optimal multiobjective planning of large-scale passive harmonic filters using hybrid differential evolution method considering parameter and loading uncertainty , 2005 .

[218]  D. Zaharie Statistical Properties of Differential Evolution and Related Random Search Algorithms , 2008 .

[219]  Andreas C. Nearchou Balancing large assembly lines by a new heuristic based on differential evolution method , 2007 .

[220]  K. P. Wong,et al.  Robust power system stabiliser design under multi-operating conditions using differential evolution , 2008 .

[221]  Spatially-Structured Sharing Technique for Multimodal Problems , 2008, Journal of Computer Science and Technology.

[222]  L. Darrell Whitley,et al.  The GENITOR Algorithm and Selection Pressure: Why Rank-Based Allocation of Reproductive Trials is Best , 1989, ICGA.

[223]  Guoshao Su Gaussian Process Assisted Differential Evolution Algorithm for Computationally Expensive Optimization Problems , 2008, 2008 IEEE Pacific-Asia Workshop on Computational Intelligence and Industrial Application.

[224]  Shiwen Yang,et al.  Sideband suppression in time-modulated linear arrays by the differential evolution algorithm , 2002 .

[225]  Bidyadhar Subudhi,et al.  Differential Evolution and Levenberg Marquardt Trained Neural Network Scheme for Nonlinear System Identification , 2008, Neural Processing Letters.

[226]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[227]  Gary B. Fogel,et al.  Noisy optimization problems - a particular challenge for differential evolution? , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[228]  Xing Xu,et al.  A novel differential evolution scheme combined with particle swarm intelligence , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[229]  Kalyanmoy Deb,et al.  On self-adaptive features in real-parameter evolutionary algorithms , 2001, IEEE Trans. Evol. Comput..

[230]  Lin Han,et al.  A novel binary differential evolution algorithm based on artificial immune system , 2007, 2007 IEEE Congress on Evolutionary Computation.

[231]  A. Massa,et al.  Optimization of the difference patterns for monopulse antennas by a hybrid real/integer-coded differential evolution method , 2005, IEEE Transactions on Antennas and Propagation.

[232]  Quan-Ke Pan,et al.  A novel differential evolution algorithm for bi-criteria no-wait flow shop scheduling problems , 2009, Comput. Oper. Res..

[233]  Anyong Qing Electromagnetic inverse scattering of multiple two-dimensional perfectly conducting objects by the differential evolution strategy , 2003 .

[234]  Xin Yao,et al.  Differential evolution for high-dimensional function optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[235]  Malabika Basu Optimal power flow with FACTS devices using differential evolution , 2008 .

[236]  M. M. Ali,et al.  An Iterative Global Optimization Algorithm for Potential Energy Minimization , 2005, Comput. Optim. Appl..

[237]  Anyong Qing Dynamic differential evolution strategy and applications in electromagnetic inverse scattering problems , 2006, IEEE Trans. Geosci. Remote. Sens..

[238]  Rainer Laur,et al.  RUN TIME ANALYSIS REGARDING STOPPING CRITERIA FOR DIFFERENTIAL EVOLUTION AND PARTICLE SWARM OPTIMIZATION , 2005 .

[239]  Andreas C. Nearchou A differential evolution approach for the common due date early/tardy job scheduling problem , 2008, Comput. Oper. Res..

[240]  B. Babu,et al.  Estimation of heat transfer parameters in a trickle-bed reactor using differential evolution and orthogonal collocation , 1999 .

[241]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[242]  He-sheng Tang,et al.  Differential evolution strategy for structural system identification , 2008 .

[243]  Godfrey C. Onwubolu,et al.  Differential Evolution: A Handbook for Global Permutation-Based Combinatorial Optimization , 2009 .

[244]  Ingo Rechenberg,et al.  Evolutionsstrategie : Optimierung technischer Systeme nach Prinzipien der biologischen Evolution , 1973 .

[245]  Thomas Hanne On the convergence of multiobjective evolutionary algorithms , 1999, Eur. J. Oper. Res..

[246]  Anyong Qing Differential Evolution: Fundamentals and Applications in Electrical Engineering , 2009 .

[247]  H. Iba,et al.  Differential evolution for economic load dispatch problems , 2008 .

[248]  Tetsuyuki Takahama,et al.  Constrained Optimization by the ε Constrained Differential Evolution with Gradient-Based Mutation and Feasible Elites , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[249]  Kalyanmoy Deb,et al.  A Computationally Efficient Evolutionary Algorithm for Real-Parameter Optimization , 2002, Evolutionary Computation.

[250]  J.-P. Chiou A variable scaling hybrid differential evolution for solving large-scale power dispatch problems , 2009 .

[251]  Wei-Der Chang Two-dimensional fractional-order digital differentiator design by using differential evolution algorithm , 2009, Digit. Signal Process..

[252]  Xiao-Feng Xie,et al.  DEPSO: hybrid particle swarm with differential evolution operator , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[253]  Rainer Storn,et al.  Differential Evolution Research – Trends and Open Questions , 2008 .

[254]  Amin Nobakhti,et al.  A simple self-adaptive Differential Evolution algorithm with application on the ALSTOM gasifier , 2008, Appl. Soft Comput..

[255]  Amit Konar,et al.  Metaheuristic Clustering , 2009, Studies in Computational Intelligence.

[256]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[257]  Ponnuthurai N. Suganthan,et al.  Novel multimodal problems and differential evolution with ensemble of restricted tournament selection , 2010, IEEE Congress on Evolutionary Computation.

[258]  Dexian Huang,et al.  Designing Neural Networks Using Hybrid Particle Swarm Optimization , 2005, ISNN.

[259]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[260]  Shahryar Rahnamayan,et al.  Opposition-Based Differential Evolution for Optimization of Noisy Problems , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[261]  Thomas Bäck,et al.  Evolutionary computation: comments on the history and current state , 1997, IEEE Trans. Evol. Comput..

[262]  Mehmet Fatih Tasgetiren,et al.  A Multi-Populated Differential Evolution Algorithm for Solving Constrained Optimization Problem , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[263]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[264]  H. B. Quek,et al.  Pareto-optimal set based multiobjective tuning of fuzzy automatic train operation for mass transit system , 1999 .

[265]  M. M. Ali,et al.  A local exploration-based differential evolution algorithm for constrained global optimization , 2009, Appl. Math. Comput..

[266]  Fawaz S. Al-Anzi,et al.  A self-adaptive differential evolution heuristic for two-stage assembly scheduling problem to minimize maximum lateness with setup times , 2007, Eur. J. Oper. Res..

[267]  Jouni Lampinen,et al.  A Trigonometric Mutation Operation to Differential Evolution , 2003, J. Glob. Optim..

[268]  Yong Gao,et al.  Comments on "Theoretical analysis of evolutionary algorithms with an infinite population size in continuous space. I. Basic properties of selection and mutation" [and reply] , 1998, IEEE Trans. Neural Networks.

[269]  A. Hernandez-Aguirre,et al.  PESO+for Constrained Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[270]  Han Huang,et al.  A Particle Swarm Optimization Algorithm with Differential Evolution , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[271]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[272]  Tim Hendtlass A Combined Swarm Differential Evolution Algorithm for Optimization Problems , 2001, IEA/AIE.

[273]  Feng-Sheng Wang,et al.  Hybrid differential evolution with geometric mean mutation in parameter estimation of bioreaction systems with large parameter search space , 2009, Comput. Chem. Eng..

[274]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[275]  Christopher G. Langton Artificial Life: An Overview , 1995 .

[276]  Rainer Storn,et al.  Minimizing the real functions of the ICEC'96 contest by differential evolution , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[277]  N. P. Padhy,et al.  Application of particle swarm optimization technique and its variants to generation expansion planning problem , 2004 .

[278]  Dana Petcu,et al.  Adaptive Pareto Differential Evolution and Its Parallelization , 2003, PPAM.

[279]  Ville Tirronen,et al.  Scale factor local search in differential evolution , 2009, Memetic Comput..

[280]  Andy J. Keane,et al.  Meta-Lamarckian learning in memetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[281]  Dolores Blanco,et al.  Differential evolution solution to the SLAM problem , 2009, Robotics Auton. Syst..

[282]  Arthur C. Sanderson,et al.  Pareto-based multi-objective differential evolution , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[283]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[284]  C. Coello,et al.  Cultured differential evolution for constrained optimization , 2006 .

[285]  A. Kai Qin,et al.  Self-adaptive Differential Evolution Algorithm for Constrained Real-Parameter Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[286]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[287]  L. Coelho,et al.  Combining of chaotic differential evolution and quadratic programming for economic dispatch optimization with valve-point effect , 2006, IEEE Transactions on Power Systems.

[288]  Xiaofeng Wang,et al.  Shape recognition based on neural networks trained by differential evolution algorithm , 2007, Neurocomputing.

[289]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO '06.

[290]  P. John Clarkson,et al.  Erratum: A Species Conserving Genetic Algorithm for Multimodal Function Optimization , 2003, Evolutionary Computation.

[291]  Ziad Kobti,et al.  A multi-agent simulation using cultural algorithms: the effect of culture on the resilience of social systems , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[292]  Xin Yao,et al.  Self-adaptive differential evolution with neighborhood search , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[293]  Rainer Storn Differential Evolution Design of an IIR-Filter with Requirements for Magnitude and Group Delay , 1995 .

[294]  Salman Mohagheghi,et al.  Particle Swarm Optimization: Basic Concepts, Variants and Applications in Power Systems , 2008, IEEE Transactions on Evolutionary Computation.

[295]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[296]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[297]  A. F. Ioffe,et al.  NEW MIGRATION SCHEME FOR PARALLEL DIFFERENTIAL EVOLUTION , 2006 .

[298]  P. Murugan,et al.  Solutions to transmission constrained generation expansion planning using differential evolution , 2009 .