Effects of population initialization on differential evolution for large scale optimization

This work provides an in-depth investigation of the effects of population initialization on Differential Evolution (DE) for dealing with large scale optimization problems. Firstly, we conduct a statistical parameter sensitive analysis to study the effects of DE's control parameters on its performance of solving large scale problems. This study reveals the optimal parameter configurations which can lead to the statistically superior performance over the CEC-2013 large-scale test problems. Thus identified optimal parameter configurations interestingly favour much larger population sizes while agreeing with the other parameter settings compared to the most commonly employed parameter configuration. Based on one of the identified optimal configurations and the most commonly used configuration, which only differ in the population size, we investigate the influence of various population initialization techniques on DE's performance. This study indicates that initialization plays a more crucial role in DE with a smaller population size. However, this observation might be the result of insufficient convergence due to the use of a large population size under the limited computational budget, which deserve more investigations.

[1]  I. Sloan.  Lattice Methods for Multiple Integration , 1994 .

[2]  Lei Peng,et al.  UDE: Differential Evolution with Uniform Design , 2010, 2010 3rd International Symposium on Parallel Architectures, Algorithms and Programming.

[3]  A. Kai Qin,et al.  A review of population initialization techniques for evolutionary algorithms , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[4]  Vinicius Veloso de Melo,et al.  Investigating Smart Sampling as a population initialization method for Differential Evolution in continuous problems , 2012, Inf. Sci..

[5]  G. Vandenbosch,et al.  Impact of Random Number Generators on the performance of particle swarm optimization in antenna design , 2012, 2012 6th European Conference on Antennas and Propagation (EUCAP).

[6]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[7]  M. Giphart-Gassler,et al.  Thermo-inducible expression of cloned early genes of bacteriophage Mu. , 1979, Gene.

[8]  Ajith Abraham,et al.  Unconventional initialization methods for differential evolution , 2013, Appl. Math. Comput..

[9]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[10]  Uday K. Chakraborty,et al.  Advances in Differential Evolution , 2010 .

[11]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[12]  Yu Gao,et al.  A Memetic Differential Evolutionary Algorithm for High Dimensional Functions' Optimization , 2007, Third International Conference on Natural Computation (ICNC 2007).

[13]  Amit Konar,et al.  Two improved differential evolution schemes for faster global search , 2005, GECCO '05.

[14]  Borhan Kazimipour,et al.  A novel genetic-based instance selection method: Using a divide and conquer approach , 2012, The 16th CSI International Symposium on Artificial Intelligence and Signal Processing (AISP 2012).

[15]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[16]  H. Abbass.  The self-adaptive Pareto differential evolution algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[17]  Shuhei Kimura,et al.  Genetic algorithms using low-discrepancy sequences , 2005, GECCO '05.

[18]  Xiaodong Li,et al.  A novel hybridization of opposition-based learning and cooperative co-evolutionary for large-scale optimization , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[19]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[20]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[21]  Millie Pant,et al.  Differential Evolution using Quadratic Interpolation for Initializing the Population , 2009, 2009 IEEE International Advance Computing Conference.

[22]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[23]  K. Miettinen,et al.  Quasi-random initial population for genetic algorithms , 2004 .

[24]  Xiaodong Li,et al.  Initialization methods for large scale global optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[25]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[26]  Francisco Herrera,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power , 2010, Inf. Sci..

[27]  Ching-Yuen Chan,et al.  An opposition-based chaotic GA/PSO hybrid algorithm and its application in circle detection , 2012, Comput. Math. Appl..

[28]  A. L. Gutierrez,et al.  Comparison of different PSO initialization techniques for high dimensional search space problems: A test with FSS and antenna arrays , 2011, Proceedings of the 5th European Conference on Antennas and Propagation (EUCAP).

[29]  Russel E. Caflisch,et al.  Quasi-Random Sequences and Their Discrepancies , 1994, SIAM J. Sci. Comput..

[30]  Shahryar Rahnamayan,et al.  Opposition versus randomness in soft computing techniques , 2008, Appl. Soft Comput..

[31]  Shahryar Rahnamayan,et al.  A novel population initialization method for accelerating evolutionary algorithms , 2007, Comput. Math. Appl..

[32]  Ronald W. Morrison.  Dispersion-Based Population Initialization , 2003, GECCO.

[33]  Paul Bratley,et al.  Algorithm 659: Implementing Sobol's quasirandom sequence generator , 1988, TOMS.

[34]  Xiaodong Li,et al.  Differential evolution on the CEC-2013 single-objective continuous optimization testbed , 2013, 2013 IEEE Congress on Evolutionary Computation.

[35]  I. Sloan,et al.  Low discrepancy sequences in high dimensions: How well are their projections distributed? , 2008 .

[36]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[37]  Shahryar Rahnamayan,et al.  Quasi-oppositional Differential Evolution , 2007, 2007 IEEE Congress on Evolutionary Computation.

[38]  Li Zhao,et al.  A review of opposition-based learning from 2005 to 2012 , 2014, Eng. Appl. Artif. Intell..

[39]  Takuji Nishimura,et al.  Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator , 1998, TOMC.