Initialization methods for large scale global optimization

Several population initialization methods for evolutionary algorithms (EAs) have been proposed previously. This paper categorizes the most well-known initialization methods and studies the effect of them on large scale global optimization problems. Experimental results indicate that the optimization of large scale problems using EAs is more sensitive to the initial population than optimizing lower dimensional problems. Statistical analysis of results show that basic random number generators, which are the most commonly used method for population initialization in EAs, lead to the inferior performance. Furthermore, our study shows, regardless of the size of the initial population, choosing a proper initialization method is vital for solving large scale problems.

[1]  Ronald W. Morrison.  Dispersion-Based Population Initialization , 2003, GECCO.

[2]  K. Miettinen,et al.  Quasi-random initial population for genetic algorithms , 2004 .

[3]  Ching-Yuen Chan,et al.  An opposition-based chaotic GA/PSO hybrid algorithm and its application in circle detection , 2012, Comput. Math. Appl..

[4]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[5]  A. L. Gutierrez,et al.  Comparison of different PSO initialization techniques for high dimensional search space problems: A test with FSS and antenna arrays , 2011, Proceedings of the 5th European Conference on Antennas and Propagation (EUCAP).

[6]  R. Storn,et al.  Differential Evolution , 2004 .

[7]  Yuanzhen Wang,et al.  Differential Evolution using Uniform-Quasi-Opposition for Initializing the Population , 2010 .

[8]  Shahryar Rahnamayan,et al.  Opposition-Based Differential Evolution for Optimization of Noisy Problems , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[9]  Lei Peng,et al.  A Novel Differential Evolution with Uniform Design for Continuous Global Optimization , 2012, J. Comput..

[10]  Yuping Wang,et al.  An orthogonal genetic algorithm with quantization for global numerical optimization , 2001, IEEE Trans. Evol. Comput..

[11]  Nguyen Xuan Hoai,et al.  Initialising PSO with randomised low-discrepancy sequences: the comparative results , 2007, 2007 IEEE Congress on Evolutionary Computation.

[12]  Millie Pant,et al.  Differential Evolution using Quadratic Interpolation for Initializing the Population , 2009, 2009 IEEE International Advance Computing Conference.

[13]  Jing Wang,et al.  A New Population Initialization Method Based on Space Transformation Search , 2009, 2009 Fifth International Conference on Natural Computation.

[14]  Yanguang Cai,et al.  A hybrid chaotic quantum evolutionary algorithm , 2010, 2010 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[15]  G. Vandenbosch,et al.  Impact of Random Number Generators on the performance of particle swarm optimization in antenna design , 2012, 2012 6th European Conference on Antennas and Propagation (EUCAP).

[16]  Takuji Nishimura,et al.  Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator , 1998, TOMC.

[17]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[18]  Paul Bratley,et al.  Algorithm 659: Implementing Sobol's quasirandom sequence generator , 1988, TOMS.

[19]  Xiaodong Li,et al.  Cooperative Co-evolution for large scale optimization through more frequent random grouping , 2010, IEEE Congress on Evolutionary Computation.

[20]  Mark Richards,et al.  Choosing a starting configuration for particle swarm optimization , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[21]  I. Sloan.  Lattice Methods for Multiple Integration , 1994 .

[22]  Shahryar Rahnamayan,et al.  A novel population initialization method for accelerating evolutionary algorithms , 2007, Comput. Math. Appl..

[23]  Muhammad Asif Jan,et al.  Centroid-based Initialized JADE for global optimization , 2011, 2011 3rd Computer Science and Electronic Engineering Conference (CEEC).

[24]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[25]  Borhan Kazimipour,et al.  A novel genetic-based instance selection method: Using a divide and conquer approach , 2012, The 16th CSI International Symposium on Artificial Intelligence and Signal Processing (AISP 2012).

[26]  Shahryar Rahnamayan,et al.  Quasi-oppositional Differential Evolution , 2007, 2007 IEEE Congress on Evolutionary Computation.

[27]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[28]  Sanyang Liu,et al.  Particle swarm optimization with chaotic opposition-based population initialization and stochastic search technique , 2012 .

[29]  Lei Peng,et al.  UDE: Differential Evolution with Uniform Design , 2010, 2010 3rd International Symposium on Parallel Architectures, Algorithms and Programming.

[30]  Kaisa Miettinen,et al.  On initial populations of a genetic algorithm for continuous optimization problems , 2007, J. Glob. Optim..

[31]  Weifeng Gao,et al.  A modified artificial bee colony algorithm , 2012, Comput. Oper. Res..

[32]  Vinicius Veloso de Melo,et al.  Investigating Smart Sampling as a population initialization method for Differential Evolution in continuous problems , 2012, Inf. Sci..

[33]  Shuhei Kimura,et al.  Genetic algorithms using low-discrepancy sequences , 2005, GECCO '05.

[34]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[35]  Chih-Hsun Chou,et al.  Genetic algorithms: initialization schemes and genes extraction , 2000, Ninth IEEE International Conference on Fuzzy Systems. FUZZ- IEEE 2000 (Cat. No.00CH37063).

[36]  Yu Gao,et al.  A Memetic Differential Evolutionary Algorithm for High Dimensional Functions' Optimization , 2007, Third International Conference on Natural Computation (ICNC 2007).

[37]  Chun Chen,et al.  Multiple trajectory search for Large Scale Global Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).