Diversity Guided Evolutionary Programming: A novel approach for continuous optimization

Avoiding premature convergence to local optima and rapid convergence towards global optima has been the major concern with evolutionary systems research. In order to avoid premature convergence, sufficient amount of genetic diversity within the evolving population is considered necessary. Several studies have focused to devise techniques to control and preserve population diversity throughout the evolution. Since mutation is the major operator in many evolutionary systems, such as evolutionary programming and evolutionary strategies, a significant amount of research has also been done for the elegant control and adaptation of the mutation step size that is proper for traversing across the locally optimum points and reach for the global optima. This paper introduces Diversity Guided Evolutionary Programming, a novel approach to combine the best of both these research directions. This scheme incorporates diversity guided mutation, an innovative mutation scheme that guides the mutation step size using the population diversity information. It also takes some extra diversity preservative measures to maintain adequate amount of population diversity in order to assist the proposed mutation scheme. An extensive simulation has been done on a wide range of benchmark numeric optimization problems and the results have been compared with a number of recent evolutionary systems. Experimental results show that the performance of the proposed system is often better than most other algorithms in comparison on most of the problems.

[1]  Shengxiang Yang,et al.  PDGA: the Primal-Dual Genetic Algorithm , 2003, HIS.

[2]  Kwang Ryel Ryu,et al.  Crew pairing optimization by a genetic algorithm with unexpressed genes , 2006, J. Intell. Manuf..

[3]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[4]  Erick Cantú-Paz,et al.  Migration Policies, Selection Pressure, and Parallel Evolutionary Algorithms , 2001, J. Heuristics.

[5]  Rasmus K. Ursem,et al.  Diversity-Guided Evolutionary Algorithms , 2002, PPSN.

[6]  G. Rudolph On Takeover Times in Spatially Structured Populations : Array and Ring , 2001 .

[7]  Ivan Sekaj,et al.  Robust Parallel Genetic Algorithms with Re-initialisation , 2004, PPSN.

[8]  William M. Spears,et al.  Crossover or Mutation? , 1992, FOGA.

[9]  Shengxiang Yang,et al.  Non-stationary problem optimization using the primal-dual genetic algorithm , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[10]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[11]  Thomas Bäck,et al.  An Overview of Evolutionary Algorithms for Parameter Optimization , 1993, Evolutionary Computation.

[12]  Philippe Collard,et al.  DGA: An Efficient Genetic Algorithm , 1994, ECAI.

[13]  Zbigniew Skolicki,et al.  The influence of migration sizes and intervals on island models , 2005, GECCO '05.

[14]  Heiko Wersing,et al.  Evolutionary optimization of a hierarchical object recognition model , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Lothar Thiele,et al.  On Set-Based Multiobjective Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[16]  Xin Yao,et al.  Evolutionary programming using mutations based on the Levy probability distribution , 2004, IEEE Transactions on Evolutionary Computation.

[17]  Terence C. Fogarty,et al.  Varying the Probability of Mutation in the Genetic Algorithm , 1989, ICGA.

[18]  D. Thierens Adaptive mutation rate control schemes in genetic algorithms , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[19]  Jing J. Liang,et al.  Novel composition test functions for numerical global optimization , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[20]  Yukiko Yoshida,et al.  A Diploid Genetic Algorithm for Preserving Population Diversity - pseudo-Meiosis GA , 1994, PPSN.

[21]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[22]  Samir W. Mahfoud Niching methods for genetic algorithms , 1996 .

[23]  R. K. Ursem Multinational evolutionary algorithms , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[24]  Philippe Collard,et al.  Genetic operators in a dual genetic algorithm , 1995, Proceedings of 7th IEEE International Conference on Tools with Artificial Intelligence.

[25]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[26]  David B. Fogel,et al.  Tuning Evolutionary Programming for Conformationally Flexible Molecular Docking , 1996, Evolutionary Programming.

[27]  Kwang Ryel Ryu,et al.  A Dual-Population Genetic Algorithm for Adaptive Diversity Control , 2010, IEEE Transactions on Evolutionary Computation.

[28]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[29]  Francisco Herrera,et al.  Adaptive local search parameters for real-coded memetic algorithms , 2005, 2005 IEEE Congress on Evolutionary Computation.

[30]  David B. Fogel,et al.  Evolutionary Computation: Towards a New Philosophy of Machine Intelligence , 1995 .

[31]  Ujjwal Maulik,et al.  Multiobjective Genetic Algorithm-Based Fuzzy Clustering of Categorical Attributes , 2009, IEEE Transactions on Evolutionary Computation.

[32]  Shigeyoshi Tsutsui,et al.  Forking Genetic Algorithm with Blocking and Shrinking Modes (fGA) , 1993, ICGA.

[33]  Kalyanmoy Deb,et al.  A Computationally Efficient Evolutionary Algorithm for Real-Parameter Optimization , 2002, Evolutionary Computation.

[34]  Murat Köksalan,et al.  A Favorable Weight-Based Evolutionary Algorithm for Multiple Criteria Problems , 2010, IEEE Transactions on Evolutionary Computation.

[35]  Xin Yao,et al.  Making a Difference to Differential Evolution , 2008, Advances in Metaheuristics for Hard Optimization.

[36]  Heinz Mühlenbein,et al.  Predictive Models for the Breeder Genetic Algorithm I. Continuous Parameter Optimization , 1993, Evolutionary Computation.

[37]  Xin Yao,et al.  Differential evolution for high-dimensional function optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[38]  Bernhard Sick,et al.  Evolutionary optimization of radial basis function classifiers for data mining applications , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[39]  Claudio De Stefano,et al.  Where Are the Niches? Dynamic Fitness Sharing , 2007, IEEE Transactions on Evolutionary Computation.

[40]  John J. Grefenstette,et al.  Genetic Algorithms for Tracking Changing Environments , 1993, ICGA.

[41]  René Thomsen,et al.  A Religion-Based Spatial Model for Evolutionary Algorithms , 2000, PPSN.

[42]  Reinhard Männer,et al.  Investigation of the M-Heuristic for Optimal Mutation Probabilities , 1992, Parallel Problem Solving from Nature.

[43]  Tomoki Hamagami,et al.  A new genetic algorithm with diploid chromosomes by using probability decoding for non-stationary function optimization , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[44]  Thomas Bäck,et al.  The Interaction of Mutation Rate, Selection, and Self-Adaptation Within a Genetic Algorithm , 1992, PPSN.

[45]  John J. Grefenstette,et al.  Genetic Algorithms for Changing Environments , 1992, PPSN.

[46]  Rajarshi Das,et al.  A Study of Control Parameters Affecting Online Performance of Genetic Algorithms for Function Optimization , 1989, ICGA.

[47]  Goutam Chakraborty,et al.  A novel distributed genetic algorithm implementation with variable number of islands , 2007, 2007 IEEE Congress on Evolutionary Computation.

[48]  Sung-Bae Cho,et al.  Evolutionary neural networks for anomaly detection based on the behavior of a program , 2005, IEEE Trans. Syst. Man Cybern. Part B.

[49]  Francisco Herrera,et al.  Real-Coded Memetic Algorithms with Crossover Hill-Climbing , 2004, Evolutionary Computation.

[50]  Pietro Simone Oliveto,et al.  Analysis of the $(1+1)$-EA for Finding Approximate Solutions to Vertex Cover Problems , 2009, IEEE Transactions on Evolutionary Computation.

[51]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[52]  Jun Zhang,et al.  A Novel Set-Based Particle Swarm Optimization Method for Discrete Optimization Problems , 2010, IEEE Transactions on Evolutionary Computation.

[53]  Bruno Sareni,et al.  Fitness sharing and niching methods revisited , 1998, IEEE Trans. Evol. Comput..

[54]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[55]  Hans-Paul Schwefel,et al.  Numerical optimization of computer models , 1981 .

[56]  Claudio De Stefano,et al.  On the role of population size and niche radius in fitness sharing , 2004, IEEE Transactions on Evolutionary Computation.

[57]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[58]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[59]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[60]  Kwang Mong Sim,et al.  Evolving Fuzzy Rules for Relaxed-Criteria Negotiation , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[61]  Jie Yao,et al.  Bi-Objective Multipopulation Genetic Algorithm for Multimodal Function Optimization , 2010, IEEE Transactions on Evolutionary Computation.

[62]  David E. Goldberg,et al.  Probabilistic Crowding: Deterministic Crowding with Probabilistic Replacement , 1999 .

[63]  Miguel Toro,et al.  Evolutionary learning of hierarchical decision rules , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[64]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[65]  W. Vent,et al.  Rechenberg, Ingo, Evolutionsstrategie — Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. 170 S. mit 36 Abb. Frommann‐Holzboog‐Verlag. Stuttgart 1973. Broschiert , 1975 .