Genetic Algorithms: Bridging the Convergence Gap

In this paper we consider the extension of genetic algorithms (GAs) with a probabilistic Boltzmann reduction operator and prove their convergence to the optimum. The algorithm can be seen as a hybridisation between GAs and simulated annealing (SA), i.e. a SA-like GA. The “temperature” parameter allows us to control the size of the entries of the probabilistic transition matrix of the corresponding Markov chain. In the limit case of temperature zero, the reduction operator becomes a kind of strong elitism. Convergence to the optimum is shown under very mild conditions for the sequence of temperatures {ck}. This means that the proposed algorithm is quite robust, and can be expected to perform well on practical applications.

[1]  Samir W. Mahfoud Finite Markov Chain Models of an Alternative Selection Strategy for the Genetic Algorithm , 1993, Complex Syst..

[2]  Günter Rudolph,et al.  Convergence analysis of canonical genetic algorithms , 1994, IEEE Trans. Neural Networks.

[3]  Joe Suzuki,et al.  A Markov chain analysis on simple genetic algorithms , 1995, IEEE Trans. Syst. Man Cybern..

[4]  José Carlos Príncipe,et al.  A Markov Chain Framework for the Simple Genetic Algorithm , 1993, Evolutionary Computation.

[5]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[6]  Emile H. L. Aarts,et al.  Simulated Annealing: Theory and Applications , 1987, Mathematics and Its Applications.

[7]  Cheng-Yan Kao,et al.  Applying the genetic approach to simulated annealing in solving some NP-hard problems , 1993, IEEE Trans. Syst. Man Cybern..

[8]  Michael D. Vose,et al.  Modeling Simple Genetic Algorithms , 1992, FOGA.

[9]  Joe Suzuki,et al.  A Further Result on the Markov Chain Model of Genetic Algorithms and Its Application to a Simulated Annealing-like Strategy , 1998, FOGA.

[10]  Dean Isaacson,et al.  Markov Chains: Theory and Applications , 1976 .

[11]  Awi Federgruen,et al.  Ergodicity in Parametric Nonstationary Markov Chains: An Application to Simulated Annealing Methods , 1987, Oper. Res..

[12]  William Feller,et al.  An Introduction to Probability Theory and Its Applications , 1951 .

[13]  A. E. Eiben,et al.  Global Convergence of Genetic Algorithms: A Markov Chain Analysis , 1990, PPSN.

[14]  David E. Goldberg,et al.  Parallel Recombinative Simulated Annealing: A Genetic Algorithm , 1995, Parallel Comput..

[15]  Griff L. Bilbro,et al.  Provably convergent inhomogeneous genetic annealing algorithm , 1992, Optics & Photonics.

[16]  David E. Goldberg,et al.  A Note on Boltzmann Tournament Selection for Genetic Algorithms and Population-Oriented Simulated Annealing , 1990, Complex Syst..