A general form of stochastic search is described (random heuristic search), and some of its general properties are proved. This provides a framework in which the simple genetic algorithm (SGA) is a special case. The framework is used to illuminate relationships between seemingly different probabilistic perspectives of SGA behavior. Next, the SGA is formalized as an instance of random heuristic search. The formalization then used to show expected population fitness is a Lyapunov function in the infinite population model when mutation is zero and fitness is linear. In particular, the infinite population algorithm must converge, and average population fitness increases from one generation to the next. The consequence for a finite population SGA is that the expected population fitness increases from one generation to the next. Moreover, the only stable fixed point of the expected next population operator corresponds to the population consisting entirely of the optimal string. This result is then extended by way of a perturbation argument to allow nonzero mutation.
[1]
Ethan Akin,et al.
The general topology of dynamical systems
,
1993
.
[2]
Tunc Geveci,et al.
Advanced Calculus
,
2014,
Nature.
[3]
Michael D. Vose,et al.
Formalizing Genetic Algorithms
,
1991
.
[4]
T. Nagylaki.
Introduction to Theoretical Population Genetics
,
1992
.
[5]
Alden H. Wright,et al.
Stability of Vertex Fixed Points and Applications
,
1994,
FOGA.
[6]
Michael D. Vose.
Logarithmic Convergence of Random Heuristic Search
,
1996,
Evolutionary Computation.
[7]
Avi Wigderson,et al.
An Analysis of a Simple Genetic Algorithm
,
1991,
ICGA.
[8]
Michael D. Vose,et al.
The Genetic Algorithm Fractal
,
1993,
Evolutionary Computation.