Properties of Gray and Binary Representations

Representations are formalized as encodings that map the search space to the vertex set of a graph. We define the notion of bit equivalent encodings and show that for such encodings the corresponding Walsh coefficients are also conserved. We focus on Gray codes as particular types of encoding and present a review of properties related to the use of Gray codes. Gray codes are widely used in conjunction with genetic algorithms and bit-climbing algorithms for parameter optimization problems. We present new convergence proofs for a special class of unimodal functions; the proofs show that a steepest ascent bit climber using any reflected Gray code representation reaches the global optimum in a number of steps that is linear with respect to the encoding size. There are in fact many different Gray codes.Shifting is defined as a mechanism for dynamically switching from one Gray code representation to another in order to escape local optima. Theoretical results that substantially improve our understanding of the Gray codes and the shifting mechanism are presented. New proofs also shed light on the number of unique Gray code neighborhoods accessible via shifting and on how neighborhood structure changes during shifting. We show that shifting can improve the performance of both a local search algorithm as well as one of the best genetic algorithms currently available.

[1]  L. Darrell Whitley,et al.  Evaluating Evolutionary Algorithms , 1996, Artif. Intell..

[2]  L. Darrell Whitley,et al.  Local Search and High Precision Gray Codes: Convergence Results and Neighborhoods , 2000, FOGA.

[3]  Frank Harary The Automorphism Group of a Hypercube , 2000, J. Univers. Comput. Sci..

[4]  L. Darrell Whitley,et al.  Functions as Permutations: Regarding No Free Lunch, Walsh Analysis and Summary Statistics , 2000, PPSN.

[5]  L. Darrell Whitley,et al.  Building Better Test Functions , 1995, ICGA.

[6]  L. Darrell Whitley,et al.  Dynamic Representations and Escaping Local Optima: Improving Genetic Algorithms and Local Search , 2000, AAAI/IAAI.

[7]  Larry J. Eshelman,et al.  The CHC Adaptive Search Algorithm: How to Have Safe Search When Engaging in Nontraditional Genetic Recombination , 1990, FOGA.

[8]  N. Brody Intelligence, 2nd ed. , 1992 .

[9]  Edward M. Reingold,et al.  Efficient generation of the binary reflected gray code and its applications , 1976, CACM.

[10]  L. Darrell Whitley,et al.  Bit Representations with a Twist , 1997, ICGA.

[11]  Patrick D. Surry,et al.  Fundamental Limitations on Search Algorithms: Evolutionary Computing in Perspective , 1995, Computer Science Today.

[12]  Kalyanmoy Deb,et al.  Long Path Problems , 1994, PPSN.

[13]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[14]  Patrick Henry Winston,et al.  Artificial intelligence (2nd ed.) , 1984 .

[15]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.

[16]  L. Darrell Whitley,et al.  Quad Search and Hybrid Genetic Algorithms , 2003, GECCO.

[17]  L. Darrell Whitley,et al.  Representation, Search and Genetic Algorithms , 1997, AAAI/IAAI.

[18]  D. Wolpert,et al.  No Free Lunch Theorems for Search , 1995 .