Univariate marginal distribution algorithms for non-stationary optimization problems

The present work is an attempt to show an way of applying the univariate marginal distribution algorithm to non-stationary environments. The main idea used for this purpose is to introduce mutation (to increase diversity) as and when the environment or the optimization function changes. Simulation study is done on different time dependent versions of a function having simple but difficult landscape. Empirical studies reveal that for smaller shift in position of the optimum, the algorithm can trace this change almost instantaneously. But if the position of the optimum changes by a larger amount, the present algorithm cannot trace it. We also discuss the issue of performance measure for non-stationary environment, and propose a new measure called tractability in this respect.

[1]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[2]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[3]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[4]  Hartmut Schmeck,et al.  Designing evolutionary algorithms for dynamic optimization problems , 2003 .

[5]  Marco Dorigo,et al.  The ant colony optimization meta-heuristic , 1999 .

[6]  Hajime Kita,et al.  Adaptation to Changing Environments by Means of the Memory Based Thermodynamical Genetic Algorithm , 1997, ICGA.

[7]  Thomas Bäck,et al.  Empirical Investigation of Multiparent Recombination Operators in Evolution Strategies , 1997, Evolutionary Computation.

[8]  John J. Grefenstette,et al.  Genetic Algorithms for Tracking Changing Environments , 1993, ICGA.

[9]  Heinz Mühlenbein,et al.  From Recombination of Genes to the Estimation of Distributions II. Continuous Parameters , 1996, PPSN.

[10]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[11]  Melanie Mitchell,et al.  An introduction to genetic algorithms , 1996 .

[12]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[13]  H. Mühlenbein,et al.  From Recombination of Genes to the Estimation of Distributions I. Binary Parameters , 1996, PPSN.

[14]  Shigeyoshi Tsutsui,et al.  A study on the effect of multi-parent recombination in real coded genetic algorithms , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[15]  Rich Caruana,et al.  Removing the Genetics from the Standard Genetic Algorithm , 1995, ICML.

[16]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (2nd, extended ed.) , 1994 .

[17]  H. Mühlenbein,et al.  Gene Pool Recombination in Genetic Algorithms , 1996 .