Genetic and Nelder-Mead algorithms hybridized for a more accurate global optimization of continuous multiminima functions

Abstract A hybrid method combining two algorithms is proposed for the global optimization of multiminima functions. To localize a “promising area”, likely to contain a global minimum, it is necessary to well “explore” the whole search domain. When a promising area is detected, the appropriate tools must be used to “exploit” this area and obtain the optimum as accurately and quickly as possible. Both tasks are hardly performed through only one method. We propose an algorithm using two processes, each one devoted to one task. Global metaheuristics, such as simulated annealing, tabu search, and genetic algorithms (GAs) are efficient to localize the “best” areas. On the other hand, local search methods are classically available: in particular the hill climbing (e.g. the quasi-Newton method), and the Nelder–Mead simplex search (SS). Therefore we worked out an hybrid method, called continuous hybrid algorithm (CHA), performing the exploration with a GA, and the exploitation with a Nelder–Mead SS. To evaluate the efficiency of CHA, we implemented a set of benchmark functions, and compared our results to the ones supplied by other competitive methods.

[1]  Wesley E. Snyder,et al.  Optimization of functions with many minima , 1991, IEEE Trans. Syst. Man Cybern..

[2]  James E. Baker,et al.  Reducing Bias and Inefficienry in the Selection Algorithm , 1987, ICGA.

[3]  Jacek Klinowski,et al.  Taboo Search: An Approach to the Multiple Minima Problem , 1995, Science.

[4]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[5]  Heinz Mühlenbein,et al.  Evolution in Time and Space - The Parallel Genetic Algorithm , 1990, FOGA.

[6]  Heinz Mühlenbein,et al.  The parallel genetic algorithm as function optimizer , 1991, Parallel Comput..

[7]  Heinz Mühlenbein,et al.  Analysis of Selection, Mutation and Recombination in Genetic Algorithms , 1995, Evolution and Biocomputation.

[8]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[9]  John H. Holland,et al.  Outline for a Logical Theory of Adaptive Systems , 1962, JACM.

[10]  Jean-Michel Renders,et al.  Hybrid methods using genetic algorithms for global optimization , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[11]  Patrick Siarry,et al.  Tabu Search applied to global optimization , 2000, Eur. J. Oper. Res..

[12]  Patrick Siarry,et al.  An optimization method fitted for model inversion in non destructive control by eddy currents , 2000 .

[13]  Roberto Battiti,et al.  The continuous reactive tabu search: Blending combinatorial optimization and stochastic search for global optimization , 1996, Ann. Oper. Res..

[14]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[15]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[16]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[17]  Patrick Siarry,et al.  Enhanced simulated annealing for globally minimizing functions of many-continuous variables , 1997, TOMS.

[18]  Patrick Siarry,et al.  A Continuous Genetic Algorithm Designed for the Global Optimization of Multimodal Functions , 2000, J. Heuristics.

[19]  Aimo A. Törn,et al.  Global Optimization , 1999, Science.

[20]  P. Siarry,et al.  FITTING OF TABU SEARCH TO OPTIMIZE FUNCTIONS OF CONTINUOUS VARIABLES , 1997 .

[21]  Jeffrey A. Joines,et al.  A hybrid genetic algorithm for manufacturing cell design , 2000 .

[22]  Klaus Schittkowski,et al.  More test examples for nonlinear programming codes , 1981 .

[23]  J. Alliot,et al.  A combined nelder-mead simplex and genetic algorithm , 1999 .