CoRSO (Collaborative Reactive Search Optimization): Blending Combinatorial and Continuous Local Search

We propose a heuristic global optimization technique which combines combinatorial and continuous local search. The combinatorial component, based on Reactive Search Optimization, generates a trajectory of binary strings describing search districts. Each district is evaluated by random sampling and by selective runs of continuous local search. A reactive prohibition mechanisms guarantees that the search is not stuck at locally optimal districts. The continuous stochastic local search is based on the Inertial Shaker method: candidate points are generated in an adaptive search box and a moving average of the steps filters out evaluation noise and high-frequency oscillations. The overall subdivision of the input space in a tree of non-overlapping search districts is adaptive, with a finer subdivision in the more interesting input zones, potentially leading to lower local minima. Finally, a portfolio of independent CoRSO search streams (P-CoRSO) is proposed to increase the robustness of the algorithm. An extensive experimental comparison with Genetic Algorithms and Particle Swarm demonstrates that CoRSO and P-CoRSO reach results which are fully competitive and in some cases significantly more robust.

[1]  Yaroslav D. Sergeyev,et al.  A deterministic global optimization using smooth diagonal auxiliary functions , 2015, Commun. Nonlinear Sci. Numer. Simul..

[2]  Hans-Martin Gutmann,et al.  A Radial Basis Function Method for Global Optimization , 2001, J. Glob. Optim..

[3]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[4]  A. A. Zhigli︠a︡vskiĭ,et al.  Stochastic Global Optimization , 2007 .

[5]  A. Zhigljavsky Stochastic Global Optimization , 2008, International Encyclopedia of Statistical Science.

[6]  C. G. E. Boender,et al.  A Bayesian Analysis of the Number of Cells of a Multinomial Distribution , 1983 .

[7]  A. ilinskas Axiomatic characterization of a global optimization algorithm and investigation of its search strategy , 1985 .

[8]  Roberto Battiti,et al.  The continuous reactive tabu search: Blending combinatorial optimization and stochastic search for global optimization , 1996, Ann. Oper. Res..

[9]  Pablo Moscato,et al.  On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts : Towards Memetic Algorithms , 1989 .

[10]  Roberto Battiti,et al.  Learning with first, second, and no derivatives: A case study in high energy physics , 1994, Neurocomputing.

[11]  A. Zilinskas,et al.  Global optimization based on a statistical model and simplicial partitioning , 2002 .

[12]  Mauro Brunato,et al.  Reactive Search and Intelligent Optimization , 2008 .

[13]  James Smith,et al.  A tutorial for competent memetic algorithms: model, taxonomy, and design issues , 2005, IEEE Transactions on Evolutionary Computation.

[14]  Aimo Törn,et al.  Topographical global optimization , 1992 .

[15]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[16]  Aimo A. Törn,et al.  Global Optimization , 1999, Science.