EM323: a line search based algorithm for solving high-dimensional continuous non-linear optimization problems

This paper presents a performance study of a one-dimensional search algorithm for solving general high-dimensional optimization problems. The proposed approach is a hybrid between a line search algorithm of Glover (The 3-2-3, stratified split and nested interval line search algorithms. Research report, OptTek Systems, Boulder, CO, 2010) and an improved variant of a global method of Gardeux et al. (Unidimensional search for solving continuous high-dimensional optimization problems. In: ISDA ’09: Proceedings of the 2009 ninth international conference on intelligent systems design and applications, IEEE Computer Society, Washington, DC, USA, pp 1096–1101, 2009) that uses line search algorithms as subroutines. The resulting algorithm, called EM323, was tested on 19 scalable benchmark functions, with a view to observing how optimization techniques for continuous optimization problems respond with increasing dimension. To this end, we report the algorithm’s performance on the 50, 100, 200, 500 and 1,000-dimension versions of each function. Computational results are given comparing our method with three leading evolutionary algorithms. Statistical analysis discloses that our method outperforms the other methods by a significant margin.

[1]  Fred W. Glover,et al.  Principles of scatter search , 2006, Eur. J. Oper. Res..

[2]  Fred Glover,et al.  The 3-2-3, Stratified Split and Nested Interval Line Search Algorithms , 2010 .

[3]  Chun Chen,et al.  Multiple trajectory search for Large Scale Global Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[4]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[5]  Fred W. Glover,et al.  Unidimensional Search for Solving Continuous High-Dimensional Optimization Problems , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[6]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[7]  Amin Milani Fard,et al.  High Dimensional Problem Optimization Using Distributed Multi-agent PSO , 2009, 2009 Third UKSim European Symposium on Computer Modeling and Simulation.

[8]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[9]  Ajith Abraham,et al.  Modified Line Search Method for Global Optimization , 2007, First Asia International Conference on Modelling & Simulation (AMS'07).

[10]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[11]  Eva K. Lee Large-Scale Optimization-Based Classification Models in Medicine and Biology , 2007, Annals of Biomedical Engineering.

[12]  L. Darrell Whitley,et al.  Test driving three 1995 genetic algorithms: New test functions and geometric matching , 1995, J. Heuristics.

[13]  Nikolaus Hansen,et al.  A restart CMA evolution strategy with increasing population size , 2005, 2005 IEEE Congress on Evolutionary Computation.

[14]  M. Hestenes,et al.  Methods of conjugate gradients for solving linear systems , 1952 .

[15]  Fred W. Glover,et al.  Tabu Thresholding: Improved Search by Nonmonotonic Trajectories , 1995, INFORMS J. Comput..