Exploratory Power of the Harmony Search Algorithm: Analysis and Improvements for Global Numerical Optimization

The theoretical analysis of evolutionary algorithms is believed to be very important for understanding their internal search mechanism and thus to develop more efficient algorithms. This paper presents a simple mathematical analysis of the explorative search behavior of a recently developed metaheuristic algorithm called harmony search (HS). HS is a derivative-free real parameter optimization algorithm, and it draws inspiration from the musical improvisation process of searching for a perfect state of harmony. This paper analyzes the evolution of the population-variance over successive generations in HS and thereby draws some important conclusions regarding the explorative power of HS. A simple but very useful modification to the classical HS has been proposed in light of the mathematical analysis undertaken here. A comparison with the most recently published variants of HS and four other state-of-the-art optimization algorithms over 15 unconstrained and five constrained benchmark functions reflects the efficiency of the modified HS in terms of final accuracy, convergence speed, and robustness.

[1]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[2]  Zong Woo Geem,et al.  Optimal Scheduling of Multiple Dam System Using Harmony Search Algorithm , 2007, IWANN.

[3]  Zong Woo Geem,et al.  Harmony Search Algorithms for Structural Design Optimization , 2009 .

[4]  R. Parncutt Harmony: A Psychoacoustical Approach , 1989 .

[5]  Yangyang Li,et al.  Quantum-Inspired Immune Clonal Algorithm for Global Optimization , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Zong Woo Geem,et al.  Harmony Search for Generalized Orienteering Problem: Best Touring in China , 2005, ICNC.

[7]  L. Coelho,et al.  An improved harmony search algorithm for synchronization of discrete-time chaotic systems , 2009 .

[8]  R. Storn,et al.  Differential evolution a simple and efficient adaptive scheme for global optimization over continu , 1997 .

[9]  M. Fesanghary,et al.  An improved harmony search algorithm for solving optimization problems , 2007, Appl. Math. Comput..

[10]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[11]  Hans-Georg Beyer,et al.  On the Dynamics of EAs without Selection , 1998, FOGA.

[12]  Abolfazl Toroghi Haghighat,et al.  Harmony search based algorithms for bandwidth-delay-constrained least-cost multicast routing , 2008, Comput. Commun..

[13]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[14]  Zong Woo Geem,et al.  Music Composition Using Harmony Search Algorithm , 2009, EvoWorkshops.

[15]  Y. M. Cheng,et al.  An improved harmony search minimization algorithm using different slip surface generation methods for slope stability analysis , 2008 .

[16]  K. Lee,et al.  A new meta-heuristic algorithm for continuous engineering optimization: harmony search theory and practice , 2005 .

[17]  David B. Fogel,et al.  Unearthing a Fossil from the History of Evolutionary Computation , 1998, Fundam. Informaticae.

[18]  Woo-seok Jang,et al.  Hybrid Simplex-Harmony search method for optimization problems , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[19]  Xin Yao,et al.  Evolutionary programming using mutations based on the Levy probability distribution , 2004, IEEE Transactions on Evolutionary Computation.

[20]  M. Fesanghary,et al.  Optimization of multi-pass face-milling via harmony search algorithm , 2009 .

[21]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[22]  Hans-Georg Beyer On the "Explorative Power" of ES/EP-like Algorithms , 1998, Evolutionary Programming.

[23]  Mahamed G. H. Omran,et al.  Global-best harmony search , 2008, Appl. Math. Comput..

[24]  David B. Fogel,et al.  A Comparison of Evolutionary Programming and Genetic Algorithms on Selected Constrained Optimization Problems , 1995, Simul..

[25]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms for Constrained Parameter Optimization Problems , 1996, Evolutionary Computation.

[26]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[27]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[28]  Zong Woo Geem,et al.  Harmony Search Optimization: Application to Pipe Network Design , 2002 .

[29]  Morteza Haghir Chehreghani,et al.  Novel meta-heuristic algorithms for clustering web documents , 2008, Appl. Math. Comput..

[30]  Zong Woo Geem,et al.  Application of Harmony Search to Vehicle Routing , 2005 .

[31]  K. Lee,et al.  A new metaheuristic algorithm for continuous engineering optimization : harmony search theory and practice , 2005 .

[32]  Zong Woo Geem,et al.  Improved Harmony Search from Ensemble of Music Players , 2006, KES.

[33]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[34]  Yuping Wang,et al.  An Evolutionary Algorithm for Global Optimization Based on Level-Set Evolution and Latin Squares , 2007, IEEE Transactions on Evolutionary Computation.

[35]  M. Fesanghary,et al.  Design optimization of shell and tube heat exchangers using global sensitivity analysis and harmony search algorithm , 2009 .

[36]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[37]  David B. Fogel,et al.  A Note on the Empirical Evaluation of Intermediate Recombination , 1995, Evolutionary Computation.

[38]  Kalyanmoy Deb,et al.  A Computationally Efficient Evolutionary Algorithm for Real-Parameter Optimization , 2002, Evolutionary Computation.

[39]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms, Homomorphous Mappings, and Constrained Parameter Optimization , 1999, Evolutionary Computation.

[40]  A. E. Eiben,et al.  On Evolutionary Exploration and Exploitation , 1998, Fundam. Informaticae.

[41]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[42]  Z. Michalewicz,et al.  Genocop III: a co-evolutionary algorithm for numerical optimization problems with nonlinear constraints , 1995, Proceedings of 1995 IEEE International Conference on Evolutionary Computation.

[43]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[44]  Peter J. Angeline,et al.  Evolutionary Optimization Versus Particle Swarm Optimization: Philosophy and Performance Differences , 1998, Evolutionary Programming.

[45]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[46]  Ajith Abraham,et al.  Population-variance and explorative power of Harmony Search: An analysis , 2008, 2008 Third International Conference on Digital Information Management.

[47]  Z. Geem Music-Inspired Harmony Search Algorithm: Theory and Applications , 2009 .

[48]  Kalyanmoy Deb,et al.  Optimal design of a welded beam via genetic algorithms , 1991 .

[49]  L. Darrell Whitley,et al.  Evaluating Evolutionary Algorithms , 1996, Artif. Intell..

[50]  M. Fesanghary,et al.  A robust stochastic approach for design optimization of air cooled heat exchangers , 2009 .

[51]  Ioannis B. Theocharis,et al.  Microgenetic algorithms as generalized hill-climbing operators for GA optimization , 2001, IEEE Trans. Evol. Comput..

[52]  Zong Woo Geem,et al.  Novel derivative of harmony search algorithm for discrete design variables , 2008, Appl. Math. Comput..

[53]  M. Fesanghary,et al.  Combined heat and power economic dispatch by harmony search algorithm , 2007 .

[54]  K. Lee,et al.  A new structural optimization method based on the harmony search algorithm , 2004 .

[55]  Yun Shang,et al.  A Note on the Extended Rosenbrock Function , 2006 .

[56]  Zong Woo Geem,et al.  Harmony Search Algorithm for Solving Sudoku , 2007, KES.

[57]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .