Continuous fitness landscape analysis using a chaos-based random walk algorithm

Extensive research on heuristic algorithms has proved their potential in solving complex optimization problems. However, it is not easy to choose the best heuristic technique for solving a particular problem. Fitness landscape analysis is used for understanding the problem characteristics based on which the best-suited algorithm for the problem can be chosen. Compared to the literature on discrete search spaces, only a few significant works have been undertaken on landscape analysis in continuous search spaces. Random walk (RW) algorithm has been used for generating sample points in the search space, and fitness landscape is created based on the relative fitness of the neighboring sample points. This paper proposes a chaos-based random walk algorithm, called as the chaotic random walk (CRW), applied in continuous search space to generate the landscape structure for a problem. The chaotic map is used to generate the chaotic pseudorandom numbers for determining variable scaled step size and direction of the proposed RW algorithm. Histogram analysis demonstrates better coverage of search space by the CRW algorithm compared to the simple and progressive random walk algorithms. In addition, we test the efficiency of the proposed method by quantifying the ruggedness and deception of a problem using entropy and fitness distance correlation measures. Experiments are conducted on the IEEE Congers on Evolutionary Computing 2013 benchmark functions in continuous search space having different levels of complexity. Extensive experiments indicate the capability for generating landscape structure on the continuous search space and efficiency of the proposed method to investigate the structural features of fitness landscapes.

[1]  Christian M. Reidys,et al.  Neutrality in fitness landscapes , 2001, Appl. Math. Comput..

[2]  Saman K. Halgamuge,et al.  Exploratory Landscape Analysis of Continuous Space Optimization Problems Using Information Content , 2015, IEEE Transactions on Evolutionary Computation.

[3]  Andries Petrus Engelbrecht,et al.  A survey of techniques for characterising fitness landscapes and some possible ways forward , 2013, Inf. Sci..

[4]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[5]  Marcus Gallagher,et al.  Sampling Techniques and Distance Metrics in High Dimensional Continuous Landscape Analysis: Limitations and Improvements , 2014, IEEE Transactions on Evolutionary Computation.

[6]  Vesselin K. Vassilev,et al.  Smoothness, ruggedness and neutrality of fitness landscapes: from theory to application , 2003 .

[7]  Xin Yao,et al.  Fitness-Probability Cloud and a Measure of Problem Hardness for Evolutionary Algorithms , 2011, EvoCOP.

[8]  Amouda Venkatesan,et al.  Computational Approach for Protein Structure Prediction , 2013, Healthcare informatics research.

[9]  Adam Prügel-Bennett,et al.  On the Landscape of Combinatorial Optimization Problems , 2014, IEEE Transactions on Evolutionary Computation.

[10]  Bart Naudts,et al.  A comparison of predictive measures of problem difficulty in evolutionary algorithms , 2000, IEEE Trans. Evol. Comput..

[11]  Marcus Gallagher,et al.  Length Scale for Characterising Continuous Optimization Problems , 2012, PPSN.

[12]  Robert M. May,et al.  Simple mathematical models with very complicated dynamics , 1976, Nature.

[13]  L. Darrell Whitley,et al.  The dispersion metric and the CMA evolution strategy , 2006, GECCO.

[14]  Sébastien Vérel,et al.  Fitness Clouds and Problem Hardness in Genetic Programming , 2004, GECCO.

[15]  Werner Ebeling,et al.  The Density of States - A Measure of the Difficulty of Optimisation Problems , 1996, PPSN.

[16]  Sheng-You Huang,et al.  Directed random walks in continuous space. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[17]  Liang-Hong Wu,et al.  A mutative-scale pseudo-parallel chaos optimization algorithm , 2015, Soft Comput..

[18]  Ernesto Costa,et al.  Multidimensional Knapsack Problem: A Fitness Landscape Analysis , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  Andries P. Engelbrecht,et al.  Fitness Landscape Analysis for Metaheuristic Performance Prediction , 2014 .

[20]  Kenneth de Jong Parameter Setting in EAs: a 30 Year Perspective , 2007 .

[21]  Andrew Wirth,et al.  Information Theoretic Classification of Problems for Metaheuristics , 2008, SEAL.

[22]  Fabio Caraffini,et al.  An analysis on separability for Memetic Computing automatic design , 2014, Inf. Sci..

[23]  Bernd Freisleben,et al.  Fitness landscape analysis and memetic algorithms for the quadratic assignment problem , 2000, IEEE Trans. Evol. Comput..

[24]  Xiaodong Li,et al.  Swarm Intelligence in Optimization , 2008, Swarm Intelligence.

[25]  Mario A. Muñoz,et al.  Landscape characterization of numerical optimization problems using biased scattered data , 2012, 2012 IEEE Congress on Evolutionary Computation.

[26]  KARL PEARSON,et al.  The Problem of the Random Walk , 1905, Nature.

[27]  Colin R. Reeves,et al.  Genetic Algorithms: Principles and Perspectives: A Guide to Ga Theory , 2002 .

[28]  Andries Petrus Engelbrecht,et al.  Quantifying ruggedness of continuous landscapes using entropy , 2009, 2009 IEEE Congress on Evolutionary Computation.

[29]  Andries Petrus Engelbrecht,et al.  A progressive random walk algorithm for sampling continuous fitness landscapes , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[30]  Bernd Bischl,et al.  Exploratory landscape analysis , 2011, GECCO '11.

[31]  Hartmut Jürgens,et al.  Chaos and Fractals: New Frontiers of Science , 1992 .

[32]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[33]  Mohammad Saleh Tavazoei,et al.  Comparison of different one-dimensional maps as chaotic search pattern in chaos optimization algorithms , 2007, Appl. Math. Comput..

[34]  Julian Francis Miller,et al.  Information Characteristics and the Structure of Landscapes , 2000, Evolutionary Computation.