Second order partial derivatives for NK-landscapes

Local search methods based on explicit neighborhood enumeration require at least $O(n)$ time to identify all possible improving moves. For k-bounded pseudo-Boolean optimization problems, recent approaches have achieved $O(k^2*2^{k})$ runtime cost per move, where $n$ is the number of variables and $k$ is the number of variables per subfunction. Even though the bound is independent of $n$, the complexity per move is still exponential in $k$. In this paper, we propose a second order partial derivatives-based approach that executes first-improvement local search where the runtime cost per move is time polynomial in $k$ and independent of $n$. This method is applied to NK-landscapes, where larger values of $k$ may be of particular interest.

[1]  L. Darrell Whitley,et al.  An Empirical Evaluation of O(1) Steepest Descent for NK-Landscapes , 2012, PPSN.

[2]  Thomas Stützle,et al.  Stochastic Local Search: Foundations & Applications , 2004 .

[3]  Bernd Freisleben,et al.  On the effectiveness of evolutionary search in high-dimensional NK-landscapes , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[4]  E. Weinberger NP Completeness of Kauffman's N-k Model, A Tuneable Rugged Fitness Landscape , 1996 .

[5]  Thomas J. Schaefer,et al.  The complexity of satisfiability problems , 1978, STOC.

[6]  S. Kauffman,et al.  Towards a general theory of adaptive walks on rugged landscapes. , 1987, Journal of theoretical biology.

[7]  Alex S. Fukunaga Efficient Implementations of SAT Local Search , 2004, SAT.

[8]  Vasco M. Manquinho,et al.  The First Evaluation of Pseudo-Boolean Solvers (PB'05) , 2006, J. Satisf. Boolean Model. Comput..

[9]  Chu Min Li,et al.  Diversification and Determinism in Local Search for Satisfiability , 2005, SAT.

[10]  V. Ralph Algazi,et al.  Unified Matrix Treatment of the Fast Walsh-Hadamard Transform , 1976, IEEE Transactions on Computers.

[11]  Stuart A. Kauffman,et al.  The origins of order , 1993 .

[12]  Endre Boros,et al.  Pseudo-Boolean optimization , 2002, Discret. Appl. Math..

[13]  Sébastien Vérel,et al.  A study of NK landscapes' basins and local optima networks , 2008, GECCO '08.

[14]  Martin V. Butz,et al.  Performance of evolutionary algorithms on NK landscapes with nearest neighbor interactions and tunable overlap , 2009, GECCO '09.

[15]  A. E. Eiben,et al.  Multi-Parent's Niche: n-ary Crossovers on NK-Landscapes , 1996, PPSN.

[16]  L. Darrell Whitley,et al.  Constant time steepest descent local search with lookahead for NK-landscapes and MAX-kSAT , 2012, GECCO '12.

[17]  Harry Zhang,et al.  Combining Adaptive Noise and Look-Ahead in Local Search for SAT , 2007, SAT.