Dynamic combinatorial optimisation problems: an analysis of the subset sum problem

The field of evolutionary computation has traditionally focused on static optimisation problems. Recently, many new approaches have been proposed that adapt traditional evolutionary algorithms to the dynamic domain to deal with the task of tracking high-quality solutions as the search space changes over time. These novel algorithms are subsequently evaluated on a wide range of different optimisation problems, including well-specified benchmark generators. However, due to a lack of theoretical results, as well as a general lack of references to actual real-world scenarios, it is not entirely clear whether these benchmarks capture any of the characteristics found in NP-hard dynamic optimisation problems. In this paper, we extensively analyse the properties of the NP-hard (dynamic) subset sum problem. In particular, we highlight the correlation between the dynamic parameters of the problem and the resulting movement of the global optimum. It is shown by empirical means that the degree to which the global optimum moves in response to the underlying dynamics is correlated only in specific cases. Furthermore, the role of the representation used to encode the problem, as well as the impact of the formulation of the objective function on the dynamics are also discussed.

[1]  Zbigniew Michalewicz,et al.  Analysis and modeling of control tasks in dynamic systems , 2002, IEEE Trans. Evol. Comput..

[2]  Christoph F. Eick,et al.  Supporting Polyploidy in Genetic Algorithms Using Dominance Vectors , 1997, Evolutionary Programming.

[3]  Jürgen Branke,et al.  The Role of Representations in Dynamic Knapsack Problems , 2006, EvoWorkshops.

[4]  Jürgen Branke,et al.  A Multi-population Approach to Dynamic Optimization Problems , 2000 .

[5]  Helen G. Cobb,et al.  An Investigation into the Use of Hypermutation as an Adaptive Operator in Genetic Algorithms Having Continuous, Time-Dependent Nonstationary Environments , 1990 .

[6]  John J. Grefenstette,et al.  Genetic Algorithms for Changing Environments , 1992, PPSN.

[7]  Jürgen Branke,et al.  Evolutionary Optimization in Dynamic Environments , 2001, Genetic Algorithms and Evolutionary Computation.

[8]  R.W. Morrison,et al.  A test problem generator for non-stationary environments , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[9]  Shengxiang Yang,et al.  Memory-based immigrants for genetic algorithms in dynamic environments , 2005, GECCO '05.

[10]  David E. Goldberg,et al.  Nonstationary Function Optimization Using Genetic Algorithms with Dominance and Diploidy , 1987, ICGA.

[11]  K. Yaniasaki,et al.  Dynamic optimization by evolutionary algorithms applied to financial time series , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[12]  Hans Kellerer,et al.  Knapsack problems , 2004 .

[13]  Shengxiang Yang,et al.  Evolutionary Computation in Dynamic and Uncertain Environments , 2007, Studies in Computational Intelligence.

[14]  Jürgen Branke,et al.  Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[15]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[16]  Von der Fakult Evolutionary Algorithms and Dynamic Optimization Problems , 2003 .

[17]  Rong Long Wang,et al.  A genetic algorithm for subset sum problem , 2004, Neurocomputing.

[18]  Katja Verbeeck,et al.  A “Futurist” approach to dynamic environments , 2000 .

[19]  Shengxiang Yang,et al.  Continuous dynamic problem generators for evolutionary algorithms , 2007, 2007 IEEE Congress on Evolutionary Computation.

[20]  Xin Yao,et al.  Attributes of Dynamic Combinatorial Optimisation , 2008, SEAL.

[21]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[22]  Karsten Weicker,et al.  Evolutionary algorithms and dynamic optimization problems , 2003 .

[23]  Per Kristian Lehre,et al.  Dynamic evolutionary optimisation: an analysis of frequency and magnitude of change , 2009, GECCO.

[24]  Paul H. Calamai,et al.  Generalized benchmark generation for dynamic combinatorial problems , 2005, GECCO '05.

[25]  Antonio Barrientos,et al.  Two adaptive mutation operators for optima tracking in dynamic optimization problems with evolution strategies , 2007, GECCO '07.

[26]  Peter A. N. Bosman,et al.  Learning and anticipation in online dynamic optimization with evolutionary algorithms: the stochastic case , 2007, GECCO '07.

[27]  A. Sima Etaner-Uyar,et al.  Towards an analysis of dynamic environments , 2005, GECCO '05.

[28]  Yorick Wilks,et al.  The role of representations , 1990 .

[29]  Shengxiang Yang,et al.  Associative Memory Scheme for Genetic Algorithms in Dynamic Environments , 2006, EvoWorkshops.

[30]  Ronald W. Morrison,et al.  Designing Evolutionary Algorithms for Dynamic Environments , 2004, Natural Computing Series.

[31]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[32]  Franz Rothlauf,et al.  Representations for genetic and evolutionary algorithms , 2002, Studies in Fuzziness and Soft Computing.

[33]  Peter A. N. Bosman,et al.  Learning, anticipation and time-deception in evolutionary online dynamic optimization , 2005, GECCO '05.

[34]  Claus O. Wilke,et al.  Evolutionary Dynamics in Time-dependent Environments , 1999 .

[35]  Shengxiang Yang,et al.  Non-stationary problem optimization using the primal-dual genetic algorithm , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..