Robust Optimization Over Time: Problem Difficulties and Benchmark Problems

The focus of most research in evolutionary dynamic optimization has been tracking moving optimum (TMO). Yet, TMO does not capture all the characteristics of real-world dynamic optimization problems (DOPs), especially in situations where a solution's future fitness has to be considered. To account for a solution's future fitness explicitly, we propose to find robust solutions to DOPs, which are formulated as the robust optimization over time (ROOT) problem. In this paper we analyze two robustness definitions in ROOT and then develop two types of benchmark problems for the two robustness definitions in ROOT, respectively. The two types of benchmark problems are motivated by the inappropriateness of existing DOP benchmarks for the study of ROOT. Additionally, we evaluate four representative methods from the literature on our proposed ROOT benchmarks, in order to gain a better understanding of ROOT problems and their relationship to more popular TMO problems. The experimental results are analyzed, which show the strengths and weaknesses of different methods in solving ROOT problems with different dynamics. In particular, the real challenges of ROOT problems have been revealed for the first time by the experimental results on our proposed ROOT benchmarks.

[1]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..

[2]  H. Akaike.  Fitting autoregressive models for prediction , 1969 .

[3]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[4]  Xin Yao,et al.  Benchmark Generator for CEC'2009 Competition on Dynamic Optimization , 2008 .

[5]  Hisashi Handa,et al.  Fitness function for finding out robust solutions on time-varying functions , 2006, GECCO '06.

[6]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[7]  R.W. Morrison,et al.  A test problem generator for non-stationary environments , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[8]  Xiaodong Li,et al.  Particle Swarms for Dynamic Optimization Problems , 2008, Swarm Intelligence.

[9]  Bernhard Sendhoff,et al.  Constructing Dynamic Optimization Test Problems Using the Multi-objective Optimization Concept , 2004, EvoWorkshops.

[10]  Peter A. N. Bosman,et al.  Learning, anticipation and time-deception in evolutionary online dynamic optimization , 2005, GECCO '05.

[11]  Edmund K. Burke,et al.  On-line decision support for take-off runway scheduling with uncertain taxi times at London Heathrow airport , 2008, J. Sched..

[12]  Claudio Rossi,et al.  Tracking Moving Optima Using Kalman-Based Predictions , 2008, Evolutionary Computation.

[13]  Xin Yao,et al.  Empirical analysis of evolutionary algorithms with immigrants schemes for dynamic optimization , 2009, Memetic Comput..

[14]  Stefan Ratschan,et al.  Efficient solving of quantified inequality constraints over the real numbers , 2002, TOCL.

[15]  Jürgen Branke,et al.  Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[16]  Zbigniew Michalewicz,et al.  Adaptation in Dynamic Environments: A Case Study in Mission Planning , 2012, IEEE Transactions on Evolutionary Computation.

[17]  Alberto L. Sangiovanni-Vincentelli,et al.  CalCS: SMT solving for non-linear convex constraints , 2010, Formal Methods in Computer Aided Design.

[18]  Phillip D. Stroud,et al.  Kalman-extended genetic algorithm for search in nonstationary environments with noisy fitness evaluations , 2001, IEEE Trans. Evol. Comput..

[19]  Xin Yao,et al.  Finding Robust Solutions to Dynamic Optimization Problems , 2013, EvoApplications.

[20]  Xin Yao,et al.  Dynamic salting route optimisation using evolutionary computation , 2005, 2005 IEEE Congress on Evolutionary Computation.

[21]  Xin Yao,et al.  Benchmarking and solving dynamic constrained problems , 2009, 2009 IEEE Congress on Evolutionary Computation.

[22]  Shengxiang Yang,et al.  Continuous dynamic problem generators for evolutionary algorithms , 2007, 2007 IEEE Congress on Evolutionary Computation.

[23]  Zbigniew Michalewicz,et al.  Analysis and modeling of control tasks in dynamic systems , 2002, IEEE Trans. Evol. Comput..

[24]  Changhe Li,et al.  A Clustering Particle Swarm Optimizer for Locating and Tracking Multiple Optima in Dynamic Environments , 2010, IEEE Transactions on Evolutionary Computation.

[25]  Xin Yao,et al.  Robust optimization over time — A new perspective on dynamic optimization problems , 2010, IEEE Congress on Evolutionary Computation.

[26]  Xin Yao,et al.  Dynamic combinatorial optimisation problems: an analysis of the subset sum problem , 2011, Soft Comput..

[27]  Allan Larsen,et al.  The Dynamic Vehicle Routing Problem , 2000 .

[28]  Xin Yao,et al.  A framework for finding robust optimal solutions over time , 2013, Memetic Comput..

[29]  Stephen F. Smith,et al.  Airlift mission monitoring and dynamic rescheduling , 2008, Eng. Appl. Artif. Intell..

[30]  Shengxiang Yang,et al.  Non-stationary problem optimization using the primal-dual genetic algorithm , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[31]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1971 .

[32]  Emma Hart,et al.  A Comparison of Dominance Mechanisms and Simple Mutation on Non-stationary Problems , 1998, PPSN.

[33]  Shengxiang Yang,et al.  Evolutionary dynamic optimization: A survey of the state of the art , 2012, Swarm Evol. Comput..

[34]  Trung Thanh Nguyen,et al.  Continuous dynamic optimisation using evolutionary algorithms , 2011 .

[35]  Helen G. Cobb,et al.  An Investigation into the Use of Hypermutation as an Adaptive Operator in Genetic Algorithms Having Continuous, Time-Dependent Nonstationary Environments , 1990 .

[36]  Jürgen Branke,et al.  Evolutionary Optimization in Dynamic Environments , 2001, Genetic Algorithms and Evolutionary Computation.

[37]  Xin Yao,et al.  Characterizing environmental changes in Robust Optimization Over Time , 2012, 2012 IEEE Congress on Evolutionary Computation.