Continuous Dynamic Constrained Optimization—The Challenges

Many real-world dynamic problems have constraints, and in certain cases not only the objective function changes over time, but also the constraints. However, there is no research in answering the question of whether current algorithms work well on continuous dynamic constrained optimization problems (DCOPs), nor is there any benchmark problem that reflects the common characteristics of continuous DCOPs. This paper contributes to the task of closing this gap. We will present some investigations on the characteristics that might make DCOPs difficult to solve by some existing dynamic optimization (DO) and constraint handling (CH) algorithms. We will then introduce a set of benchmark problems with these characteristics and test several representative DO and CH strategies on these problems. The results confirm that DCOPs do have special characteristics that can significantly affect algorithm performance. The results also reveal some interesting observations where the presence or combination of different types of dynamics and constraints can make the problems easier to solve for certain types of algorithms. Based on the analyses of the results, a list of potential requirements that an algorithm should meet to solve DCOPs effectively will be proposed.

[1]  Uri Alon,et al.  Varying environments can speed up evolution , 2007, Proceedings of the National Academy of Sciences.

[2]  William Rand,et al.  Shaky Ladders, Hyperplane-Defined Functions and Genetic Algorithms: Systematic Controlled Observation in Dynamic Environments , 2005, EvoWorkshops.

[3]  Xiaodong Li,et al.  This article has been accepted for inclusion in a future issue. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 Locating and Tracking Multiple Dynamic Optima by a Particle Swarm Model Using Speciation , 2022 .

[4]  Miguel Rocha,et al.  Evolutionary algorithms for static and dynamic optimization of fed-batch fermentation processes , 2005 .

[5]  Carlos Artemio Coello-Coello,et al.  Theoretical and numerical constraint-handling techniques used with evolutionary algorithms: a survey of the state of the art , 2002 .

[6]  Andreas König,et al.  Intrinsic Evolution of Predictable Behavior Evolvable Hardware in Dynamic Environment , 2006, 2006 Sixth International Conference on Hybrid Intelligent Systems (HIS'06).

[7]  John J. Grefenstette,et al.  Genetic Algorithms for Changing Environments , 1992, PPSN.

[8]  Kathryn A. Dowsland,et al.  A robust simulated annealing based examination timetabling system , 1998, Comput. Oper. Res..

[9]  Jonathan A. Wright,et al.  Self-adaptive fitness formulation for constrained optimization , 2003, IEEE Trans. Evol. Comput..

[10]  Jürgen Branke,et al.  Multiswarms, exclusion, and anti-convergence in dynamic environments , 2006, IEEE Transactions on Evolutionary Computation.

[11]  Xin Yao,et al.  Benchmarking and solving dynamic constrained problems , 2009, 2009 IEEE Congress on Evolutionary Computation.

[12]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[13]  Kathryn A. Dowsland,et al.  Nurse scheduling with tabu search and strategic oscillation , 1998, Eur. J. Oper. Res..

[14]  Haluk Topcuoglu,et al.  A comparative study of evolutionary optimization techniques in dynamic environments , 2006, GECCO '06.

[15]  Tetsuyuki Takahama,et al.  Constrained optimization by applying the /spl alpha/ constrained method to the nonlinear simplex method with mutations , 2005, IEEE Transactions on Evolutionary Computation.

[16]  Zbigniew Michalewicz,et al.  A Survey of Constraint Handling Techniques in Evolutionary Computation Methods , 1995 .

[17]  Yuren Zhou,et al.  An Adaptive Tradeoff Model for Constrained Evolutionary Optimization , 2008, IEEE Transactions on Evolutionary Computation.

[18]  A. Peirce.  Computer Methods in Applied Mechanics and Engineering , 2010 .

[19]  Sana Ben Hamida,et al.  The need for improving the exploration operators for constrained optimization problems , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[20]  Chen Shi-ming.  Path planning of mobile robot based on improved Particle Swarm Optimization in dynamic environment , 2008 .

[21]  Diego Martinez Prata,et al.  Simultaneous Data Reconciliation and Parameter Estimation in Bulk Polypropylene Polymerizations in Real Time , 2006 .

[22]  Petros A. Ioannou,et al.  DYNAMIC OPTIMIZATION OF CARGO MOVEMENT BY TRUCKS IN METROPOLITAN AREAS WITH ADJACENT PORTS , 2002 .

[23]  Kathryn A. Dowsland,et al.  General Cooling Schedules for a Simulated Annealing Based Timetabling System , 1995, PATAT.

[24]  Juan Julián Merelo Guervós,et al.  A genetic algorithm for dynamic modelling and prediction of activity in document streams , 2007, GECCO '07.

[25]  Terence C. Fogarty,et al.  Load Balancing Application of the Genetic Algorithm in a Nonstationary Environment , 1995, Evolutionary Computing, AISB Workshop.

[26]  Hendrik Richter,et al.  Detecting change in dynamic fitness landscapes , 2009, 2009 IEEE Congress on Evolutionary Computation.

[27]  Nostrand Reinhold,et al.  the utility of using the genetic algorithm approach on the problem of Davis, L. (1991), Handbook of Genetic Algorithms. Van Nostrand Reinhold, New York. , 1991 .

[28]  Tom Holvoet,et al.  The DynCOAA algorithm for dynamic constraint optimization problems , 2006, AAMAS '06.

[29]  Hendrik Richter.  Memory Design for Constrained Dynamic Optimization Problems , 2010, EvoApplications.

[30]  Wolfgang Marquardt,et al.  Adaptive switching structure detection for the solution of dynamic optimization problems , 2006 .

[31]  Jürgen Branke,et al.  Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[32]  Sharon L. Padula,et al.  Aerospace applications of optimization under uncertainty , 2006 .

[33]  Xin Yao,et al.  Experimental study on population-based incremental learning algorithms for dynamic optimization problems , 2005, Soft Comput..

[34]  James C. Bean,et al.  A Genetic Algorithm for the Multiple-Choice Integer Program , 1997, Oper. Res..

[35]  Marc Schoenauer,et al.  ASCHEA: new results using adaptive segregational constraint handling , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[36]  Jeffrey Horn,et al.  Handbook of evolutionary computation , 1997 .

[37]  Hartmut Schmeck,et al.  Designing evolutionary algorithms for dynamic optimization problems , 2003 .

[38]  Gary G. Yen,et al.  A generic framework for constrained optimization using genetic algorithms , 2005, IEEE Transactions on Evolutionary Computation.

[39]  John J. Grefenstette,et al.  Genetic Algorithms for the Traveling Salesman Problem , 1985, ICGA.

[40]  C. Floudas.  Handbook of Test Problems in Local and Global Optimization , 1999 .

[41]  Z. Michalewicz,et al.  Genocop III: a co-evolutionary algorithm for numerical optimization problems with nonlinear constraints , 1995, Proceedings of 1995 IEEE International Conference on Evolutionary Computation.

[42]  Xin Yao,et al.  Dynamic Time-Linkage Problems Revisited , 2009, EvoWorkshops.

[43]  Chun-an Liu,et al.  New Dynamic Constrained Optimization PSO Algorithm , 2008, 2008 Fourth International Conference on Natural Computation.

[44]  Efrn Mezura-Montes,et al.  Constraint-Handling in Evolutionary Optimization , 2009 .

[45]  Trung Thanh Nguyen,et al.  Continuous dynamic optimisation using evolutionary algorithms , 2011 .

[46]  Helen G. Cobb,et al.  An Investigation into the Use of Hypermutation as an Adaptive Operator in Genetic Algorithms Having Continuous, Time-Dependent Nonstationary Environments , 1990 .

[47]  A. Eiben.  Evolutionary algorithms and constraint satisfaction: definitions, survey, methodology, and research directions , 2001 .

[48]  Martin Middendorf,et al.  A hierarchical particle swarm optimizer and its adaptive variant , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[49]  Michael Gleicher,et al.  Evaluating video-based motion capture , 2002, Proceedings of Computer Animation 2002 (CA 2002).

[50]  Uwe Aickelin,et al.  Exploiting Problem Structure in a Genetic Algorithm Approach to a Nurse Rostering Problem , 2000, ArXiv.

[51]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[52]  Deepak Kumar,et al.  Target Exploration for Disconnected Feasible Regions in Enterprise-Driven Multilevel Product Design , 2006 .

[53]  Tim Hendtlass,et al.  A simple and efficient multi-component algorithm for solving dynamic function optimisation problems , 2007, 2007 IEEE Congress on Evolutionary Computation.

[54]  Jürgen Branke,et al.  Evolutionary Optimization in Dynamic Environments , 2001, Genetic Algorithms and Evolutionary Computation.

[55]  Xin Yao,et al.  Solving dynamic constrained optimisation problems using repair methods , 2010 .

[56]  G. Syswerda,et al.  Schedule Optimization Using Genetic Algorithms , 1991 .

[57]  Robert G. Reynolds,et al.  A Survey of Constraint Handling Techniques in Evolutionary Computation Methods , 1995 .

[58]  Rolf H. Möhring,et al.  Scheduling project networks with resource constraints and time windows , 1988 .

[59]  Carlos A. Coello Coello,et al.  A simple multimembered evolution strategy to solve constrained optimization problems , 2005, IEEE Transactions on Evolutionary Computation.

[60]  Mark Wineberg,et al.  The Shifting Balance Genetic Algorithm: improving the GA in a dynamic environment , 1999 .

[61]  Jürgen Branke,et al.  A Multi-population Approach to Dynamic Optimization Problems , 2000 .

[62]  Yao Wang,et al.  Estimation of evolvability genetic algorithm and dynamic environments , 2006, Genetic Programming and Evolvable Machines.

[63]  Kalyanmoy Deb,et al.  Dynamic Multi-objective Optimization and Decision-Making Using Modified NSGA-II: A Case Study on Hydro-thermal Power Scheduling , 2007, EMO.

[64]  Dai Qiao-yan.  Genetic Algorithm for TSP , 2004 .

[65]  John J. Grefenstette,et al.  Genetic Algorithms for Tracking Changing Environments , 1993, ICGA.

[66]  Shengxiang Yang,et al.  Learning behavior in abstract memory schemes for dynamic optimization problems , 2009, Soft Comput..

[67]  Christopher R. Houck,et al.  On the use of non-stationary penalty functions to solve nonlinear constrained optimization problems with GA's , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[68]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[69]  Ángel Fernando Kuri Morales,et al.  A UNIVERSAL ECLECTIC GENETIC ALGORITHM FOR CONSTRAINED OPTIMIZATION , 2022 .

[70]  Xin Yao,et al.  Search biases in constrained evolutionary optimization , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[71]  Sancho Salcedo-Sanz,et al.  A survey of repair methods used as constraint handling techniques in evolutionary algorithms , 2009, Comput. Sci. Rev..