Adaptation in Dynamic Environments: A Case Study in Mission Planning

Many random events usually are associated with executions of operational plans at various companies and organizations. For example, some tasks might be delayed and/or executed earlier. Some operational constraints can be introduced due to new regulations or business rules. In some cases, there might be a shift in the relative importance of objectives associated with these plans. All these potential modifications create a huge pressure on planning staff for generating plans that can adapt quickly to changes in environment during execution. In this paper, we address adaptation in dynamic environments. Many researchers in evolutionary community addressed the problem of optimization in dynamic environments. Through an overview on applying evolutionary algorithms for solving dynamic optimization problems, we classify the paper into two main categories: 1) finding/tracking optima, and 2) adaptation and we discuss their relevance for solving planning problems. Based on this discussion, we propose a computational approach to adaptation within the context of planning. This approach models the dynamic planning problem as a multiobjective optimization problem and an evolutionary mechanism is incorporated; this adapts the current solution to new situations when a change occurs. As the multiobjective model is used, the proposed approach produces a set of non-dominated solutions after each planning cycle. This set of solutions can be perceived as an information-rich data set which can be used to support the adaptation process against the effect of changes. The main question is how to exploit this set efficiently. In this paper, we propose a method based on the concept of centroids over a number of changing-time steps; at each step we obtain a set of non-dominated solutions. We carried out a case study on this proposed approach. Mission planning was used for our experiments and experimental analysis. We selected mission planning as our test environment because battlefields are always highly dynamic and uncertain and can be conveniently used to demonstrate different types of changes, especially time-varying constraints. The obtained results support the significance of our centroid-based approach.

[1]  Hartmut Schmeck,et al.  Ant colony optimization for resource-constrained project scheduling , 2000, IEEE Trans. Evol. Comput..

[2]  Jonathan Billington,et al.  A coloured petri net based tool for course of action development and analysis , 2002, FME 2002.

[3]  David E. Goldberg,et al.  Nonstationary Function Optimization Using Genetic Algorithms with Dominance and Diploidy , 1987, ICGA.

[4]  Zbigniew Michalewicz,et al.  Adaptive Business Intelligence , 2009, Encyclopedia of Artificial Intelligence.

[5]  Sushil J. Louis,et al.  Learning with case-injected genetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[6]  Hajime Kita,et al.  Adaptation to Changing Environments by Means of the Memory Based Thermodynamical Genetic Algorithm , 1997, ICGA.

[7]  Jürgen Branke,et al.  A Multi-population Approach to Dynamic Optimization Problems , 2000 .

[8]  Alf Kimms,et al.  Optimization guided lower and upper bounds for the resource investment problem , 2001, J. Oper. Res. Soc..

[9]  Krzysztof Fleszar,et al.  An evolutionary algorithm for resource-constrained project scheduling , 2002, IEEE Trans. Evol. Comput..

[10]  Adel Guitouni,et al.  Multi-objectives Tabu Search based algorithm for progressive resource allocation , 2007, Eur. J. Oper. Res..

[11]  Sameer Alam,et al.  Multi-Objective Optimization in Computational Intelligence: Theory and Practice , 2008 .

[12]  Joseph Y.-T. Leung,et al.  Handbook of Scheduling: Algorithms, Models, and Performance Analysis , 2004 .

[13]  W. Punch,et al.  A Genetic Algorithm Approach to Dynamic Job Shop Scheduling Problems , 1997 .

[14]  Rainer Kolisch,et al.  Experimental investigation of heuristics for resource-constrained project scheduling: An update , 2006, Eur. J. Oper. Res..

[15]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[16]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[17]  Jürgen Branke,et al.  Evolutionary Optimization in Dynamic Environments , 2001, Genetic Algorithms and Evolutionary Computation.

[18]  C. A. Coello Coello,et al.  Evolutionary multi-objective optimization: a historical view of the field , 2006, IEEE Computational Intelligence Magazine.

[19]  Erik D. Goodman,et al.  A Genetic Algorithm Approach to Dynamic Job Shop Scheduling Problem , 1997, ICGA.

[20]  Concepción Maroto,et al.  A Robust Genetic Algorithm for Resource Allocation in Project Scheduling , 2001, Ann. Oper. Res..

[21]  Mark Wineberg,et al.  Enhancing the GA's Ability to Cope with Dynamic Environments , 2000, GECCO.

[22]  Krishna R. Pattipati,et al.  Integration of a Holonic Organizational Control Architecture and Multiobjective Evolutionary Algorithm for Flexible Distributed Scheduling , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[23]  Amir Azaron,et al.  Multi-objective time-cost trade-off in dynamic PERT networks using an interactive approach , 2007, Eur. J. Oper. Res..

[24]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[25]  Zbigniew Michalewicz,et al.  Genetic algorithms + data structures = evolution programs (3rd ed.) , 1996 .

[26]  Erik Demeulemeester,et al.  Proactive heuristic procedures for robust project scheduling: An experimental analysis , 2008, Eur. J. Oper. Res..

[27]  Pei-Chann Chang,et al.  One-machine rescheduling heuristics with efficiency and stability as criteria , 1993, Comput. Oper. Res..

[28]  Robert H. Kewley,et al.  Computational military tactical planning system , 2002, IEEE Trans. Syst. Man Cybern. Part C.

[29]  Roman Slowinski,et al.  Multiobjective project scheduling under multiple-category resource constraint , 1989 .

[30]  Jan Karel Lenstra,et al.  Scheduling subject to resource constraints: classification and complexity , 1983, Discret. Appl. Math..

[31]  Albert Battersby,et al.  Advances in Critical Path Methods , 1966 .

[32]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[33]  Jan Van Damme,et al.  Project scheduling under uncertainty survey and research potentials , 2002 .

[34]  Carlos A. Coello Coello,et al.  Evolutionary multi-objective optimization: a historical view of the field , 2006, IEEE Comput. Intell. Mag..

[35]  Ian Fuss,et al.  On Relationships between Key Concepts of Operational Level Planning , 2000 .

[36]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[37]  Sanja Petrovic,et al.  SURVEY OF DYNAMIC SCHEDULING IN MANUFACTURING SYSTEMS , 2006 .

[38]  J. Berger,et al.  A Survey of Military Planning Systems , 2004 .

[39]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[40]  H. Crichton-Miller Adaptation , 1926 .

[41]  Jonathan F. Bard,et al.  Disruption management for resource-constrained project scheduling , 2005, J. Oper. Res. Soc..

[42]  John J. Grefenstette,et al.  Genetic Algorithms for Changing Environments , 1992, PPSN.

[43]  Rainer Kolisch,et al.  Experimental evaluation of state-of-the-art heuristics for the resource-constrained project scheduling problem , 2000, Eur. J. Oper. Res..

[44]  Shahram Shadrokh,et al.  Bi-objective resource-constrained project scheduling with robustness and makespan criteria , 2006, Appl. Math. Comput..

[45]  Lin Zhang,et al.  Decision-Theoretic Military Operations Planning , 2004, ICAPS.

[46]  Michael Pinedo,et al.  Scheduling: Theory, Algorithms, and Systems , 1994 .

[47]  Jorge Pinho de Sousa,et al.  Using metaheuristics in multiobjective resource constrained project scheduling , 2000, Eur. J. Oper. Res..

[48]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[49]  John J. Grefenstette,et al.  Case-Based Initialization of Genetic Algorithms , 1993, ICGA.

[50]  Hussein A. Abbass,et al.  Multiobjective optimization for dynamic environments , 2005, 2005 IEEE Congress on Evolutionary Computation.

[51]  Erik Demeulemeester,et al.  A branch-and-bound procedure for the multiple resource-constrained project scheduling problem , 1992 .

[52]  Erik Demeulemeester,et al.  A classification of predictive-reactive project scheduling procedures , 2007, J. Sched..

[53]  Hussein A. Abbass,et al.  A MULTI-OBJECTIVE RISK-BASED FRAMEWORK FOR MISSION CAPABILITY PLANNING , 2009 .

[54]  Helen G. Cobb,et al.  An Investigation into the Use of Hypermutation as an Adaptive Operator in Genetic Algorithms Having Continuous, Time-Dependent Nonstationary Environments , 1990 .

[55]  A. Nagar,et al.  Multiple and bicriteria scheduling : A literature survey , 1995 .

[56]  Rasmus K. Ursem,et al.  Multinational GAs: Multimodal Optimization Techniques in Dynamic Environments , 2000, GECCO.

[57]  H. Abbass,et al.  PDE: a Pareto-frontier differential evolution approach for multi-objective optimization problems , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).