Workflow scheduling in grids: an ant colony optimization approach

Grid applications in virtue of open service grid architecture (OGSA) are promising next-generation computation techniques. One of the most important and challenging problems about grid application is the workflow scheduling problem to achieve the users' QoS (quality of service) requirements as well as to minimize the cost. This paper proposes an ant colony optimization (ACO) algorithm to tackle this problem. Several new features are introduced to the algorithm. First, we define two kinds of pheromone and three kinds of heuristic information to guide the search direction of ants for this bi-criteria problem. Each ant uses either one from these heuristic types and pheromone types in each iteration based on the probabilities controlled by two parameters. These two parameters are adaptively adjusted in the process of the algorithm. Second, we use the information of partial solutions to modify the bias of ants so that inferior choices will be ignored. Moreover, the experimental results in 3 workflow applications under different deadline constraints show that the performance of our algorithm is very promising, for it outperforms the Deadline-MDP algorithm in most cases.

[1]  David Abramson,et al.  A case for economy grid architecture for service oriented grid computing , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[2]  Marco Dorigo,et al.  Distributed Optimization by Ant Colonies , 1992 .

[3]  Carl Kesselman,et al.  Optimizing Grid-Based Workflow Execution , 2005, Journal of Grid Computing.

[4]  David Abramson,et al.  A Computational Economy for Grid Computing and its Implementation in the Nimrod-G Resource Brok , 2001, Future Gener. Comput. Syst..

[5]  Gregor von Laszewski,et al.  QoS guided Min-Min heuristic for grid task scheduling , 2003, Journal of Computer Science and Technology.

[6]  Steven Tuecke,et al.  The Physiology of the Grid An Open Grid Services Architecture for Distributed Systems Integration , 2002 .

[7]  Miron Livny,et al.  Condor: a distributed job scheduler , 2001 .

[8]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Yong Zhao,et al.  Grid middleware services for virtual data discovery, composition, and integration , 2004, MGC '04.

[10]  Geoffrey Sampson The myth of diminishing firms , 2003, CACM.

[11]  Kwang Mong Sim,et al.  Ant colony optimization for routing and load-balancing: survey and new directions , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[12]  Yolanda Gil,et al.  Pegasus: Planning for Execution in Grids , 2002 .

[13]  John Darlington,et al.  Mapping of Scientific Workflow within the e-Protein project to Distributed Resources , 2004 .

[14]  Xiaoping Li,et al.  Time-Cost Tradeoff Dynamic Scheduling Algorithm for Workflows in Grids , 2006, 2006 10th International Conference on Computer Supported Cooperative Work in Design.

[15]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[16]  Rajkumar Buyya,et al.  Cost-based scheduling of scientific workflow applications on utility grids , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).

[17]  Rajkumar Buyya,et al.  Grid Market Directory: A Web Services based Grid Service Publication Directory , 2003, ArXiv.

[18]  Elisa Heymann,et al.  Analysis of Dynamic Heuristics for Workflow Scheduling on Grid Systems , 2006, 2006 Fifth International Symposium on Parallel and Distributed Computing.

[19]  Adam Arbree,et al.  Mapping Abstract Complex Workflows onto Grid Environments , 2003, Journal of Grid Computing.

[20]  Von-Wun Soo,et al.  Market-oriented multiple resource scheduling in grid computing environments , 2005, 19th International Conference on Advanced Information Networking and Applications (AINA'05) Volume 1 (AINA papers).

[21]  Radu Prodan,et al.  ASKALON: a tool set for cluster and Grid computing , 2005, Concurr. Pract. Exp..

[22]  Mike P. Papazoglou,et al.  Service-Oriented Computing , 2008 .

[23]  Vittorio Maniezzo,et al.  The Ant System Applied to the Quadratic Assignment Problem , 1999, IEEE Trans. Knowl. Data Eng..