Research Article

Fault-tolerant execution of large parameter sweep applications across multiple VOs with storage constraints

  1. Shahaan Ayyub*,
  2. David Abramson,
  3. Colin Enticott,
  4. Slavisa Garic,
  5. Jefferson Tan

Article first published online: 25 AUG 2008

DOI: 10.1002/cpe.1353

Issue

Concurrency and Computation: Practice and Experience

Concurrency and Computation: Practice and Experience

Special Issue: The Best of CCGrid'2007: A Snapshot of an ‘Adolescent’ Area

Volume 21, Issue 3, pages 377–392, 10 March 2009

Additional Information

How to Cite

Ayyub, S., Abramson, D., Enticott, C., Garic, S. and Tan, J. (2009), Fault-tolerant execution of large parameter sweep applications across multiple VOs with storage constraints. Concurrency and Computation: Practice and Experience, 21: 377–392. doi: 10.1002/cpe.1353

Author Information

  1. Faculty of Information Technology, Monash University, Melbourne, Vic. 3145, Australia

*Faculty of Information Technology, Monash University, Melbourne, Vic. 3145, Australia

Publication History

  1. Issue published online: 30 JAN 2009
  2. Article first published online: 25 AUG 2008
  3. Manuscript Accepted: 7 MAY 2008
  4. Manuscript Revised: 30 MAR 2008
  5. Manuscript Received: 11 DEC 2007

Funded by

  • Australian Research Council
  • CSIRO Division of Atmospheric Research

SEARCH

SEARCH BY CITATION

ARTICLE TOOLS

View Full Article (HTML) Get PDF (379K)

Keywords:

  • e-science;
  • parameter sweep applications;
  • Grid

Abstract

Applications that span multiple virtual organizations (VOs) are of great interest to the e-science community. However, our recent attempts to execute large-scale parameter sweep applications (PSAs) for real-world climate studies with the Nimrod/G tool have exposed problems in the areas of fault tolerance, data storage and trust management. In response, we have implemented a task-splitting approach that facilitates breaking up large PSAs into a sequence of dependent subtasks, improving fault tolerance; provides a garbage collection technique that deletes unnecessary data; and employs a trust delegation technique that facilitates flexible third party data transfers across different VOs. Copyright © 2008 John Wiley & Sons, Ltd.

View Full Article (HTML) Get PDF (379K)