GinFlow: A Decentralised Adaptive Workflow Execution Manager - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2016

GinFlow: A Decentralised Adaptive Workflow Execution Manager

Résumé

Workflow-based computing has become a dominant paradigm to design and execute scientific applications. After the initial breakthrough of now standard workflow management systems, several approaches have recently proposed to decentralise the coordination of the execution. In particular, shared space-based coordination has been shown to provide appropriate building blocks for such a decentralised execution. Uncertainty is also still a major concern in scientific workflows. The ability to adapt the workflow, change its shape and switch for alternate scenarios on-the-fly is still missing in workflow management systems. In this paper, based on the shared space model, we firstly devise a programmatic way to specify such adaptive workflows. We use a reactive, rule-based programming model to modify the workflow description by changing its associated direct acyclic graph on-the-fly without needing to stop and restart the execution from the beginning. Secondly, we present the GinFlow middleware, a resilient decentralised workflow execution manager implementing these concepts. Through a set of deployments of adaptive workflows of different characteristics, we discuss the GinFlow performance and resilience and show the limited overhead of the adaptiveness mechanism, making it a promising decentralised adaptive workflow execution manager.
Fichier principal
Vignette du fichier
IPDPS.pdf (1.06 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01292135 , version 1 (30-06-2016)

Identifiants

  • HAL Id : hal-01292135 , version 1

Citer

Javier Rojas Balderrama, Matthieu Simonin, Cédric Tedeschi. GinFlow: A Decentralised Adaptive Workflow Execution Manager. 30th IEEE International Parallel & Distributed Processing Symposium, May 2016, Chicago, United States. ⟨hal-01292135⟩
347 Consultations
244 Téléchargements

Partager

Gmail Facebook X LinkedIn More