An Algebraic Approach for Data-Centric Scientific Workflows - Inria - Institut national de recherche en sciences et technologies du numérique
Article Dans Une Revue Proceedings of the VLDB Endowment (PVLDB) Année : 2011

An Algebraic Approach for Data-Centric Scientific Workflows

Résumé

Scientific workflows have emerged as a basic abstraction for structuring and executing scientific experiments in computational environments. In many situations, these workflows are computationally and data intensive, thus requiring execution in large-scale parallel computers. However, parallelization of scientific workflows remains low-level, ad-hoc and laborintensive, which makes it hard to exploit optimization opportunities. To address this problem, we propose an algebraic approach (inspired by relational algebra) and a parallel execution model that enable automatic optimization of scientific workflows. We conducted a thorough validation of our approach using both a real oil exploitation application and synthetic data scenarios. The experiments were run in Chiron, a data-centric scientific workflow engine implemented to support our algebraic approach. Our experiments demonstrate performance improvements of up to 226% compared to an ad-hoc workflow implementation.
Fichier principal
Vignette du fichier
An Algebraic Approach for Data-Centric Scientific Workflows.pdf (689.63 Ko) Télécharger le fichier
Loading...

Dates et versions

hal-00640431 , version 1 (13-11-2019)

Identifiants

Citer

Eduardo Ogasawara, Daniel de Oliveira, Patrick Valduriez, Jonas Dias, Fabio Porto, et al.. An Algebraic Approach for Data-Centric Scientific Workflows. Proceedings of the VLDB Endowment (PVLDB), 2011, 4 (11), pp.1328-1339. ⟨10.14778/3402755.3402766⟩. ⟨hal-00640431⟩
320 Consultations
227 Téléchargements

Altmetric

Partager

More