An Algebraic Approach for Data-Centric Scientific Workflows - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Proceedings of the VLDB Endowment (PVLDB) Year : 2011

An Algebraic Approach for Data-Centric Scientific Workflows

Abstract

Scientific workflows have emerged as a basic abstraction for structuring and executing scientific experiments in computational environments. In many situations, these workflows are computationally and data intensive, thus requiring execution in large-scale parallel computers. However, parallelization of scientific workflows remains low-level, ad-hoc and laborintensive, which makes it hard to exploit optimization opportunities. To address this problem, we propose an algebraic approach (inspired by relational algebra) and a parallel execution model that enable automatic optimization of scientific workflows. We conducted a thorough validation of our approach using both a real oil exploitation application and synthetic data scenarios. The experiments were run in Chiron, a data-centric scientific workflow engine implemented to support our algebraic approach. Our experiments demonstrate performance improvements of up to 226% compared to an ad-hoc workflow implementation.
Fichier principal
Vignette du fichier
An Algebraic Approach for Data-Centric Scientific Workflows.pdf (689.63 Ko) Télécharger le fichier
Loading...

Dates and versions

hal-00640431 , version 1 (13-11-2019)

Identifiers

Cite

Eduardo Ogasawara, Daniel de Oliveira, Patrick Valduriez, Jonas Dias, Fabio Porto, et al.. An Algebraic Approach for Data-Centric Scientific Workflows. Proceedings of the VLDB Endowment (PVLDB), 2011, 4 (11), pp.1328-1339. ⟨10.14778/3402755.3402766⟩. ⟨hal-00640431⟩
305 View
205 Download

Altmetric

Share

Gmail Facebook X LinkedIn More