Provenance-and machine learning-based recommendation of parameter values in scientific workflows - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles PeerJ Computer Science Year : 2021

Provenance-and machine learning-based recommendation of parameter values in scientific workflows

Abstract

Scientific Workflows (SWfs) have revolutionized how scientists in various domains of science conduct their experiments. The management of SWfs is performed by complex tools that provide support for workflow composition, monitoring, execution, capturing, and storage of the data generated during execution. In some cases, they also provide components to ease the visualization and analysis of the generated data. During the workflow's composition phase, programs must be selected to perform the activities defined in the workflow specification. These programs often require additional parameters that serve to adjust the program's behavior according to the experiment's goals. Consequently, workflows commonly have many parameters to be manually configured, encompassing even more than one hundred in many cases. Wrongly parameters' values choosing can lead to crash workflows executions or provide undesired results. As the execution of data-and computeintensive workflows is commonly performed in a high-performance computing environment e.g., (a cluster, a supercomputer, or a public cloud), an unsuccessful execution configures a waste of time and resources. In this article, we present FReeP-Feature Recommender from Preferences, a parameter value recommendation method that is designed to suggest values for workflow parameters, taking into account past user preferences. FReeP is based on Machine Learning techniques, particularly in Preference Learning. FReeP is composed of three algorithms, where two of them aim at recommending the value for one parameter at a time, and the third makes recommendations for n parameters at once. The experimental results obtained with provenance data from two broadly used workflows showed FReeP usefulness in the recommendation of values for one parameter. Furthermore, the results indicate the potential of FReeP to recommend values for n parameters in scientific workflows.
Fichier principal
Vignette du fichier
peerj-cs-606.pdf (15.17 Mo) Télécharger le fichier
Origin Publisher files allowed on an open archive

Dates and versions

hal-03418836 , version 1 (08-11-2021)

Licence

Identifiers

Cite

Daniel Junior Silva, Esther Pacitti, Aline Paes, Daniel de Oliveira. Provenance-and machine learning-based recommendation of parameter values in scientific workflows. PeerJ Computer Science, 2021, 7, pp.e606. ⟨10.7717/peerj-cs.606⟩. ⟨hal-03418836⟩
35 View
19 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More