On-line, non-clairvoyant optimization of workflow activity granularity on grids - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2013

On-line, non-clairvoyant optimization of workflow activity granularity on grids

Rafael Ferreira da Silva
  • Fonction : Auteur
  • PersonId : 916317
Tristan Glatard
  • Fonction : Auteur
  • PersonId : 916316

Résumé

Controlling the granularity of workflow activities executed on widely distributed computing platforms such as grids is required to reduce the impact of task queuing and data transfer time. Most existing granularity control approaches assume extensive knowledge about the applications and resources (e.g. task duration on each resource), and that both the workload and available resources do not change over time. We propose a granularity control algorithm for platforms where such clairvoyant and offline conditions are not realistic. Our method groups tasks when the fineness degree of the application, which takes into account the ratio of shared data and the queuing/round-trip time ratio, becomes higher than a threshold determined from execution traces. The algorithm also de-groups task groups when new resources arrive. The application's behavior is constantly monitored so that the characteristics useful for the optimization are progressively discovered. Experimental results, obtained with 3 workflow activities deployed on the European Grid Infrastructure, show that (i) the grouping process yields speed-ups of about 2.5 when the amount of available resources is constant and that (ii) the use of de-grouping yields speed-ups of 2 when resources progressively appear.
Fichier principal
Vignette du fichier
europar2013_0.pdf (349.31 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00849988 , version 1 (02-08-2013)

Identifiants

  • HAL Id : hal-00849988 , version 1

Citer

Rafael Ferreira da Silva, Tristan Glatard, Frédéric Desprez. On-line, non-clairvoyant optimization of workflow activity granularity on grids. 19th International Conference Euro-Par 2013, Aug 2013, Aachen, Germany. pp.255-266. ⟨hal-00849988⟩
407 Consultations
360 Téléchargements

Partager

Gmail Facebook X LinkedIn More