Analyzing Real Cluster Data for Formulating Allocation Algorithms in Cloud Platforms - Inria - Institut national de recherche en sciences et technologies du numérique
Article Dans Une Revue Parallel Computing Année : 2015

Analyzing Real Cluster Data for Formulating Allocation Algorithms in Cloud Platforms

Résumé

A problem commonly faced in Computer Science research is the lack of real usage data that can be used for the validation of algorithms. This situation is particularly true and crucial in Cloud Computing. The privacy of data managed by commercial Cloud infrastructures, together with their massive scale, makes them very uncommon to be available to the research community. Due to their scale, when designing resource allocation algorithms for Cloud infrastructures, many assumptions must be made in order to make the problem tractable. This paper provides deep analysis of a cluster data trace recently released by Google and focuses on a number of questions which have not been addressed in previous studies. In particular, we describe the characteristics of job resource usage in terms of dynamics (how it varies with time), of correlation between jobs (identify daily and/or weekly patterns), and correlation inside jobs between the different resources (dependence of memory usage on CPU usage). From this analysis, we propose a way to formalize the allocation problem on such platforms, which encompasses most job features from the trace with a small set of parameters.
Fichier principal
Vignette du fichier
parco.pdf (1.05 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01214636 , version 1 (15-10-2015)

Identifiants

  • HAL Id : hal-01214636 , version 1

Citer

Olivier Beaumont, Lionel Eyraud-Dubois, Juan-Angel Lorenzo-Del-Castillo. Analyzing Real Cluster Data for Formulating Allocation Algorithms in Cloud Platforms. Parallel Computing, 2015. ⟨hal-01214636⟩
118 Consultations
334 Téléchargements

Partager

More