Risk-Aware Scheduling Algorithms for Variable Capacity Resources - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Risk-Aware Scheduling Algorithms for Variable Capacity Resources

Résumé

The drive to decarbonize the power grid to slow the pace of climate change has caused dramatic variation in the cost, availability, and carbon-intensity of power. This has begun to shape the planning and operation of datacenters. This paper focuses on the design of scheduling algorithms for independent jobs that are submitted to a platform whose resource capacity varies over time. Jobs are submitted online and assigned on a target machine by the scheduler, which is agnostic to the rate and amount of resource variation. The optimization objective is the goodput, defined as the fraction of time devoted to effective computations (re-execution does not count). We introduce several novel algorithms that: (i) decide which fraction of the resources can be used safely; (ii) maintain a risk index associated to each machine; and (iii) achieves a global load balance while mapping longer jobs to safer machines. We assess the performance of these algorithms using one set of actual workflow traces together with three sets of synthetic traces. The goodput achieved by our algorithms increases up to 10% compared to standard first-fit approaches, while we never experience any loss in complementary metrics such as the maximum or average stretch.
Fichier principal
Vignette du fichier
hal-pmbs2023.pdf (716.61 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04397574 , version 1 (16-01-2024)

Licence

Paternité

Identifiants

Citer

Lucas Perotin, Chaojie Zhang, Rajini Wijayawardana, Anne Benoit, Yves Robert, et al.. Risk-Aware Scheduling Algorithms for Variable Capacity Resources. PMBS Workshop - SC-W 2023: Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis, Nov 2023, Denver, CO, United States. pp.1306-1315, ⟨10.1145/3624062.3624194⟩. ⟨hal-04397574⟩
4 Consultations
13 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More