Topology-aware resource management for HPC applications - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Rapport (Rapport De Recherche) Année : 2016

Topology-aware resource management for HPC applications

Résumé

The Resource and Job Management System (RJMS) is a crucial system software part of the HPC stack. It is responsible for efficiently delivering computing power to applications in supercomputing environments. Its main intelligence relies on resource selection techniques to find the most adapted resources to schedule the users' jobs. Improper resource selection operations may lead to poor performance executions and global system utilization along with increase of system fragmentation and jobs starvation. These phenomenas play a role in the increase of the platforms' total cost of ownership and should be minimized. This paper introduces a new topology-aware re- source selection algorithm to determine the best choice among the available nodes of the platform based upon their position within the network and taking into account the applications commu- nication matrix. To validate our approach, we integrated this algorithm as a plugin for Slurm, a popular and widespread HPC resource and job management system (RJMS). We validated our plugin with different optimization schemes by comparing with the default Slurm algorithm using both emulation of a large-scale platform, and by carrying out experiments in a real cluster.
Nous montrons comment la prise en compte de la topologie au moment de la sélection des ressources permet d'augmenter les performances des batch Scheduler
Fichier principal
Vignette du fichier
RR-8859.pdf (690.9 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01275270 , version 1 (17-02-2016)
hal-01275270 , version 2 (04-04-2016)

Identifiants

  • HAL Id : hal-01275270 , version 2

Citer

Yiannis Georgiou, Emmanuel Jeannot, Guillaume Mercier, Adèle Villiermet. Topology-aware resource management for HPC applications. [Research Report] RR-8859, Inria Bordeaux Sud-Ouest ; Bordeaux INP; LaBRI - Laboratoire Bordelais de Recherche en Informatique. 2016, pp.17. ⟨hal-01275270v2⟩
385 Consultations
1302 Téléchargements

Partager

Gmail Facebook X LinkedIn More