StorAlloc: A Simulator for Job Scheduling on Heterogeneous Storage Resources - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2022

StorAlloc: A Simulator for Job Scheduling on Heterogeneous Storage Resources

Résumé

The ability of large-scale infrastructures to store and retrieve a massive amount of data is now decisive to scale up scientific applications. However, there is an ever-widening gap between I/O and computing performance. A way to mitigate this consists of deploying new intermediate storage tiers (node-local storage, burst-buffers, ...) between the compute nodes and the traditional global shared parallel file-system. Unfortunately, without advanced techniques to allocate and size these resources, they remain underutilized. In this paper, we investigate how heterogeneous storage resources can be allocated on an HPC platform, in a similar way as compute resources. In that regard, we introduce StorAlloc, a simulator used as a testbed for assessing storage-aware job scheduling algorithms and evaluating various storage infrastructures.
Fichier principal
Vignette du fichier
StorAlloc_preprint.pdf (399.75 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03683568 , version 1 (31-05-2022)
hal-03683568 , version 2 (06-12-2022)

Identifiants

  • HAL Id : hal-03683568 , version 1

Citer

Julien Monniot, François Tessier, Matthieu Robert, Gabriel Antoniu. StorAlloc: A Simulator for Job Scheduling on Heterogeneous Storage Resources. HeteroPar 2022 - 20th International Workshop on Algorithms, Models and Tools for Parallel Computing on Heterogeneous Platforms, held in conjunction with the Euro-Par 2022 conference, Aug 2022, Glasgow, United Kingdom. ⟨hal-03683568v1⟩
290 Consultations
285 Téléchargements

Partager

More