IO-SETS: Simple and efficient approaches for I/O bandwidth management - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles IEEE Transactions on Parallel and Distributed Systems Year : 2023

IO-SETS: Simple and efficient approaches for I/O bandwidth management

Abstract

One of the main performance issues faced by high- performance computing platforms is the congestion caused by concurrent I/O from applications. When this happens, the platform’s overall performance and utilization are harmed. From the extensive work in this field, I/O scheduling is the essential solution to this problem. The main drawback of current techniques is the amount of information needed about applications, which compromises their applicability. In this paper, we propose a novel method for I/O management, IO-SETS. We present its potential through a scheduling heuristic called SET-10, which is simple and requires only minimal information. Our extensive experimental campaign shows the importance of IO-SETS and the robustness of SET-10 under various workloads. In particular in most of the simulated scenarios we improve the I/O slowdown over fairshare by 50%, which corresponds in our scenarios to a platform utilization gain of 2.5%. In the practical scenarios that we did, the utilization gain varies between 10 and 30%. We also provide insights on using our proposal in practice.
Fichier principal
Vignette du fichier
main.pdf (3.34 Mo) Télécharger le fichier
supp (1).pdf (724.17 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Licence : CC BY - Attribution

Dates and versions

hal-03648225 , version 1 (21-04-2022)
hal-03648225 , version 2 (05-05-2022)
hal-03648225 , version 3 (19-08-2023)

Licence

Attribution

Identifiers

Cite

Francieli Boito, Guillaume Pallez, Luan Teylo, Nicolas Vidal. IO-SETS: Simple and efficient approaches for I/O bandwidth management. IEEE Transactions on Parallel and Distributed Systems, 2023, 34 (10), pp.2783 - 2796. ⟨10.1109/TPDS.2023.3305028⟩. ⟨hal-03648225v3⟩
403 View
257 Download

Altmetric

Share

Gmail Facebook X LinkedIn More