Communication Dans Un Congrès Année : 2025

Bridging the Gap Between Genericity and Programmability of Dynamic Resources in HPC

Résumé

Dynamic Resource Management (DRM) allows dynamically changing the resources assigned to a job during its execution. This flexibility can improve productivity in completed jobs per unit of time, resource utilization rate, and energy consumption, among other metrics.

Despite its benefits, DRM remains complex to implement, which is one of the reasons it has not yet been widely adopted in production HPC systems. To address this challenge, we design, implement, and evaluate a methodology aimed at improving the programmability of DRM for iterative algorithm-based applications, while maintaining a generic and flexible foundation. Specifically, we interface the Dynamic Management of Resources API (DMR-API), an application-level abstraction layer that simplifies the adoption of dynamic resources-particularly in classical iteration-based HPC applications-with the Dynamic Processes with PSets (DPP) approach, which provides a set of generic design principles for dynamic resource management in high-performance parallel programming models. This integration makes DRM more accessible for iteration-based HPC applications through the DMR-API, while preserving the generality and flexibility of DPP at the system software level to support a wider range of HPC application types.

Our results show that DRM can be effectively leveraged in HPC environments with minimal coding effort, unlocking the benefits of dynamic resource allocation for job throughput and system utilization.

Fichier principal
Vignette du fichier
Bridging_the_Gap_Between_Genericity_and_Programmability_of_Dynamic_Resources_in_HPC_preprint.pdf.pdf (434.76 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04994828 , version 1 (17-03-2025)

Licence

Identifiants

  • HAL Id : hal-04994828 , version 1

Citer

Dominik Huber, Sergio Iserte, Martin Schreiber, Antonio J. Peña, Martin Schulz. Bridging the Gap Between Genericity and Programmability of Dynamic Resources in HPC. ISC High Performance 2025 - 40th ISC High Performance International Conference, Jun 2025, Hamburg, Germany. pp.1-11. ⟨hal-04994828⟩
683 Consultations
353 Téléchargements

Partager

  • More