Asynchronous multi-phase task-based applications: Employing different nodes to design better distributions - Inria - Institut national de recherche en sciences et technologies du numérique
Journal Articles Future Generation Computer Systems Year : 2023

Asynchronous multi-phase task-based applications: Employing different nodes to design better distributions

Abstract

HPC infrastructures often present intra-node (multi-core CPUs and multiple GPUs) and system-level heterogeneity (different nodes arranged into partitions). HPC applications with several phases, each with distinct resource necessities, can exploit the taskbased programming paradigm to overlap phases and take advantage of inter-node heterogeneity to improve performance, provided their workload is correctly distributed. We study two applications with these characteristics, a machine learning framework for geostatistics data, ExaGeoStat, and a multivariate data analysis library, Diodon. We show how to both (1) organize the application to improve runtime and scheduling decisions that impact the asynchronous phases overlap with performance gains between 31% and 46% in ExaGeoStat and 29% to 40% in Diodon when running on homogeneous nodes; and (2) create a distribution per phase over heterogeneous nodes considering overlap and reducing redistribution overhead, improving performance up to 69% in ExaGeoStat and 73% in Diodon compared to a block-cyclic distribution, thereby taming the diversity in supercomputers.

Fichier principal
Vignette du fichier
FGCS.pdf (5.93 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04695275 , version 1 (12-09-2024)

Licence

Identifiers

Cite

Lucas Leandro Nesi, Arnaud Legrand, Lucas Mello Schnorr. Asynchronous multi-phase task-based applications: Employing different nodes to design better distributions. Future Generation Computer Systems, 2023, 147, pp.119-135. ⟨10.1016/j.future.2023.05.005⟩. ⟨hal-04695275⟩
28 View
6 Download

Altmetric

Share

More