Enhancing MPI+OpenMP task based applications for heterogenous architectures with GPU support - Inria - Institut national de recherche en sciences et technologies du numérique
Conference Papers Year : 2022

Enhancing MPI+OpenMP task based applications for heterogenous architectures with GPU support

Abstract

Heterogeneous supercomputers are widespread over HPC systems and programming efficient applications on these architectures is a challenge. Task-based programming models are a promising way to tackle this challenge. Since OpenMP 4.0 and 4.5, the target directives enable to offload pieces of code to GPUs and to express it as tasks with dependencies. Therefore, heterogeneous machines can be programmed using MPI+OpenMP(task+target) to exhibit a very high level of concurrent asynchronous operations for which data transfers, kernel executions, communications and CPU computations can be overlapped. Hence, it is possible to suspend tasks performing these asynchronous operations on the CPUs and to overlap their completion with another task execution. Suspended tasks can resume once the associated asynchronous event is completed in an opportunistic way at every scheduling point. We have integrated this feature into the MPC framework and validated it on a AXPY microbenchmark and evaluated on a MPI+OpenMP(tasks) implementation of the LULESH proxy applications. The results show that we are able to improve asynchronism and the overall HPC performance, allowing applications to benefit from asynchronous execution on heterogeneous machines.
Fichier principal
Vignette du fichier
2022_iwomp_omp-target.pdf (574.28 Ko) Télécharger le fichier
2022-iwomp-ferat_mpc.pdf (910.96 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

cea-03749364 , version 1 (10-08-2022)

Identifiers

Cite

Manuel Ferat, Romain Pereira, Adrien Roussel, Patrick Carribault, Luiz-Angelo Steffenel, et al.. Enhancing MPI+OpenMP task based applications for heterogenous architectures with GPU support. IWOMP 2022 - 18th International Workshop on OpenMP, Sep 2022, Chattanooga, TH, United States. pp.3-16, ⟨10.1007/978-3-031-15922-0_1⟩. ⟨cea-03749364⟩
330 View
833 Download

Altmetric

Share

More