XKBlas: a High Performance Implementation of BLAS-3 Kernels on Multi-GPU Server - Inria - Institut national de recherche en sciences et technologies du numérique
Conference Papers Year : 2020

XKBlas: a High Performance Implementation of BLAS-3 Kernels on Multi-GPU Server

Abstract

In the last ten years, GPUs have dominated the market considering the computing/power metric and numerous research works have provided Basic Linear Algebra Subprograms implementations accelerated on GPUs. Several software libraries have been developed for exploiting performance of systems with accelerators, but the real performance may be far from the platform peak performance. This paper presents XKBlas that aims to improve performance of BLAS-3 kernels on multi-GPU systems. At low level, we model computation as a set of tasks accessing data on different resources. At high level, the API design favors non-blocking calls as uniform concept to overlap latency, even by fine grain computation. Unit benchmark of BLAS-3 kernels showed that XKBlas outperformed most implementations including the overhead of dynamic task's creation and scheduling. XKBlas outperformed BLAS implementations such as cuBLAS-XT, PaRSEC, BLASX and Chameleon/StarPU.
Fichier principal
Vignette du fichier
pdp2020.pdf (760.52 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03121583 , version 1 (28-09-2021)

Identifiers

Cite

Thierry Gautier, Joao Vicente Ferreira Lima. XKBlas: a High Performance Implementation of BLAS-3 Kernels on Multi-GPU Server. PDP 2020 - 28th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, Mar 2020, Västerås, Sweden. pp.1-8, ⟨10.1109/PDP50117.2020.00008⟩. ⟨hal-03121583⟩
96 View
436 Download

Altmetric

Share

More