Using Static Allocation Algorithms for Matrix Matrix Multiplication on Multicores and GPUs - Inria - Institut national de recherche en sciences et technologies du numérique
Pré-Publication, Document De Travail Année : 2017

Using Static Allocation Algorithms for Matrix Matrix Multiplication on Multicores and GPUs

Résumé

We consider how to allocate data when performing matrix multiplication on a heterogeneous node, with multicores and GPUs. Classical (cyclic) allocations designed for homogeneous settings are not appropriate, but the advent of task-based runtime systems makes it possible to use more general allocations. Previous theoretical work has proposed square and cube partitioning algorithms aimed at minimizing data movement for matrix multiplication. We propose techniques to adapt these continuous square partitionings to allocating discrete tiles of a matrix, and strategies to adapt the static allocation at run-time. We use these techniques in an implementation of Matrix Multiplication based on the StarPU runtime system, and we show through extensive experiments that this implementation allows to consistently obtain a lower communication volume while improving slightly the execution time, compared to standard state-of-the-art dynamic strategies.
Fichier principal
Vignette du fichier
ipdps.pdf (309.71 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01670678 , version 1 (22-12-2017)
hal-01670678 , version 2 (31-05-2018)

Identifiants

  • HAL Id : hal-01670678 , version 1

Citer

Lionel Eyraud-Dubois, Thomas Lambert. Using Static Allocation Algorithms for Matrix Matrix Multiplication on Multicores and GPUs. 2017. ⟨hal-01670678v1⟩
289 Consultations
474 Téléchargements

Partager

More