Scalability of the NewMadeleine Communication Library for Large Numbers of MPI Point-to-Point Requests - Inria - Institut national de recherche en sciences et technologies du numérique
Conference Papers Year : 2019

Scalability of the NewMadeleine Communication Library for Large Numbers of MPI Point-to-Point Requests

Abstract

New kinds of applications with lots of threads or irregular communication patterns which rely a lot on point-to-point MPI communications have emerged. It stresses the MPI library with potentially a lot of simultaneous MPI requests for sending and receiving at the same time. To deal with large numbers of simultaneous requests, the bottleneck lies in two main mechanisms: the tag-matching (the algorithm that matches an incoming packet with a posted receive request), and the progression engine. In this paper, we propose algorithms and implementations that overcome these issues so as to scale up to thousands of requests if needed. In particular our algorithms are able to perform constant-time tag-matching even with any-source and any-tag support. We have implemented these mechanisms in our New-Madeleine communication library. Through micro-benchmarks and computation kernel benchmarks, we demonstrate that our MPI library exhibits better performance than state-of-the-art MPI implementations in cases with many simultaneous requests.
Fichier principal
Vignette du fichier
article.pdf (282.94 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-02103700 , version 1 (18-04-2019)

Licence

Identifiers

  • HAL Id : hal-02103700 , version 1

Cite

Alexandre Denis. Scalability of the NewMadeleine Communication Library for Large Numbers of MPI Point-to-Point Requests. CCGrid 2019 - 19th Annual IEEE/ACM International Symposium in Cluster, Cloud, and Grid Computing, May 2019, Larnaca, Cyprus. ⟨hal-02103700⟩
169 View
196 Download

Share

More