Topology and affinity aware hierarchical and distributed load-balancing in Charm++ - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year :

Topology and affinity aware hierarchical and distributed load-balancing in Charm++

Abstract

The evolution of massively parallel supercomputers make palpable two issues in particular: the load imbalance and the poor management of data locality in applications. Thus, with the increase of the number of cores and the drastic decrease of amount of memory per core, the large performance needs imply to particularly take care of the load-balancing and as much as possible of the locality of data. One mean to take into account this locality issue relies on the placement of the processing entities and load balancing techniques are relevant in order to improve application performance. With large-scale platforms in mind, we developed a hierarchical and distributed algorithm which aim is to perform a topology-aware load balancing tailored for Charm++ applications. This algorithm is based on both LibTopoMap for the network awareness aspects and on TREEMATCH to determine a relevant placement of the processing entities. We show that the proposed algorithm improves the overall execution time in both the cases of real applications and a synthetic benchmark as well. For this last experiment, we show a scalability up to one millions processing entities.
Fichier principal
Vignette du fichier
tmlb-paper.pdf (465.73 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01394748 , version 1 (14-11-2016)

Identifiers

  • HAL Id : hal-01394748 , version 1

Cite

Emmanuel Jeannot, Guillaume Mercier, François Tessier. Topology and affinity aware hierarchical and distributed load-balancing in Charm++. 1st Workshop on Optimization of Communication in HPC runtime systems (IEEE COM-HPC16), Nov 2016, Salt-Lake City, United States. ⟨hal-01394748⟩
140 View
272 Download

Share

Gmail Facebook Twitter LinkedIn More