Load-Balancing Iterative Computations on Heterogeneous Clusters with Shared Communication Links - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2003

Load-Balancing Iterative Computations on Heterogeneous Clusters with Shared Communication Links

Abstract

We focus on mapping iterative algorithms onto heterogeneous clusters. The application data is partitioned over the processors, which are arranged along a virtual ring. At each iteration, independent calculations are carried out in parallel, and some communications take place between consecutive processors in the ring. The question is to determine how to slice the application data into chunks, and assign these chunks to the processors, so that the total execution time is minimized. A major difficulty is to embed a processor ring into a network that typically is not fully connected, so that some communication links have to be shared by several processor pairs. We establish a complexity result assessing the difficulty of this problem, and we design a practical heuristic that provides efficient mapping, routing, and data distribution schemes.

Dates and versions

hal-00789452 , version 1 (18-02-2013)

Identifiers

Cite

Arnaud Legrand, Hélène Renard, Yves Robert, Frédéric Vivien. Load-Balancing Iterative Computations on Heterogeneous Clusters with Shared Communication Links. PPAM-2003: Fifth International Conference on Parallel Processing and Applied Mathematics, 2003, Unknown, pp.930―937, ⟨10.1007/978-3-540-24669-5_120⟩. ⟨hal-00789452⟩
56 View
0 Download

Altmetric

Share

Gmail Facebook X LinkedIn More