Sublinear Communication for Integer Permutations - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Rapport (Rapport De Recherche) Année : 2007

Sublinear Communication for Integer Permutations

Jens Gustedt

Résumé

In [\cite{GUSTEDT:2006:INRIA-00000900:2}] we have shown that random shuffling of data can be realised with linear resource usage, CPU time as well as communication, and this for a large variaty of paradigms, in particular distributed and out-of-core computation. In this paper we restrict to the case of permutations of the integers $[M] = \{1, \ldots, M\}$ and show first show how the communication for a $p$ processor setting can be reduced from $O(M)$ words ($O(M \log M)$ bits, the coding size of the permutation) to $O(M \log p / \log M)$ words ($O(M \log p)$ bits, the coding size of a partition of $[M]$ into $M / p$ sized subsets). % For the common case of using pseudo-random numbers instead of real randomness, this coding size is in fact not a valid lower bound; we show the communication can be lowered to a use of bandwidth that is proportional to the used real randomness. % The efficiency and feasibility of this second approach is demonstrated by large scale experiments where it proves its scalability and outperforms the previously known approaches by far. First, we compare our algorithm to the classical sequential data shuffle algorithm, where we get a speedup of about $1.5$. Then, we show how the algorithm parallelizes well on a multicore system and scales to a cluster of $440$ cores.
Fichier principal
Vignette du fichier
RR-6403.pdf (323.69 Ko) Télécharger le fichier
Origine : Accord explicite pour ce dépôt
Loading...

Dates et versions

inria-00201503 , version 1 (31-12-2007)
inria-00201503 , version 2 (02-01-2008)
inria-00201503 , version 3 (04-01-2008)

Identifiants

  • HAL Id : inria-00201503 , version 3

Citer

Jens Gustedt. Sublinear Communication for Integer Permutations. [Research Report] RR-6403, INRIA. 2007, 20 p. ⟨inria-00201503v3⟩
131 Consultations
70 Téléchargements

Partager

Gmail Facebook X LinkedIn More