Scalable and Reliable Data Broadcast with Kascade - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2014

Scalable and Reliable Data Broadcast with Kascade

Stéphane Martin
  • Fonction : Auteur
  • PersonId : 933922
Tomasz Buchert
  • Fonction : Auteur
  • PersonId : 871843
Olivier Richard
Emmanuel Jeanvoine
  • Fonction : Auteur
  • PersonId : 847304

Résumé

Many large scale scientific computations or Big Data analysis require the distribution of large amounts of data to each machine involved. That distribution of data often has a key role in the overall performance of the operation. In this paper, we present Kascade, a solution for the broadcast of data to a large set of compute nodes. We evaluate Kascade using a set of large scale experiments in a variety of experimental settings, and show that Kascade: (1) achieves very high scalability by organizing nodes in a pipeline; (2) can almost saturate a 1~Gbit/s network, even at large scale; (3) handles failures of nodes during the transfer gracefully thanks to a fault-tolerant design.
Fichier principal
Vignette du fichier
kascade.pdf (549.52 Ko) Télécharger le fichier
kascade-slides.pdf (270.59 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Format : Autre

Dates et versions

hal-00957671 , version 1 (10-03-2014)
hal-00957671 , version 2 (16-06-2014)
hal-00957671 , version 3 (23-06-2014)

Identifiants

  • HAL Id : hal-00957671 , version 3

Citer

Stéphane Martin, Tomasz Buchert, Pierric Willemet, Olivier Richard, Emmanuel Jeanvoine, et al.. Scalable and Reliable Data Broadcast with Kascade. HPDIC - International Workshop on High Performance Data Intensive Computing, in conjunction with IEEE IPDPS 2014, May 2014, Phoenix, United States. ⟨hal-00957671v3⟩
424 Consultations
662 Téléchargements

Partager

Gmail Facebook X LinkedIn More