Large-Scale Distributed Storage for Highly Concurrent MapReduce Applications - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2010

Large-Scale Distributed Storage for Highly Concurrent MapReduce Applications

Diana Moise
  • Function : Author
  • PersonId : 867268
Gabriel Antoniu
Luc Bougé

Abstract

A large part of today's most popular applications are data-intensive; the data volume they process is continuously growing. Specialized abstractions like Google's MapReduce and Pig-Latin were developed to efficiently manage the workloads of data-intensive applications. These models propose high-level data processing frameworks intended to hide the details of parallelization from the user. Such frameworks rely on storing huge objects and target high performance by optimizing the parallel execution of the computation. The purpose of this PhD is to provide efficient storage for the MapReduce framework and the applications it was designed for. The research conducted so far, concerned the storage layer this type of applications require. To meet these requirements we rely on BlobSeer, a system for managing massive data in a large-scale distributed context.
Fichier principal
Vignette du fichier
main.pdf (43.95 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

inria-00458143 , version 1 (19-02-2010)

Identifiers

Cite

Diana Moise, Gabriel Antoniu, Luc Bougé. Large-Scale Distributed Storage for Highly Concurrent MapReduce Applications. 24th IEEE International Symposium on Parallel and Distributed Processing (IPDPS 2010) - Workshop Proceedings, Apr 2010, Atlanta, United States. ⟨10.1109/IPDPSW.2010.5470806⟩. ⟨inria-00458143⟩
189 View
226 Download

Altmetric

Share

Gmail Facebook X LinkedIn More