BlobSeer: Efficient Data Management for Data-Intensive Applications Distributed at Large-Scale - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2009

BlobSeer: Efficient Data Management for Data-Intensive Applications Distributed at Large-Scale

Gabriel Antoniu
Luc Bougé

Abstract

Large-scale data-intensive applications are a class of applications that acquire and maintain massive datasets, while performing distributed computations on these datasets. In this context, a a key factor is the storage service responsible for the data management, as it has to efficiently deal with massively parallel data access in order to ensure scalability and performance for the whole system itself. This PhD thesis proposes BlobSeer, a data management service specifically designed to address the needs of large-scale data-intensive applications. Three key design factors: data striping, distributed metadata management and versioning-based concurrency control enable BlobSeer not only to provide efficient support for features commonly used to exploit data-level parallelism, but also enable exploring a set of new features that can be leveraged to further improve parallel data access. Extensive experimentations, both in scale and scope, on the Grid5000 testbed demonstrate clear benefits of using BlobSeer as the underlying storage for a variety of scenarios: data-intensive grid applications, grid file systems, MapReduce datacenters, desktop grids. Further work targets providing efficient storage solutions for cloud computing as well.
Fichier principal
Vignette du fichier
PID1121303.pdf (69.97 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

inria-00457809 , version 1 (18-02-2010)

Identifiers

Cite

Bogdan Nicolae, Gabriel Antoniu, Luc Bougé. BlobSeer: Efficient Data Management for Data-Intensive Applications Distributed at Large-Scale. IPDPS '10: Proceedings of the 24th IEEE International Symposium on Parallel and Distributed Processing: Workshops and Phd Forum, Apr 2010, Atlanta, United States. pp.1-4, ⟨10.1109/IPDPSW.2010.5470802⟩. ⟨inria-00457809⟩
309 View
393 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More