Towards quality-of-service driven consistency for Big Data management - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles International Journal of Big Data Intelligence Year : 2014

Towards quality-of-service driven consistency for Big Data management


With the advent of Cloud Computing, Big Data management has become a fundamental challenge during the deployment and operation of distributed highly available and fault-tolerant storage systems such as the HBase extensible record-store. These systems can provide support for geo-replication, which comes with the issue of data consistency among distributed sites. In order to offer a best-in-class service to applications, one wants to maximise performance while minimising latency. In terms of data replication, that means incurring in as low latency as possible when moving data between distant data centres. Traditional consistency models introduce a significant problem for systems architects, which is specially important to note in cases where large amounts of data need to be replicated across wide-area networks. In such scenarios it might be suitable to use eventual consistency, and even though not always convenient, latency can be partly reduced and traded for consistency guarantees so that data-transfers do not impact performance. In contrast, this work proposes a broader range of data semantics for consistency while prioritising data at the cost of putting a minimum latency overhead on the rest of non-critical updates. Finally, we show how these semantics can help in finding an optimal data replication strategy for achieving just the required level of data consistency under low latency and a more efficient network bandwidth utilisation.
Fichier principal
Vignette du fichier
IJBDI.2014.063853.pdf (1.74 Mo) Télécharger le fichier
Origin : Publisher files allowed on an open archive

Dates and versions

hal-01370448 , version 1 (22-09-2016)



Álvaro García Recuero, Sérgio Esteves, Luís Veiga. Towards quality-of-service driven consistency for Big Data management. International Journal of Big Data Intelligence, 2014, 1 (1/2), ⟨10.1504/IJBDI.2014.063853⟩. ⟨hal-01370448⟩
170 View
194 Download



Gmail Facebook X LinkedIn More