Taming Tail Latency in Key-Value Stores: a Scheduling Perspective - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

Taming Tail Latency in Key-Value Stores: a Scheduling Perspective

Résumé

Distributed key-value stores employ replication for high availability. Yet, they do not always efficiently take advantage of the availability of multiple replicas for each value, and read operations often exhibit high tail latencies. Various replica selection strategies have been proposed to address this problem, together with local request scheduling policies. It is difficult, however, to determine what is the absolute performance gain each of these strategies can achieve. We present a formal framework allowing the systematic study of request scheduling strategies in key-value stores. We contribute a definition of the optimization problem related to reducing tail latency in a replicated key-value store as a minimization problem with respect to the maximum weighted flow criterion. By using scheduling theory, we show the difficulty of this problem, and therefore the need to develop performance guarantees. We also study the behavior of heuristic methods using simulations, which highlight which properties are useful for limiting tail latency: for instance, the EFT strategy-which uses the earliest available time of servers-exhibits a tail latency that is less than half that of state-of-the-art strategies, often matching the lower bound. Our study also emphasizes the importance of metrics such as the stretch to properly evaluate replica selection and local execution policies.
Fichier principal
Vignette du fichier
europar.pdf (439.32 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03424040 , version 1 (10-11-2021)

Identifiants

Citer

Sonia Ben Mokhtar, Louis-Claude Canon, Anthony Dugois, Loris Marchal, Etienne Rivière. Taming Tail Latency in Key-Value Stores: a Scheduling Perspective. Euro-Par 2021 - 27th International European Conference on Parallel and Distributed Computing, Aug 2021, Lisbon (virtual), Portugal. pp.136-150, ⟨10.1007/978-3-030-85665-6_9⟩. ⟨hal-03424040⟩
81 Consultations
189 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More