ALOR: Adaptive Layout Optimization of Raft Groups for Heterogeneous Distributed Key-Value Stores - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2018

ALOR: Adaptive Layout Optimization of Raft Groups for Heterogeneous Distributed Key-Value Stores

Résumé

Many distributed key-value storage systems employ the simple and effective Raft protocol to ensure data consistency. They usually assume a homogeneous node hardware configuration for the underlying cluster and thus adopt even data distribution schemes. However, today’s distributed systems tend to be heterogeneous in nodes’ I/O devices due to the regular worn I/O device replacement and the emergence of expensive new storage media (e.g., non-volatile memory). In this paper, we propose a new data layout scheme called Adaptive Layout Optimization of Raft groups (ALOR), considering the hardware heterogeneity of the cluster. ALOR aims to optimize the data layout of Raft groups to achieve a better practical load balance, which leads to higher performance. ALOR consists of two components: leader migration in Raft groups and skewed data layout based on cold data migration. We conducted experiments on a practical heterogeneous cluster, and the results indicate that, on average, ALOR improves throughput by 36.89%, reduces latency and 99th percentile tail latency by 24.54% and 21.32%, respectively.
Fichier principal
Vignette du fichier
477597_1_En_2_Chapter.pdf (1.37 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02279551 , version 1 (05-09-2019)

Licence

Identifiants

Citer

Yangyang Wang, Yunpeng Chai, Xin Wang. ALOR: Adaptive Layout Optimization of Raft Groups for Heterogeneous Distributed Key-Value Stores. 15th IFIP International Conference on Network and Parallel Computing (NPC), Nov 2018, Muroran, Japan. pp.13-26, ⟨10.1007/978-3-030-05677-3_2⟩. ⟨hal-02279551⟩
78 Consultations
90 Téléchargements

Altmetric

Partager

More