Shadow Data: A Method to Optimize Incremental Synchronization in Data Center - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

Shadow Data: A Method to Optimize Incremental Synchronization in Data Center

Résumé

With the continuous increase of data, the data center that plays the role of backup is facing the problem of energy hunger. In practice, to reduce the bandwidth, the local data is synchronized to the data center based on incremental synchronization. In this process, the data center will generate a huge CPU load. To solve this pressure of the data center, first, we analyze the process of the Rsync algorithm, the most commonly used in incremental synchronization, and CDC algorithms, another way of chunking algorithm. Then we propose a data structure called Shadow Data, which greatly reduces the CPU load of the data center by sacrificing part of the hard disk space in the local node.
Fichier principal
Vignette du fichier
511910_1_En_29_Chapter.pdf (1.15 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03768748 , version 1 (04-09-2022)

Licence

Identifiants

Citer

Changjian Zhang, Deyu Qi, Wenhao Huang. Shadow Data: A Method to Optimize Incremental Synchronization in Data Center. 17th IFIP International Conference on Network and Parallel Computing (NPC), Sep 2020, Zhengzhou, China. pp.339-348, ⟨10.1007/978-3-030-79478-1_29⟩. ⟨hal-03768748⟩
20 Consultations
6 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More