Improve Throughput of Storage Cluster Interconnected with a TCP/IP Network Using Intelligent Server Grouping - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2010

Improve Throughput of Storage Cluster Interconnected with a TCP/IP Network Using Intelligent Server Grouping

Résumé

Cluster-based storage systems connected with TCP/IP networks are expected to achieve a high throughput by striping files across multiple storage servers. However, for the storage system interconnected with the TCP/IP network, several critical issues, like Incast effect and data access interference, invalidate the assumption that higher access parallelism always results in increased I/O throughput. To address this issue, we propose a new file striping strategy, named as storage server grouping (SSG), which changes file striping pattern across the storage servers based on the analysis of file popularity and impact of the number of storage servers on the clients' perceived performance (I/O speedup) to reduce the interference of data accesses to popular files and avoid dramatic reduction of system throughput caused by the Incast effect. Our experimental evaluation shows that SSG can improve I/O throughput by 22.1% on average.
Fichier principal
Vignette du fichier
final-paper.pdf (1.54 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01054971 , version 1 (11-08-2014)

Licence

Identifiants

Citer

Xuechen Zhang, Guiquan Liu, Song Jiang. Improve Throughput of Storage Cluster Interconnected with a TCP/IP Network Using Intelligent Server Grouping. IFIP International Conference on Network and Parallel Computing (NPC), Sep 2010, Zhengzhou, China. pp.373-389, ⟨10.1007/978-3-642-15672-4_31⟩. ⟨hal-01054971⟩
69 Consultations
107 Téléchargements

Altmetric

Partager

More