I/O Optimizations Based on Workload Characteristics for Parallel File Systems - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

I/O Optimizations Based on Workload Characteristics for Parallel File Systems

Résumé

Parallel file systems usually provide a unified storage solution, which fails to meet specific application needs. In this paper, we propose an extended file handle scheme to address this problem. It allows the file systems to specify optimizations for individual file or directory based on workload characteristics. One case study shows that our proposed approach improves the aggregate throughput of large files and small files by up to 5% and 30%, respectively. To further improve the access performance of small files in parallel file systems, we also propose a new metadata-based small file optimization method. The experimental results show that the aggregate throughput of small files can be effectively improved through our method.
Fichier principal
Vignette du fichier
486810_1_En_24_Chapter.pdf (461.43 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03770539 , version 1 (06-09-2022)

Licence

Paternité

Identifiants

Citer

Bing Wei, Limin Xiao, Bingyu Zhou, Guangjun Qin, Baicheng Yan, et al.. I/O Optimizations Based on Workload Characteristics for Parallel File Systems. 16th IFIP International Conference on Network and Parallel Computing (NPC), Aug 2019, Hohhot, China. pp.305-310, ⟨10.1007/978-3-030-30709-7_24⟩. ⟨hal-03770539⟩
13 Consultations
20 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More