HiPower: A High-Performance RDMA Acceleration Solution for Distributed Transaction Processing - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2019

HiPower: A High-Performance RDMA Acceleration Solution for Distributed Transaction Processing

Résumé

The increasing complex tasks and growing size of data have necessitated the application of distributed transaction processing (DTP), which decouples tasks and data among multiple nodes for jointly processing. However, compared with the revolutionary development of computation power, the network capability falls relatively behind, leaving communication as a more distinct bottleneck. This paper focuses on the recent emerging RDMA technology, which can greatly improve communication performance but cannot be well exploited in many cases due to improper interactive design between the requester and responder. Our research finds that the typical implementation of confirming per work request (CPWR) triggers considerable CPU involvement, which further degrades the overall performance of RDMA communication. Targeting at this, we propose HiPower, which leverages a batched confirmation scheme with lower CPU utilization, to improve high-frequency communication efficiency. Our experiments show that, compared with CPWR, HiPower can improve the communication efficiency by up to 75% and reduce CPU cost by up to 79%, which speeds up the overall FCT (Flow Completion Time) by up to 14% on real workflow (Resnet-152).
Fichier principal
Vignette du fichier
486810_1_En_17_Chapter.pdf (930.5 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03770544 , version 1 (06-09-2022)

Licence

Identifiants

Citer

Runhua Zhang, Yang Cheng, Jinkun Geng, Shuai Wang, Kaihui Gao, et al.. HiPower: A High-Performance RDMA Acceleration Solution for Distributed Transaction Processing. 16th IFIP International Conference on Network and Parallel Computing (NPC), Aug 2019, Hohhot, China. pp.209-221, ⟨10.1007/978-3-030-30709-7_17⟩. ⟨hal-03770544⟩
24 Consultations
86 Téléchargements

Altmetric

Partager

More