ASTracer: An Efficient Tracing Tool for HDFS with Adaptive Sampling - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

ASTracer: An Efficient Tracing Tool for HDFS with Adaptive Sampling

Yang Song
  • Fonction : Auteur
  • PersonId : 1161689
Yunchun Li
  • Fonction : Auteur
  • PersonId : 1053387
Shuhan Wu
  • Fonction : Auteur
  • PersonId : 1161690
Hailong Yang
  • Fonction : Auteur
  • PersonId : 1053390
Wei Li
  • Fonction : Auteur
  • PersonId : 1053391

Résumé

Existing distributed tracing tools such as HTrace use static probabilistic samplers to collect the function call trees for performance analysis, which may fail to capture important but less executed function call trees and thus miss the opportunities for performance optimization. To address the above problem, we propose ASTracer, a new distributed tracing tool with two adaptive samplers. The advantage of adaptive samplers is that they can adjust the sampling rate dynamically, which is able to capture comprehensive function call trees and in the meanwhile maintain the size of trace file acceptable. In addition, we propose an auto-tuning mechanism to search for the optimal parameter settings of the adaptive samplers in ASTracer. The experiment results demonstrate the adaptive samplers are more effective in tracing the function call trees compared to probabilistic sampler. Moreover, we provide several case studies to demonstrate the usage of ASTracer in identifying potential performance bottlenecks.
Fichier principal
Vignette du fichier
486810_1_En_9_Chapter.pdf (464.95 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03770561 , version 1 (06-09-2022)

Licence

Paternité

Identifiants

Citer

Yang Song, Yunchun Li, Shuhan Wu, Hailong Yang, Wei Li. ASTracer: An Efficient Tracing Tool for HDFS with Adaptive Sampling. 16th IFIP International Conference on Network and Parallel Computing (NPC), Aug 2019, Hohhot, China. pp.107-119, ⟨10.1007/978-3-030-30709-7_9⟩. ⟨hal-03770561⟩
26 Consultations
37 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More