Stragglers' Detection in Big Data Analytic Systems: The Impact of Heartbeat Arrival - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2022

Stragglers' Detection in Big Data Analytic Systems: The Impact of Heartbeat Arrival

Abstract

Speculative execution can significantly improve the performance of Big Data applications by launching other copies of stragglers (slow tasks). Stragglers detection plays an important role in the effectiveness of speculative execution. The methods employed to detect stragglers use the information extracted from the last received heartbeats which may be outdated when triggering detection. This, in turn, can mislead Big Data analytic systems to make wrong detection with high inaccuracy. To shed the light on this issue, we carry out extensive simulations to identify how heartbeat arrival, task starting times, and detection methods impact the accuracy of stragglers detection in Big Data analytic systems. We reveal that the asynchrony in heartbeat arrivals not only lead to marking normal tasks as stragglers (false positives) but can also result in overlooking real stragglers (false negatives).
Fichier principal
Vignette du fichier
CCGrid'22-CR.pdf (395.95 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03777656 , version 1 (08-12-2022)

Licence

Identifiers

Cite

Thomas Lambert, Shadi Ibrahim, Twinkle Jain, David Guyon. Stragglers' Detection in Big Data Analytic Systems: The Impact of Heartbeat Arrival. CCGrid 2022 - 22nd International Symposium on Cluster, Cloud and Internet Computing, May 2022, Taormina, Italy. pp.747-751, ⟨10.1109/CCGrid54584.2022.00084⟩. ⟨hal-03777656⟩
120 View
72 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More