Load-aware shedding in stream processing systems - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2016

Load-aware shedding in stream processing systems


Load shedding is a technique employed by stream processing systems to handle unpredictable spikes in the input load whenever available computing resources are not adequately provisioned. A load shedder drops tuples to keep the input load below a critical threshold and thus avoid tuple queuing and system trashing. In this paper we propose Load-Aware Shedding (LAS), a novel load shedding solution that drops tuples with the aim of maintaining queuing times below a tunable threshold. Tuple execution durations are estimated at runtime using efficient sketch data structures. We provide a theoretical analysis proving that LAS is an (ε, δ)-approximation of the optimal online load shedder and show its performance through a practical evaluation based both on simulations and on a running prototype.
Fichier principal
Vignette du fichier
main-no-cc.pdf (516.81 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01413212 , version 1 (12-12-2016)



Nicoló Rivetti, Yann Busnel, Leonardo Querzoni. Load-aware shedding in stream processing systems. 10th ACM International Conference on Distributed and Event-based Systems (DEBS), Jun 2016, Irvine, United States. pp.61 - 68, ⟨10.1145/2933267.2933311⟩. ⟨hal-01413212⟩
704 View
210 Download



Gmail Facebook Twitter LinkedIn More