In support of push-based streaming for the computing continuum - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2023

In support of push-based streaming for the computing continuum

Résumé

Real-time data architectures are core tools for implementing the edge-to-cloud computing continuum since streams are a natural abstraction for representing and predicting the needs of such applications. Over the past decade, Big Data architectures evolved into specialized layers for handling real-time storage and stream processing. Open-source streaming architectures efficiently decouple fast storage and processing engines by implementing stream reads through a pull-based interface exposed by storage. However, how much data the stream source operators have to pull from storage continuously and how often to issue pull-based requests are configurations left to the application and can result in increased system resources and overall reduced application performance. To tackle these issues, this paper proposes a unified streaming architecture that integrates co-located fast storage and streaming engines through push-based source integrations, making the data available for processing as soon as storage has them. We empirically evaluate pull-based versus push-based design alternatives of the streaming source reader and discuss the advantages of both approaches.
Fichier principal
Vignette du fichier
article.pdf (506.95 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence
Copyright (Tous droits réservés)

Dates et versions

hal-04150523 , version 1 (04-07-2023)

Licence

Copyright (Tous droits réservés)

Identifiants

  • HAL Id : hal-04150523 , version 1

Citer

Ovidiu-Cristian Marcu, Pascal Bouvry. In support of push-based streaming for the computing continuum. 15th Asian Conference on Intelligent Information and Database Systems, Jul 2023, Phuket, Thailand. ⟨hal-04150523⟩
32 Consultations
111 Téléchargements

Partager

More