Studying the Energy Consumption of Stream Processing Engines in the Cloud - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2023

Studying the Energy Consumption of Stream Processing Engines in the Cloud

Abstract

Reducing the energy consumption of the global IT industry requires one to understand and optimize the large software infrastructures the modern data economy relies on. Among them are the data stream processing systems that are deployed in cloud data centers by companies, such as Twitter, to process billion of events per day in real time. However, studying the energy consumption of such infrastructures is difficult because they rely on a complex virtualized software ecosystem where attributing energy consumption to individual software components is a challenge, and because the space of possible configurations is large. We present GreenFlow, a principled methodology and tool designed to automate the deployment of energy measurement experiments for data stream processing systems in cloud environments. GreenFlow is designed to deliver reproducible results while remaining flexible enough to support a wide range of experiments. We illustrate its usage and show in particular that consolidating a DSP system in the smallest number of servers that are capable of processing it is an effective way to reduce energy consumption.
Fichier principal
Vignette du fichier
main.pdf (1.14 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-04164074 , version 1 (18-07-2023)

Licence

Attribution

Identifiers

  • HAL Id : hal-04164074 , version 1

Cite

Govind KP, Guillaume Pierre, Romain Rouvoy. Studying the Energy Consumption of Stream Processing Engines in the Cloud. IC2E 2023 - 11th IEEE International Conference on Cloud Engineering, IEEE, Sep 2023, Boston (MA), United States. pp.1-9. ⟨hal-04164074⟩
140 View
531 Download

Share

Gmail Facebook X LinkedIn More