Taming Energy Consumption Variations in Systems Benchmarking - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2020

Taming Energy Consumption Variations in Systems Benchmarking


The past decade witnessed the inclusion of power measurements to evaluate the energy efficiency of software systems, thus making energy a prime indicator along with performance. Nevertheless, measuring the energy consumption of a software system remains a tedious task for practitioners. In particular, the energy measurement process may be subject to a lot of variations that hinder the relevance of potential comparisons. While the state of the art mostly acknowledged the impact of hardware factors (chip printing process, CPU temperature), this paper investigates the impact of controllable factors on these variations. More specifically, we conduct an empirical study of multiple controllable parameters that one can easily tune to tame the energy consumption variations when benchmarking software systems. To better understand the causes of such variations, we ran more than a 1000 experiments on more than 100 machines with different workloads and configurations. The main factors we studied encompass: experimental protocol, CPU features (C-states, Turbo~Boost, core pinning) and generations, as well as the operating system. Our experiments showed that, for some workloads, it is possible to tighten the energy variation by up to 30×. Finally, we summarize our results as guidelines to tame energy consumption variations. We argue that the guidelines we deliver are the minimal requirements to be considered prior to any energy efficiency evaluation
Fichier principal
Vignette du fichier
ournani-icpe-20.pdf (970.89 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-02403379 , version 1 (24-01-2020)



Zakaria Ournani, Mohammed Chakib Belgaid, Romain Rouvoy, Pierre Rust, Joël Penhoat, et al.. Taming Energy Consumption Variations in Systems Benchmarking. ICPE'2020 - 11th ACM/SPEC International Conference on Performance Engineering, Apr 2020, Edmonton, Canada. ⟨10.1145/3358960.3379142⟩. ⟨hal-02403379⟩
490 View
470 Download



Gmail Mastodon Facebook X LinkedIn More