Deploying Heterogeneity-aware Deep Learning Workloads on the Computing Continuum - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2021

Deploying Heterogeneity-aware Deep Learning Workloads on the Computing Continuum

Thomas Bouvier
Alexandru Costan
Gabriel Antoniu

Abstract

The increasing need for real-time analytics motivated the emergence of new incremental methods to learn representations from continuous flows of data, especially in the context of the Internet of Things. This trend led to the evolution of centralized computing infrastructures towards interconnected processing units spanning from edge devices to cloud data centers. This new paradigm is referred to as the Computing or Edge-to-Cloud Continuum. However, the network and compute heterogeneity across and within clusters may negatively impact Deep Learning (DL) training. We introduce a roadmap for understanding the end-to-end performance of DL workloads in such heterogeneous settings. The goal is to identify key parameters leading to stragglers and devise novel intra- and inter-cluster strategies to address them. We will explore various policies aiming to improve makespan, cost and fairness objectives while ensuring system scalability.
Fichier principal
Vignette du fichier
bda_21_short_article.pdf (454.61 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03338520 , version 1 (08-09-2021)
hal-03338520 , version 2 (22-10-2021)

Identifiers

  • HAL Id : hal-03338520 , version 2

Cite

Thomas Bouvier, Alexandru Costan, Gabriel Antoniu. Deploying Heterogeneity-aware Deep Learning Workloads on the Computing Continuum. BDA 2021 - 37e Conférence sur la Gestion de Données - Principes, Technologies et Applications, Oct 2021, Paris, France. ⟨hal-03338520v2⟩
166 View
78 Download

Share

Gmail Facebook X LinkedIn More