Enabling microservices management for Deep Learning applications across the Edge-Cloud Continuum - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2021

Enabling microservices management for Deep Learning applications across the Edge-Cloud Continuum

Abstract

Deep Learning has shifted the focus of traditional batch workflows to data-driven feature engineering on streaming data. In particular, the execution of Deep Learning workflows presents expectations of near-real-time results with user-defined acceptable accuracy. Meeting the objectives of such applications across heterogeneous resources located at the edge of the network, the core, and in-between requires managing trade-offs between the accuracy and the urgency of the results. However, current data analysis rarely manages the entire Deep Learning pipeline along the data path, making it complex for developers to implement strategies in real-world deployments. Driven by an object detection use case, this paper presents an architecture for time-critical Deep Learning workflows by providing a data-driven scheduling approach to distribute the pipeline across Edge to Cloud resources. Furthermore, it adopts a data management strategy that reduces the resolution of incoming data when potential trade-off optimizations are available. We illustrate the system's viability through a performance evaluation of the object detection use case on the Grid'5000 testbed. We demonstrate that in a multiuser scenario, with a standard frame rate of 25 frames per second, the system speed-up data analysis up to 54.4% compared to a Cloud-only-based scenario with an analysis accuracy higher than a fixed threshold.
Fichier principal
Vignette du fichier
SBAC_PAD2021_Zeina.pdf (390.17 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03409405 , version 1 (29-10-2021)

Identifiers

Cite

Zeina Houmani, Daniel Balouek-Thomert, Eddy Caron, Manish Parashar. Enabling microservices management for Deep Learning applications across the Edge-Cloud Continuum. SBAC-PAD 2021 - IEEE 33rd International Symposium on Computer Architecture and High Performance Computing, Oct 2021, Belo Horizonte, Brazil. pp.1-10, ⟨10.1109/SBAC-PAD53543.2021.00025⟩. ⟨hal-03409405⟩
171 View
318 Download

Altmetric

Share

Gmail Facebook X LinkedIn More