Communication Dans Un Congrès Année : 2024

Resource-aware Deployment of Dynamic DNNs over Multi-tiered Interconnected Systems

Y. Wu
  • Fonction : Auteur
F. Malandrino
  • Fonction : Auteur
M. Levorato
  • Fonction : Auteur
C F Chiasserini
  • Fonction : Auteur

Résumé

The increasing pervasiveness of intelligent mobile applications requires to exploit the full range of resources offered by the mobile-edge-cloud network for the execution of inference tasks. However, due to the heterogeneity of such multi-tiered networks, it is essential to make the applications' demand amenable to the available resources while minimizing energy consumption. Modern dynamic deep neural networks (DNN) achieve this goal by designing multi-branched architectures where early exits enable sample-based adaptation of the model depth. In this paper, we tackle the problem of allocating sections of DNNs with early exits to the nodes of the mobile-edge-cloud system. By envisioning a 3-stage graph-modeling approach, we represent the possible options for splitting the DNN and deploying the DNN blocks on the multi-tiered network, embedding both the system constraints and the application requirements in a convenient and efficient way. Our framework -named Feasible Inference Graph (FIN) -can identify the solution that minimizes the overall inference energy consumption while enabling distributed inference over the multi-tiered network with the target quality and latency. Our results, obtained for DNNs with different levels of complexity, show that FIN matches the optimum and yields over 65% energy savings relative to a state-of-the-art technique for cost minimization.

Fichier principal
Vignette du fichier
ToN2025_dynamic_DNN_complete_final (2).pdf (4.19 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-05448965 , version 1 (08-01-2026)

Licence

Identifiants

Citer

Chetna Singhal, Y. Wu, F. Malandrino, M. Levorato, C F Chiasserini. Resource-aware Deployment of Dynamic DNNs over Multi-tiered Interconnected Systems. INFOCOM 2024 - IEEE Conference on Computer Communications, May 2024, Vancouver, France. pp.1621-1630, ⟨10.1109/INFOCOM52122.2024.10621218⟩. ⟨hal-05448965⟩
57 Consultations
235 Téléchargements

Altmetric

Partager

  • More