DNN Split Computing: Quantization and Run-length Coding are Enough - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2023

DNN Split Computing: Quantization and Run-length Coding are Enough

Résumé

Split computing, a recently developed paradigm, capitalizes on the computational resources of end devices to enhance the inference efficiency in machine learning (ML) applications. This approach involves the end device processing input data and transmitting intermediate results to a cloud server, which then completes the inference computation. While the main goals of split computing are to reduce latency, minimize energy consumption, and decrease data transfer overhead, minimizing data transmission time remains a challenge. Many existing strategies involve modifying the ML model architecture which ultimately requires resource-intensive retraining. In our work, we explore lossless and lossy techniques to encode intermediate results without modifying the ML model. Concentrating on image classification and object detection-two prevalent ML applications-we assess the advantages and limitations of each technique. Our findings indicate that simple tools, such as linear quantization and run-length encoding, already accomplish considerable information reduction, which is on par with more complex state-of-the-art techniques that necessitate model retraining. These tools are computationally efficient and do not burden the end device.
Fichier principal
Vignette du fichier
split_coding (4).pdf (480.78 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04762856 , version 1 (31-10-2024)

Licence

Identifiants

Citer

Damiano Carra, Giovanni Neglia. DNN Split Computing: Quantization and Run-length Coding are Enough. GLOBECOM 2023 - 2023 IEEE Global Communications Conference, Dec 2023, Kuala Lumpur, France. pp.7357-7362, ⟨10.1109/GLOBECOM54140.2023.10437445⟩. ⟨hal-04762856⟩
2 Consultations
3 Téléchargements

Altmetric

Partager

More