A machine-learning-guided framework for fault-tolerant DNNs - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2023

A machine-learning-guided framework for fault-tolerant DNNs

Résumé

Deep Neural Networks (DNNs) show promising performance in several application domains. Nevertheless, DNN results may be incorrect, not only because of the network intrinsic inaccuracy, but also due to faults affecting the hardware. Ensuring the fault tolerance of DNN is crucial, but common fault tolerance approaches are not cost-effective, due to the prohibitive overheads for large DNNs. This work proposes a comprehensive framework to assess the fault tolerance of DNN parameters and cost- effectively protect them. As a first step, the proposed framework performs a statistical fault injection. The results are used in the second step with classification-based machine learning methods to obtain a bit-accurate prediction of the criticality of all network parameters. Last, Error Correction Codes (ECCs) are selectively inserted to protect only the critical parameters, hence entailing low cost. Thanks to the proposed framework, we explored and protected two Convolutional Neural Networks (CNNs), each with four different data encoding. The results show that it is possible to protect the critical network parameters with selective ECCs while saving up to 79% memory w.r.t. conventional ECC approaches.
Fichier principal
Vignette du fichier
DATE23_ExtendedAbstract.pdf (98.13 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03887681 , version 1 (13-02-2023)

Identifiants

  • HAL Id : hal-03887681 , version 1

Citer

Marcello Traiola, Angeliki Kritikakou, Olivier Sentieys. A machine-learning-guided framework for fault-tolerant DNNs. DATE 2023 – 26th IEEE/ACM Design, Automation and Test in Europe, Apr 2023, Antwerp, Belgium. pp.1-2. ⟨hal-03887681⟩
96 Consultations
247 Téléchargements

Partager

More