MEAD: A Multi-Armed Approach for Evaluation of Adversarial Examples Detectors - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

MEAD: A Multi-Armed Approach for Evaluation of Adversarial Examples Detectors

Résumé

Detection of adversarial examples has been a hot topic in the last years due to its importance for safely deploying machine learning algorithms in critical applications. However, the detection methods are generally validated by assuming a single implicitly known attack strategy, which does not necessarily account for real-life threats. Indeed, this can lead to an overoptimistic assessment of the detectors' performance and may induce some bias in the comparison between competing detection schemes. We propose a novel multi-armed framework, called MEAD, for evaluating detectors based on several attack strategies to overcome this limitation. Among them, we make use of three new objectives to generate attacks. The proposed performance metric is based on the worst-case scenario: detection is successful if and only if all different attacks are correctly recognized. Empirically, we show the effectiveness of our approach. Moreover, the poor performance obtained for state-of-the-art detectors opens a new exciting line of research.
Fichier principal
Vignette du fichier
2206.15415.pdf (838.45 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03909893 , version 1 (21-12-2022)

Identifiants

Citer

Federica Granese, Marine Picot, Marco Romanelli, Francisco Messina, Pablo Piantanida. MEAD: A Multi-Armed Approach for Evaluation of Adversarial Examples Detectors. ECML PKDD 2022 - European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, Sep 2022, Grenoble, France. ⟨10.1007/978-3-031-26409-2_18⟩. ⟨hal-03909893⟩
107 Consultations
32 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More