Bias in Face Image Classification Machine Learning Models: The Impact of Annotator’s Gender and Race - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Bias in Face Image Classification Machine Learning Models: The Impact of Annotator’s Gender and Race

Andreas Kafkalias
  • Fonction : Auteur
  • PersonId : 1406758
Stylianos Herodotou
  • Fonction : Auteur
  • PersonId : 1406759
Zenonas Theodosiou
  • Fonction : Auteur
  • PersonId : 1406760
Andreas Lanitis
  • Fonction : Auteur
  • PersonId : 992473

Résumé

An important factor that ensures the correct operation of Machine Learning models is the quality of data used during the model training process. Quite often, training data is annotated by humans, and as a result, annotation bias may be introduced. In this study, we focus on face image classification and aim to quantify the effect of annotation bias introduced by different groups of annotators, allowing in that way the understanding of the problems that arise due to annotation bias. The results of the experiments indicate that the performance of Machine Learning models in several face image interpretation tasks is correlated to the self-reported demographic characteristics of the annotators. In particular, we found significant correlation to annotator race, while correlation to gender is less profound. Furthermore, experimental results show that it is possible to determine the group of annotators involved in the annotation process by considering the annotation data provided by previously unseen annotators. The results emphasize the risks of annotation bias in Machine Learning models.
Fichier sous embargo
Fichier sous embargo
0 4 6
Année Mois Jours
Avant la publication
mercredi 1 janvier 2025
Fichier sous embargo
mercredi 1 janvier 2025
Connectez-vous pour demander l'accès au fichier

Dates et versions

hal-04668664 , version 1 (07-08-2024)

Licence

Identifiants

Citer

Andreas Kafkalias, Stylianos Herodotou, Zenonas Theodosiou, Andreas Lanitis. Bias in Face Image Classification Machine Learning Models: The Impact of Annotator’s Gender and Race. 18th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), Jun 2022, Hersonissos, Greece. pp.89-100, ⟨10.1007/978-3-031-08337-2_8⟩. ⟨hal-04668664⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More