Inferring attributes with picture metadata embeddings - Inria - Institut national de recherche en sciences et technologies du numérique
Article Dans Une Revue ACM SIGAPP applied computing review : a publication of the Special Interest Group on Applied Computing Année : 2020

Inferring attributes with picture metadata embeddings

Résumé

Users in online social networks are vulnerable to attribute inference attacks due to some published data. Thus, the picture owner's gender has a strong influence on individuals' emotional reactions to the photo. In this work, we present a graph-embedding approach for gender inference attacks based on pictures meta-data such as (i) alt-texts generated by Facebook to describe the content of images, and (ii) Emojis/Emoticons posted by friends, friends of friends or regular users as a reaction to the picture. Specifically, we apply a semi-supervised technique, node2vec, for learning a mapping of pictures meta-data to a low-dimensional vector space. Next, we study in this vector space the gender closeness of users who published similar photos and/or received similar reactions. We leverage this image sharing and reaction mode of Facebook users to derive an efficient and accurate technique for user gender inference. Experimental results show that privacy attack often succeeds even when other information than pictures published by their owners is either hidden or unavailable.
Fichier principal
Vignette du fichier
attribute.pdf (569.4 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02996034 , version 1 (12-01-2021)

Identifiants

Citer

Bizhan Alipour Pijani, Abdessamad Imine, Michaël Rusinowitch. Inferring attributes with picture metadata embeddings. ACM SIGAPP applied computing review : a publication of the Special Interest Group on Applied Computing, 2020, 20 (2), pp.36-45. ⟨10.1145/3412816.3412819⟩. ⟨hal-02996034⟩
143 Consultations
201 Téléchargements

Altmetric

Partager

More