Instagram Hashtags as Image Annotation Metadata - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2015

Instagram Hashtags as Image Annotation Metadata

Stamatios Giannoulakis
  • Fonction : Auteur
  • PersonId : 991066
Nicolas Tsapatsoulis
  • Fonction : Auteur
  • PersonId : 991067

Résumé

Image tagging is an essential step for developing automatic image annotation methods that are based on the learning by example paradigm. However, manual image annotation, even for creating training sets for machine learning algorithms, requires hard effort and contains human judgment errors and subjectivity. Thus, alternative ways for automatically creating training examples, i.e., pairs of images and tags, are pursued. In this work we investigate whether tags accompanying photos in social media and especially the Instagram hashtags, provide a form of image annotation. If such a claim is proved then Instagram could be a very rich source of training data, easily collectable automatically, for the development of automatic image annotation techniques. Our hypothesis is that Instagram hashtags, and especially those provided by the photo owner / creator, express more accurately the content of a photo compared to the tags assigned to a photo during explicit image annotation processes like crowdsourcing. In this context, we explore the descriptive power of hashtags by examining whether other users would use the same, with the owner, hashtags to annotate an image. For this purpose a set of 30 randomly chosen, from Instagram, images were used as a dataset for our research. Then, one to four hashtags, considered as the most descriptive ones for the image in question, were selected among the hashtags used by the image owner. Three online questionnaires with ten images each were distributed to experiment participants in order to choose the best suitable hashtag for every image according to their interpretation. Results show that an average of 55% of the participants hashtag choices coincide with those suggested by the photo owners; thus, an initial evidence towards our hypothesis confirmation can be claimed.
Fichier principal
Vignette du fichier
978-3-319-23868-5_15_Chapter.pdf (1.62 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01385356 , version 1 (21-10-2016)

Licence

Paternité

Identifiants

Citer

Stamatios Giannoulakis, Nicolas Tsapatsoulis. Instagram Hashtags as Image Annotation Metadata. 11th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI 2015), Sep 2015, Bayonne, France. pp.206-220, ⟨10.1007/978-3-319-23868-5_15⟩. ⟨hal-01385356⟩
300 Consultations
859 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More