Paid Crowdsourcing, Low Income Contributors, and Subjectivity - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

Paid Crowdsourcing, Low Income Contributors, and Subjectivity

Giannis Haralabopoulos
  • Fonction : Auteur
  • PersonId : 1058254
Christian Wagner
  • Fonction : Auteur
  • PersonId : 1058255
Derek Mcauley
  • Fonction : Auteur
  • PersonId : 1058256
Ioannis Anagnostopoulos
  • Fonction : Auteur
  • PersonId : 992356

Résumé

Scientific projects that require human computation often resort to crowdsourcing. Interested individuals can contribute to a crowdsourcing task, essentially contributing towards the project’s goals. To motivate participation and engagement, scientists use a variety of reward mechanisms. The most common motivation, and the one that yields the fastest results, is monetary rewards. By using monetary, scientists address a wider audience to participate in the task. As the payment is below minimum wage for developed economies, users from developing countries are more eager to participate. In subjective tasks, or tasks that cannot be validated through a right or wrong type of validation, monetary incentives could contrast with the much needed quality of submissions. We perform a subjective crowdsourcing task, emotion annotation, and compare the quality of the answers from contributors of varying income levels, based on the Gross Domestic Product. The results indicate a different contribution process between contributors from varying GDP regions. Low income contributors, possibly driven by the monetary incentive, submit low quality answers at a higher pace, while high income contributors provide diverse answers at a slower pace.
Fichier principal
Vignette du fichier
484534_1_En_20_Chapter.pdf (297.3 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02363840 , version 1 (14-11-2019)

Licence

Paternité

Identifiants

Citer

Giannis Haralabopoulos, Christian Wagner, Derek Mcauley, Ioannis Anagnostopoulos. Paid Crowdsourcing, Low Income Contributors, and Subjectivity. 15th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), May 2019, Hersonissos, Greece. pp.225-231, ⟨10.1007/978-3-030-19909-8_20⟩. ⟨hal-02363840⟩
40 Consultations
13 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More