ThePlantGame: Actively Training Human Annotators for Domain-specific Crowdsourcing - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2016

ThePlantGame: Actively Training Human Annotators for Domain-specific Crowdsourcing

Alexis Joly
Julien Champ
Esther Pacitti

Résumé

In a typical citizen science/crowdsourcing environment, the contributors label items. When there are few labels, it is straightforward to train contributors and judge the quality of their labels by giving a few examples with known answers. Neither is true when there are thousands of domain-specic labels and annotators with heterogeneous skills. This demo paper presents an Active User Training framework implemented as a serious game called The- PlantGame. It is based on a set of data-driven algorithms allowing to (i) actively train annotators, and (ii) evaluate the quality of contributors’ answers on new test items to optimize predictions.
Fichier principal
Vignette du fichier
TPG-demo-ACMM.pdf (570.13 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01373769 , version 1 (03-10-2016)

Licence

Identifiants

Citer

Maximilien Servajean, Alexis Joly, Dennis Shasha, Julien Champ, Esther Pacitti. ThePlantGame: Actively Training Human Annotators for Domain-specific Crowdsourcing. MM 2016 - 24th International Conference on Multimedia, Oct 2016, Amsterdam, Netherlands. pp.720-721, ⟨10.1145/2964284.2973820⟩. ⟨hal-01373769⟩
693 Consultations
246 Téléchargements

Altmetric

Partager

More