Crowdsourcing Complex Language Resources: Playing to Annotate Dependency Syntax - Inria - Institut national de recherche en sciences et technologies du numérique
Conference Papers Year : 2016

Crowdsourcing Complex Language Resources: Playing to Annotate Dependency Syntax

Bruno Guillaume
Karën Fort
Nicolas Lefèbvre
  • Function : Author
  • PersonId : 990284

Abstract

This article presents the results we obtained on a complex annotation task (that of dependency syntax) using a specifically designed Game with a Purpose, ZombiLingo. We show that with suitable mechanisms (decomposition of the task, training of the players and regular control of the annotation quality during the game), it is possible to obtain annotations whose quality is significantly higher than that obtainable with a parser, provided that enough players participate. The source code of the game and the resulting annotated corpora (for French) are freely available.
Fichier principal
Vignette du fichier
coling2016_zl.pdf (461.8 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01378980 , version 1 (11-10-2016)

Identifiers

  • HAL Id : hal-01378980 , version 1

Cite

Bruno Guillaume, Karën Fort, Nicolas Lefèbvre. Crowdsourcing Complex Language Resources: Playing to Annotate Dependency Syntax. International Conference on Computational Linguistics (COLING), Dec 2016, Osaka, Japan. ⟨hal-01378980⟩
927 View
663 Download

Share

More