Use of a Citizen Science Platform for the Creation of a Language Resource to Study Bias in Language Models for French: a case study - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2022

Use of a Citizen Science Platform for the Creation of a Language Resource to Study Bias in Language Models for French: a case study

Abstract

There is a growing interest in the evaluation of bias, fairness and social impact of Natural Language Processing models and tools. However, little resources are available for this task in languages other than English. Translation of resources originally developed for English is a promising research direction. However, there is also a need for complementing translated resources by newly sourced resources in the original languages and social contexts studied. In order to collect a language resource for the study of biases in Language Models for French, we decided to resort to citizen science. We created three tasks on the LanguageARC citizen science platform to assist with the translation of an existing resource from English into French as well as the collection of complementary resources in native French. We successfully collected data for all three tasks from a total of 102 volunteer participants. Participants from different parts of the world contributed and we noted that although calls sent to mailing lists had a positive impact on participation, some participants pointed barriers to contributions due to the collection platform.
Fichier principal
Vignette du fichier
NovelIncentivesPaper.pdf (1016.99 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03693686 , version 1 (13-06-2022)

Identifiers

  • HAL Id : hal-03693686 , version 1

Cite

Karën Fort, Aurélie Névéol, Yoann Dupont, Julien Bezançon. Use of a Citizen Science Platform for the Creation of a Language Resource to Study Bias in Language Models for French: a case study. 2nd LREC Workshop on Novel Incentives in Data Collection from People, Jun 2022, Marseille, France. ⟨hal-03693686⟩
565 View
94 Download

Share

Gmail Facebook X LinkedIn More