UkraiNER: A New Corpus and Annotation Scheme Towards Comprehensive Entity Recognition - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2024

UkraiNER: A New Corpus and Annotation Scheme Towards Comprehensive Entity Recognition

Résumé

Named entity recognition as it is traditionally envisioned excludes in practice a significant part of the entities of potential interest for real-word applications: nested, discontinuous, non-named entities. Despite various attempts to broaden their coverage, subsequent annotation schemes have achieved little adoption in the literature and the most restrictive variant of NER remains the default. This is partly due to the complexity of those annotations and their format. In this paper, we introduce a new annotation scheme that offers higher comprehensiveness while preserving simplicity, together with an annotation tool to implement that scheme. We also release the corpus UkraiNER, comprised of 10,000 French sentences in the geopolitical news domain and manually annotated with comprehensive entity recognition. Our baseline experiments on UkraiNER provide a first point of comparison to facilitate future research (82 F1 for comprehensive entity recognition, 87 F1 when focusing on traditional nested NER), as well as various insights on the composition and challenges that this corpus presents for state-of-the-art named entity recognition models.
Fichier principal
Vignette du fichier
2792_Paper.pdf (208.62 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04629859 , version 1 (01-07-2024)

Licence

Identifiants

  • HAL Id : hal-04629859 , version 1

Citer

Lauriane Aufrant, Lucie Chasseur. UkraiNER: A New Corpus and Annotation Scheme Towards Comprehensive Entity Recognition. LREC-COLING 2024 - The 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation, May 2024, Torino, Italy. ⟨hal-04629859⟩

Collections

INRIA INRIA2
13 Consultations
15 Téléchargements

Partager

More