Out-of-the-Box and Into the Ditch? Multilingual Evaluation of Generic Text Extraction Tools - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue Language Resources and Evaluation Conference (LREC 2020) Année : 2020

Out-of-the-Box and Into the Ditch? Multilingual Evaluation of Generic Text Extraction Tools

Résumé

This article examines extraction methods designed to retain the main text content of web pages and discusses how the extraction could be oriented and evaluated: can and should it be as generic as possible to ensure opportunistic corpus construction? The evaluation grounds on a comparative benchmark of open-source tools used on pages in five different languages (Chinese, English, Greek, Polish and Russian), it features several metrics to obtain more fine-grained differentiations. Our experiments highlight the diversity of web page layouts across languages or publishing countries. These discrepancies are reflected by diverging performances so that the right tool has to be chosen accordingly.
Fichier principal
Vignette du fichier
2020.wac-1.2.pdf (276.01 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-02732851 , version 1 (02-06-2020)

Identifiants

  • HAL Id : hal-02732851 , version 1

Citer

Adrien Barbaresi, Gaël Lejeune. Out-of-the-Box and Into the Ditch? Multilingual Evaluation of Generic Text Extraction Tools. Language Resources and Evaluation Conference (LREC 2020), 2020, pp.5-13. ⟨hal-02732851⟩
97 Consultations
251 Téléchargements

Partager

Gmail Facebook X LinkedIn More