Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answering - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2021

Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answering

Abstract

Coupled with the availability of large scale datasets, deep learning architectures have enabled rapid progress on the Question Answering task. However, most of those datasets are in English, and the performances of state-of-the-art multilingual models are significantly lower when evaluated on non-English data. Due to high data collection costs, it is not realistic to obtain annotated data for each language one desires to support. We propose a method to improve the Cross-lingual Question Answering performance without requiring additional annotated data, leveraging Question Generation models to produce synthetic samples in a cross-lingual fashion. We show that the proposed method allows to significantly outperform the baselines trained on English data only. We report a new state-of-the-art on four multilingual datasets: MLQA, XQuAD, SQuAD-it and PIAF (fr).
Fichier principal
Vignette du fichier
2021.emnlp-main.562.pdf (593.81 Ko) Télécharger le fichier
Origin Publisher files allowed on an open archive

Dates and versions

hal-03109187 , version 1 (18-01-2024)

Identifiers

Cite

Arij Riabi, Thomas Scialom, Rachel Keraron, Benoît Sagot, Djamé Seddah, et al.. Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answering. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Nov 2021, Punta cana, Dominican Republic. ⟨10.18653/v1/2021.emnlp-main.562⟩. ⟨hal-03109187⟩
82 View
3 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More