MUSS: Multilingual Unsupervised Sentence Simplification by Mining Paraphrases - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2022

MUSS: Multilingual Unsupervised Sentence Simplification by Mining Paraphrases

Abstract

Progress in sentence simplification has been hindered by a lack of labeled parallel simplification data, particularly in languages other than English. We introduce MUSS, a Multilingual Unsupervised Sentence Simplification system that does not require labeled simplification data. MUSS uses a novel approach to sentence simplification that trains strong models using sentencelevel paraphrase data instead of proper simplification data. These models leverage unsupervised pretraining and controllable generation mechanisms to flexibly adjust attributes such as length and lexical complexity at inference time. We show that this paraphrase data can be mined in any language from Common Crawl using semantic sentence embeddings, thus removing the need for labeled data. We evaluate our approach on English, French, and Spanish simplification benchmarks and closely match or outperform the previous best supervised results, despite not using any labeled simplification data. We push the state of the art further by incorporating labeled simplification data.
Fichier principal
Vignette du fichier
Martin-et-al.-MUSS-LREC2022.pdf (485.02 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03834719 , version 1 (30-10-2022)

Identifiers

  • HAL Id : hal-03834719 , version 1

Cite

Louis Martin, Angela Fan, Eric Villemonte de La Clergerie, Antoine Bordes, Benoît Sagot. MUSS: Multilingual Unsupervised Sentence Simplification by Mining Paraphrases. LREC 2022 - 13th Language Resources and Evaluation Conference, Jun 2022, Marseille, France. ⟨hal-03834719⟩
41 View
140 Download

Share

Gmail Facebook X LinkedIn More