EASSE: Easier Automatic Sentence Simplification Evaluation - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year :

EASSE: Easier Automatic Sentence Simplification Evaluation


We introduce EASSE, a Python package aiming to facilitate and standardise automatic evaluation and comparison of Sentence Simplification (SS) systems. EASSE provides a single access point to a broad range of evaluation resources: standard automatic metrics for assessing SS outputs (e.g. SARI), word-level accuracy scores for certain simplification transformations, reference-independent quality estimation features (e.g. compression ratio), and standard test data for SS evaluation (e.g. TurkCorpus). Finally, EASSE generates easy-to-visualise reports on the various met-rics and features above and on how a particular SS output fares against reference simplifications. Through experiments, we show that these functionalities allow for better comparison and understanding of the performance of SS systems.
Fichier principal
Vignette du fichier
D19-3009.pdf (462.29 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02272950 , version 1 (22-01-2020)


  • HAL Id : hal-02272950 , version 1


Fernando Alva-Manchego, Louis Martin, Carolina Scarton, Lucia Specia. EASSE: Easier Automatic Sentence Simplification Evaluation. EMNLP-IJCNLP 2019 - Conference on Empirical Methods in Natural Language Processing and 9th International Joint Conference on Natural Language Processing (demo session), Nov 2019, Hong Kong, China. pp.49-54. ⟨hal-02272950⟩


80 View
201 Download


Gmail Facebook Twitter LinkedIn More